Metric5

Senior Data Architecture Consultant

Metric5

full-time

Posted on:

Location Type: Hybrid

Location: DC Metro Area • District of Columbia • 🇺🇸 United States

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

Amazon RedshiftApacheAWSCloudDockerEC2GroovyJenkinsKubernetesOpenShiftPostgresPythonScalaSQL

About the role

  • Define and articulate a multi-year technical vision and roadmap for the data lake, encompassing data ingestion, processing, storage, governance, and consumption layers
  • Act as the primary technical interface for customer stakeholders, ensuring all architectural decisions and development activities directly address and prioritize the customer's mission-critical needs and objectives
  • Serve as a technical leader in driving innovation across the data platform and actively implement initiatives defined by the existing Center of Excellence (CoE) and Innovation teams
  • Collaborate closely with cross-functional development, data science, and engineering teams (DevSecOps, AWS, Databricks) to translate architecture into actionable implementation plans, providing guidance and mentorship
  • Coordinate and synchronize technical activities across multiple workstreams (data ingestion, graph services, and data consumption) to manage interdependencies, mitigate risks, and ensure the timely delivery of integrated solutions
  • Lead end-to-end technical design and architecture reviews, focusing on optimal use of Databricks E2/Delta Lake features
  • Architect robust and secure interfaces for both internal and external data exchange, managing technical discussions with various data source owners (internal/external to USCIS)
  • Lead code and design reviews to uphold high-quality standards, ensuring scalability, security, and maintainability across the Python, Scala, Apache Groovy, and PL/SQL code base

Requirements

  • Must be a U.S. Citizen and capable of obtaining/maintaining appropriate government clearance
  • Bachelors or masters degree in computer science, software engineering, or a related field
  • 12+ years of progressive experience in data architecture, with at least 5 years in a senior or principal role defining data lake or modern data warehouse strategies
  • Expert-level proficiency and architectural experience with Databricks E2, Delta Lake, and MlFlow
  • Mandatory, deep, and proven experience in architecting solutions centered on Graph Data and Entity Resolution, specifically leveraging Senzing (Senzing Runtime API v3.10.2)
  • Familiarity with integrating and utilizing platforms like Sprinklr and CopyStorm into the Delta Lake architecture
  • Expert-level knowledge of AWS foundational services, including S3, EC2, RDS (PostgreSQL), ELB, DMS, and EBS
  • Extensive experience designing and optimizing solutions using AWS Redshift, AWS Athena, and AWS Glue
  • Proficiency in defining and managing infrastructure using CloudFormation Templates (CFT)
  • Expert-level proficiency in at least two of the primary data lake languages: Python, Scala, or Apache Groovy
  • Experience with Jenkins/Liquibase deployment strategies across AWS Commercial Cloud and OpenShift
  • Experience with OpenShift, Docker/Kubernetes, and optionally EKS
Benefits
  • Health & Dental Insurance with 100% of individual coverage paid for by the company
  • Vision Insurance
  • Life & Short Term Disability Insurance
  • 401k with company match (employees are immediately vested)
  • Paid Vacation
  • 9 Paid Holidays per year (plus 2 paid floating holidays)
  • Parental Leave
  • Employee Bonuses
  • Professional Development Reimbursement Program
  • Tuition Assistance Program

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data architecturedata lakeDatabricks E2Delta LakeMlFlowGraph DataEntity ResolutionPythonScalaApache Groovy
Soft skills
technical leadershipcollaborationmentorshipcommunicationrisk managementinnovation