Lead Data Engineer – Data Transformation, Modeling, Architecture

Capital One

Lead Data Engineer at Capital One focusing on data transformation, modeling, and architecture. Collaborate across teams to support data solutions and governance.

Posted 5/19/2026full-timeRichmond • Massachusetts, Virginia • 🇺🇸 United StatesSenior💰 $179,400 - $225,100 per yearWebsite

Tech Stack

Tools & technologies

Amazon RedshiftAWSAzureCassandraCloudHadoopJavaKafkaLinuxMapReduceMySQLNoSQLPythonScalaShell ScriptingSparkSQLUnix

About the role

Key responsibilities & impact

Design and maintain comprehensive data models—spanning conceptual, logical, and physical layers
Architect and implement robust data ecosystem solutions, including Data Lake and Data Warehouse patterns
Support high-performance data pipelines and complex transformations that utilize SQL, Spark, and Python
Define and enforce rigorous data governance standards
Translate complex technical concepts into actionable business insights
Collaborate with and across Agile teams to design, develop, implement, and support technical solutions

Requirements

What you’ll need

Bachelor’s Degree
At least 4 years of experience in application development
At least 2 years of experience in big data technologies
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
4+ years of experience in Data Architecture / Data Modeling
7+ years of experience in application development including Python, SQL, Scala, or Java
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
4+ year experience working on real-time data and streaming applications
4+ years of experience with NoSQL implementation (Mongo, Cassandra)
4+ years of data warehousing experience (Redshift or Snowflake)
4+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices

Benefits

Comp & perks

Comprehensive health benefits
Performance-based incentive compensation
Employee wellness programs

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data modelingdata architectureSQLSparkPythonScalaJavaMapReduceHadoopNoSQL

Soft Skills

collaborationcommunicationproblem-solvingagile practicesdata governance

Certifications

Bachelor's Degree