Senior Lead Data Engineer – Java, Python, Scala, AWS

Capital One

Senior Lead Data Engineer building Java, Python, and Scala cloud data platforms for Capital One’s personalized marketing systems. Leading developers and delivering scalable omnichannel messaging technology.

Posted 9/10/2026full-timeNew York City • California, New York, Texas, Virginia • 🇺🇸 United StatesSenior💰 $209,000 - $286,200 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in full-stack development, leveraging programming languages such as Java, Python, and Scala, along with cloud computing platforms like AWS and Azure. Proven ability to lead teams in building scalable, data-driven solutions while applying Agile methodologies and mentoring peers.

Highest-signal resume keywords

Full-Stack DevelopmentCloud Computing (AWS, Azure, Google Cloud)Machine LearningBig Data TechnologiesAgile Engineering Practices

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

JavaPythonScalaSQLNoSQL (Mongo, Cassandra)Data Warehousing (Redshift, Snowflake)Distributed Data/Computing Tools (Hadoop, Spark, Kafka)UNIX/LinuxAI-Assisted Coding Tools (Claude Code, GitHub Copilot)Real-Time Data Applications

Soft Skills

CollaborationMentoringCommunication

Tools & Technologies

Agile ToolsOpen-Source RDBMSCloud-Based Data Warehousing ServicesAdtech Channels

Certifications & Qualifications

Bachelor’s Degree

Industry Keywords

Application DevelopmentMicroservicesOmnichannel MessagingStreaming Applications

Tech Stack

Tools & technologies

Amazon RedshiftAWSAzureCassandraCloudHadoopJavaKafkaLinuxMapReduceMicroservicesMySQLNoSQLPythonRDBMSScalaShell ScriptingSparkSQLUnix

About the role

Key responsibilities & impact

Collaborate across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
Lead a team of developers experienced in machine learning, distributed microservices, and full-stack systems
Use Java, Scala, Python, open-source RDBMS and NoSQL databases, and cloud-based data warehousing services such as Redshift and Snowflake
Stay current with technology trends, experiment with and learn new technologies, participate in internal and external technology communities, and mentor engineering community members
Collaborate with digital product managers to deliver robust cloud-based solutions that create powerful experiences for millions of Americans
Perform unit tests and conduct code reviews to ensure rigorously designed, elegant, and performance-tuned code
Build scalable platforms delivering omnichannel messages across owned and paid Adtech channels

Requirements

What you’ll need

Bachelor’s Degree
At least 6 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate software delivery
9+ years of experience in application development including Python, SQL, Scala, or Java
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
5+ years of experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
4+ years of experience working on real-time data and streaming applications
4+ years of experience with NoSQL implementation (Mongo, Cassandra)
4+ years of data warehousing experience (Redshift or Snowflake)
4+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position

Benefits

Comp & perks

Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Comprehensive, competitive, and inclusive health, financial and other benefits supporting total well-being
Equal opportunity employer committed to non-discrimination
Reasonable accommodations for applicants with disabilities
Drug-free workplace