Lead Data Engineer, Python, AWS, SQL, GenAI

Capital One

Lead Data Engineer building Python, AWS, SQL, and GenAI-powered data platforms for Capital One’s personalized marketing systems. Delivering scalable omnichannel messaging and customer experiences.

Posted 9/10/2026full-timeNew York City • California, New York, Texas, Virginia • 🇺🇸 United StatesSenior💰 $179,400 - $245,600 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in application development with a strong focus on big data technologies, cloud computing, and machine learning. Proficient in building scalable solutions and mentoring team members while adhering to Agile practices.

Highest-signal resume keywords

Application DevelopmentBig Data TechnologiesCloud ComputingMachine LearningAgile Engineering Practices

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

JavaScalaPythonSQLNoSQLData WarehousingData ModelingUnit TestingCode ReviewShell Scripting

Soft Skills

CollaborationMentoringCommunication

Tools & Technologies

AWSMicrosoft AzureGoogle CloudRedshiftSnowflakeDistributed MicroservicesOmnichannel Messaging PlatformsAI-Assisted Coding Tools

Industry Keywords

AgileCloud-Based SolutionsReal-Time DataStreaming ApplicationsOpen-Source RDBMS

Tech Stack

Tools & technologies

Amazon RedshiftAWSAzureCloudJavaLinuxMicroservicesNoSQLPythonRDBMSScalaShell ScriptingSQLUnix

About the role

Key responsibilities & impact

Collaborate across Agile teams to design, develop, test, implement, and support technical solutions
Work with developers experienced in machine learning, distributed microservices, and full-stack systems
Use Java, Scala, Python, open-source RDBMS and NoSQL databases, Redshift, Snowflake, and cloud-based data warehousing services
Stay current with technology trends, experiment with and learn new technologies, participate in technology communities, and mentor engineering community members
Collaborate with digital product managers to deliver robust cloud-based solutions supporting customer experiences
Perform unit tests and conduct code reviews to ensure rigorously designed, elegant, and performant code
Build scalable omnichannel messaging platforms delivering hyper-personalized experiences through owned and paid Adtech channels

Requirements

What you’ll need

Bachelor’s Degree
At least 4 years of experience in application development (Internship experience does not apply)
At least 2 years of experience in big data technologies
At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
No employment authorization sponsorship or immigration-related support for new applicants
Preferred: Master’s Degree
Preferred: 1+ years of experience leveraging AI-assisted coding tools such as Claude Code and GitHub Copilot
Preferred: 7+ years of experience in application development including Python, SQL, Scala, or Java
Preferred: 4+ years of experience with a public cloud
Preferred: 4+ years of experience with distributed data/computing tools
Preferred: 4+ years of experience working on real-time data and streaming applications
Preferred: 4+ years of experience with NoSQL implementation
Preferred: 4+ years of data warehousing experience
Preferred: 4+ years of experience with UNIX/Linux, basic commands, and shell scripting
Preferred: 4+ years of experience with data modeling for data warehousing
Preferred: 2+ years of experience with Agile engineering practices

Benefits

Comp & perks

Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Comprehensive, competitive, and inclusive health, financial and other benefits supporting total well-being
Reasonable accommodations for applicants who require them
Equal opportunity and non-discrimination protections
Drug-free workplace