
Lead Data Engineer, Python, AWS, Spark, SQL, Snowflake, Databricks, GenAI
Capital One
full-time
Posted on:
Location Type: Hybrid
Location: Chicago • Illinois • Virginia • United States
Visit company websiteExplore more
Salary
💰 $179,400 - $225,100 per year
Job Level
Tech Stack
About the role
- Collaborate with and across Agile teams to develop, test, implement, and support technical solutions
- Work with a team of developers with experience in data movement, distributed computing, and full stack systems
- Utilize programming languages like Python, SQL and open source RDBMS and NoSQL databases
- Optimize information systems for end-user and downstream application consumers
- Share passion for tech trends and mentor other members of the engineering community
- Collaborate with digital product managers to deliver robust cloud-based solutions
Requirements
- Bachelor’s Degree
- At least 4 years of experience in application development (Internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
- Master’s Degree (Preferred)
- Experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot)
- 7+ years of experience in application development including Python, SQL, Spark, ETL tools, AWS Glue
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)
- 4+ year experience working on real-time data and streaming applications
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 4+ years of data warehousing experience (Redshift or Snowflake)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 4+ years experience with data modeling for data warehousing
- 2+ years of experience with Agile engineering practices
Benefits
- Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonSQLSparkETL toolsAWS GlueMapReduceHadoopHiveKafkaNoSQL
Soft Skills
collaborationmentoringcommunicationpassion for tech trends
Certifications
Bachelor’s DegreeMaster’s Degree