Senior Data Engineer
NBCUniversal
ApacheCloudETLJavaPythonScalaSpark
Senior Lead Data Engineer
Capital One
full-time
Posted on:
Location Type: Office
Location: Chicago • Illinois, Virginia • 🇺🇸 United States
Visit company websiteSalary
💰 $204,900 - $233,800 per year
Job Level
Senior
Tech Stack
Amazon RedshiftAWSAzureCassandraCloudHadoopJavaKafkaLinuxMapReduceMicroservicesMySQLNoSQLOpen SourcePythonRDBMSScalaShell ScriptingSparkSQLUnix
About the role
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
- Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
- Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
- Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
- Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Requirements
- Bachelor's Degree
- At least 6 years of experience in application development (Internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
- Master's Degree (Preferred)
- 9+ years of experience in application development including Python, SQL, Scala, or Java (Preferred)
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) (Preferred)
- 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) (Preferred)
- 4+ year experience working on real-time data and streaming applications (Preferred)
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra) (Preferred)
- 4+ years of data warehousing experience (Redshift or Snowflake) (Preferred)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting (Preferred)
- 2+ years of experience with Agile engineering practices (Preferred)
Benefits
- Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
JavaScalaPythonSQLNoSQLMapReduceHadoopHiveKafkaSpark
Soft skills
collaborationleadershipmentoringcommunicationproblem-solvingadaptabilityteamworkpassion for technologycode reviewunit testing
Certifications
Bachelor's DegreeMaster's Degree
