Lead Data Engineer
540
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
Amazon RedshiftAWSCloudETLPython
About the role
- Lead the design and implementation of enterprise-scale data pipelines and ETL processes in AWS environments
- Provide technical leadership and architectural guidance to cross-functional engineering teams
- Drive best practices for data modeling, pipeline optimization, and cloud infrastructure design
- Architect and implement solutions using Python, AWS Lambda, and modern data engineering frameworks
- Oversee code quality, conduct architectural reviews, and establish engineering standards
- Collaborate with stakeholders to translate complex business requirements into technical solutions
- Mentor and develop junior and senior engineers through code reviews and technical guidance
- Troubleshoot and resolve complex data engineering challenges across the technology stack
- Stay current with emerging technologies and recommend innovative approaches to data challenges
Requirements
- 9+ years of professional experience in data engineering or related technical roles
- Demonstrated experience as a technical lead or architect on complex data projects
- Expert-level proficiency in Python programming and software engineering best practices
- Deep understanding of AWS services including Lambda, S3, Step Functions, Glue, EMR, Redshift, and related data tools
- Strong experience with Git version control and collaborative development workflows
- Proven track record of designing and implementing scalable, high-performance data solutions
- Experience with data warehousing concepts, dimensional modeling, and analytics platforms
- Strong understanding of CI/CD pipelines and infrastructure-as-code principles
- Excellent communication skills with ability to explain complex technical concepts to diverse audiences
- Currently possess or be able to obtain within 30 days of hire:
- AWS Cloud Practitioner certification (or higher)
- CompTIA Security+ certification (or higher)
Benefits
- Flexible PTO + all Federal holidays off
- Health, dental and vision insurance plans
- Flexible Spending Account (FSA)
- 401k with employer match
- Company-sponsored life insurance, short- and long-term disability
- Professional development (training, certifications, conferences)
- Paid cloud developer accounts
- Referral bonuses
- HQ office perks (parking / metro reimbursement, nitro coffee & lunches)
- Annual social events (540 Week, hackathon, charity golf tournament, etc.)
- Access to 540’s Washington Capitals & Nationals tickets
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringETL processesPythondata modelingpipeline optimizationcloud infrastructure designdata warehousingdimensional modelingCI/CD pipelinesinfrastructure-as-code
Soft skills
technical leadershiparchitectural guidancementoringcommunicationcollaborationtroubleshootingproblem-solvingcode reviewsstakeholder engagementteam development
Certifications
AWS Cloud PractitionerCompTIA Security+