Explore more
Tech Stack
About the role
- Design, build, and operate **robust ingestion pipelines** for batch and near-real-time data using AWS-native services
- Implement **CDC-based ingestion patterns** for databases, SaaS platforms, and external partners
- Standardize ingestion frameworks for files, APIs, event streams, and cross-account data sharing
- Define and maintain **raw and staging data models** that preserve source fidelity and lineage
- Partner with source system owners to define ingestion SLAs, contracts, schemas, and change management strategies
- Ensure ingestion pipelines meet **data quality, observability, and reliability standards**
- Implement metadata capture, schema evolution handling, and data validation at ingestion time
- Automate infrastructure using **AWS CDK** and integrate CI/CD pipelines via CodeCommit and CodePipeline
- Optimize ingestion workflows for scalability, cost efficiency, and fault tolerance
- Support Agile delivery and collaborate closely with offshore engineering teams
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a quantitative field
- 5+ years of experience in data engineering, with a strong focus on **data ingestion and integration**
- Strong understanding of **change data capture (CDC)** concepts and ingestion patterns
- Hands-on experience with AWS services such as **Lambda, Step Functions, MWAA, Glue, Redshift**
- Experience building ingestion pipelines for **APIs, files, databases, and event-based systems**
- Proficiency in **Python** and familiarity with data serialization formats (JSON, Parquet, Avro)
- Experience implementing infrastructure as code using **AWS CDK**
- Working knowledge of CI/CD, version control, and automated deployments
- Strong collaboration skills and comfort working with distributed offshore teams
- Detail-oriented, proactive, and ownership-driven mindset
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data ingestiondata integrationchange data captureAWS LambdaAWS Step FunctionsAWS MWAAAWS GlueAWS RedshiftPythoninfrastructure as code
Soft Skills
collaborationdetail-orientedproactiveownership-driven
Certifications
Bachelor’s degreeMaster’s degree