Tech Stack
AirflowApacheAWSETLFlaskKafkaPythonSparkSQLTerraform
About the role
- Provide hands-on technical guidance and ensure best practices in architecture, coding, and design.
- Collaborate closely with clients to understand IT environments, business needs, and digital transformation goals.
- Take ownership of project outcomes, ensuring timely delivery and alignment with client expectations.
- Proactively identify risks, challenges, and opportunities for improvement, and drive solutions forward.
- Work directly with ML Engineers to create resilient data pipelines powering Data Products.
- Define data models to integrate disparate data across organizations.
- Design, implement, and maintain ETL/ELT pipelines using modern tools.
- Perform large-scale data transformations with **Spark, Trino, AWS Athena**.
- Develop, test, and deploy Data API Products with **Python** and frameworks like **Flask/FastAPI**.
Requirements
- 5+ years of **hands-on data engineering experience**.
- Proven track record in **team leadership and technical advising**.
- Strong problem-solving skills and ability to take ownership in dynamic settings.
- Solid expertise in **AWS**.
- Experience handling **real-time and batch data pipelines** with tools like **Airflow, Dagster, Kafka, Apache Druid, Spark, dbt**.
- Proficiency in **Python and SQL**.
- Familiarity with IaC tools (**Terraform, AWS CloudFormation**).
- Experience in **building scalable APIs**.
- Understanding of **Data Governance** (quality, lineage, security, glossary, MDM, cost optimization).
- **English: Upper-Intermediate+**.
- Work on **cutting-edge Data & AI projects** for global enterprises.
- Be part of a collaborative, innovative, and supportive culture.
- Grow your expertise in **Data, AI/ML, and Cloud technologies**.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringETLELTdata transformationsPythonSQLdata modelsreal-time data pipelinesbatch data pipelinesAPI development
Soft skills
team leadershiptechnical advisingproblem-solvingownershipcollaborationrisk identificationsolution drivingcommunication