Data Engineer
Greenlight
full-time
Posted on:
Location Type: Hybrid
Location: Bengaluru • India
Visit company websiteExplore more
About the role
- Building and maintaining scalable data pipelines using Airflow to orchestrate data workflows that ingest, transform, and deliver data from various sources into Snowflake and Databricks.
- Designing and implementing data models in Snowflake that support analytics, reporting, and ML use cases with a focus on performance, reliability, and scalability.
- Developing infrastructure as code using Terraform to automate and manage cloud resources in AWS, ensuring consistent and reproducible deployments.
- Monitoring data pipeline health and implementing data quality checks to ensure accuracy, completeness, and timeliness of data as business needs evolve.
- Optimizing data processing workflows to improve performance, reduce costs, and handle growing data volumes efficiently.
- Troubleshooting and resolving data pipeline issues, working through ambiguity to get to the root cause and implementing long-term fixes.
- Bridging gaps between data and the business by working with cross-functional teams across the US and India office to understand requirements and translate them into robust technical solutions.
- Creating comprehensive documentation on data pipelines, data models, and infrastructure, keeping documentation up to date and facilitating knowledge transfer across the team.
Requirements
- 2+ years of data engineering experience with strong technical skills and the ability to architect scalable data solutions.
- Hands-on experience with Python for data processing, automation, and building data pipelines.
- Proficiency with workflow orchestration tools, preferably Airflow, including DAG development, task dependencies, and monitoring.
- Strong SQL skills and experience with cloud data warehouses like Snowflake, including performance optimization and data modeling.
- Experience with cloud platforms, preferably AWS (S3, Lambda, EC2, IAM, etc.), and understanding of cloud-based data architectures.
- Experience working cross-functionally with data analysts, analytics engineers, data scientists, and business stakeholders to understand requirements and deliver solutions.
- An ownership mentality – this engineer will be responsible for the reliability and performance of their data pipelines and expected to fully understand data flows, dependencies, and their implications on downstream users.
- A proactive mindset. While work is assigned, engineers are expected to independently drive their work forward, ask thoughtful questions, and bring structure to ambiguous technical problems.
Benefits
- Greenlight is an equal opportunity employer and will not discriminate against any employee or applicant based on age, race, color, national origin, gender, gender identity or expression, sexual orientation, religion, physical or mental disability, medical condition (including pregnancy, childbirth, or a medical condition related to pregnancy or childbirth), genetic information, marital status, veteran status, or any other characteristic protected by federal, state or local law.
- Greenlight is committed to an inclusive work environment and interview experience. If you require reasonable accommodations to participate in our hiring process, please reach out to your recruiter directly or email recruiting@greenlight.me.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data engineeringPythonSQLdata modelingworkflow orchestrationAirflowTerraformcloud data architecturedata processingdata quality checks
Soft Skills
ownership mentalityproactive mindsetcross-functional collaborationproblem-solvingcommunicationdocumentationambiguity resolutiontechnical solution translationteamworkknowledge transfer