Big Data Engineer, Airflow/Snowflake
Sequoia Connect
AirflowApacheAWSCloudPythonSQL
Job Level
JuniorMid-Level
Tech Stack
AirflowAWSETLInformaticaPythonSQL
About the role
- Design and develop ETL workflows to move data from various sources into the organization's data warehouse.
- Develop and implement data quality controls and monitor data accuracy.
- Design and develop ML-based algorithms in Python to automate and optimize data processing.
- Work closely with cross-functional teams to ensure data solutions meet business requirements.
- Develop and maintain data processing and automation scripts using Python.
- Create data visualizations and provide insights to the data analytics team.
- Design and implement data security and access controls.
- Develop and maintain data pipelines and ETL workflows for various data sources.
Requirements
- Bachelor's degree in computer science, Information Systems, or related field.
- 2-5 years of experience in data processing and ETL using SQL, Informatica, AWS Glue , Airflow, Python, or similar tools.
- Experience with CI-CD with DevOps.
- Experience in designing and developing ML-based algorithms in Python.
- Strong knowledge of data analytics patterns and data processing techniques.
- Good communication and interpersonal skills to effectively communicate with cross-functional teams.
- Excellent problem-solving skills and the ability to work independently or as part of a team.
- Knowledge of data security and access control.
- Only Singaporean & Singapore PR can apply.
