GCP Engineer
qode.world
AirflowApacheBigQueryCloudETLGoogle Cloud PlatformKubernetesPythonShell ScriptingSparkSQLTensorflow+1 more
Job Level
Senior
Tech Stack
AirflowApacheBigQueryCloudETLGoogle Cloud PlatformNumpyPandasPythonSparkSQL
About the role
- Take full ownership of designing, building, and deployment of data infrastructures.
- Work with researchers, data scientists and product managers.
- Create a new industry-altering product from its inception to production level.
Requirements
- At least 2 years of demonstrated experience in software development.
- At least 5 years of experience in building data stream pipelines and ETL using Big Data frameworks such as Spark, Apache Airflow, and BigQuery.
- Advanced proficiency in Python and SQL.
- Experience with various types of databases.
- Skilled in using Python data analysis libraries (e.g., Pandas, Numpy, Arrow).
- Proven experience in deploying pipelines on the cloud (GCP preferred), including testing, staging, and monitoring.
- Proficient in applying software engineering best practices, including coding standards, code reviews, CI/CD, and testing.
- B.Sc in Computer Science or a related scientific field.
Similar jobs on JobTailor
Junior Data Engineer
Dev.Pro
AirflowApacheBigQueryCloudDockerETLGoogle Cloud PlatformPythonSQL
Data Engineer, Retail Media
Schwarz Corporate Solutions
AirflowApacheBigQueryCloudGoogle Cloud PlatformKubernetesPythonSparkSQL
Senior Data Engineer
Madhive
AirflowApacheBigQueryCloudDistributed SystemsETLGoogle Cloud PlatformJavaScriptKafkaNoSQLPostgresSQL
Senior Data Engineer, Snowflake
Data Ideology, LLC
AirflowAWSAzureCloudETLGoogle Cloud PlatformInformaticaPythonSQL