
Senior Data Engineer, GCP
Minor Hotels Europe and Americas
full-time
Posted on:
Location Type: Hybrid
Location: New York City • New York • United States
Visit company websiteExplore more
Job Level
About the role
- Contribute to the migration of legacy data warehouse to a google cloud-based data warehouse
- Collaborate with Data Product Managers, Data Architects to design, implement, and deliver successful data solutions
- Help architect data pipelines for the underlying data warehouse and data marts
- Design and develop very complex ETL pipelines in Google cloud Data environments
- Maintain detailed documentation of your work and changes to support data quality and data governance
- Support QA and UAT data testing activities
- Support Deployment activities to higher environments
- Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams)
- Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team
Requirements
- 4 to 8+ years of data engineering experience developing large data pipelines in very complex environments
- Very Strong SQL skills and ability to build Very complex transformation data pipelines using custom ETL framework in Google BigQuery environment
- Exposure to Teradata and ability to understand complex Teradata BTEQ scripts
- Strong Python programming skills
- Strong Skills on build Airflow Jobs and Debug issues
- Ability to Optimize the Query in BigQuery
- Hands-on experience on Google Cloud data Technologies (GCS, BigQuery, Dataflow, Pub sub, Data Fusion, Cloud Function)
Benefits
- Professional development
- Remote work options
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
SQLETLPythonAirflowBigQueryDataflowPub/SubData FusionCloud FunctionsTeradata
Soft Skills
collaborationdocumentationdata qualitydata governanceQA testingUAT testingoperational efficiencyagilescrumprocess improvement