
Data Engineer – Gen AI
Minor Hotels Europe and Americas
full-time
Posted on:
Location Type: Office
Location: Atlanta • 🇺🇸 United States
Visit company websiteSalary
💰 $110,000 - $115,000 per year
Job Level
SeniorLead
Tech Stack
AzureCloudETLPythonSparkSQLTerraform
About the role
- Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, and Databricks.
- Ingest, transform, and curate structured and unstructured data from diverse sources for AI/ML consumption.
- Optimize data workflows for performance, reliability, and cost-efficiency.
- Enable data access and preparation for Azure AI services including Azure Machine Learning, Azure OpenAI, and Cognitive Services.
- Collaborate with data scientists and ML engineers to operationalize AI models using MLOps and GenAIOps practices.
- Support RAG (Retrieval-Augmented Generation) and other GenAI patterns through data engineering best practices.
- Implement CI/CD pipelines for data workflows using Azure DevOps or GitHub Actions.
- Automate infrastructure provisioning using Terraform, Bicep, or ARM templates.
- Monitor and troubleshoot data pipelines and cloud resources using Azure Monitor and Log Analytics.
Requirements
- 8- 10+ years of experience in data engineering, cloud platforms, and big data technologies.
- Strong proficiency in Azure services: Data Factory, Synapse, Data Lake, Azure SQL, Cosmos DB.
- Experience with Python, Spark, SQL, and distributed data processing.
- Familiarity with AI/ML workflows and tools such as Azure ML, MLflow, and OpenAI APIs.
- Understanding of data governance, security, and compliance in cloud environments.
Benefits
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs
- Financial well-being programs such as 401(k) and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized back-up child/elder care and tutoring
- Mentoring, coaching and learning programs
- Employee Resource Groups
- Disaster Relief
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLELTAzure Data FactorySynapse PipelinesDatabricksPythonSparkSQLTerraformCI/CD
Soft skills
collaborationtroubleshootingoptimizationcommunicationproblem-solving