Azure Data Engineering Lead
Minor Hotels Europe and Americas
full-time
Posted on:
Location Type: Office
Location: Alpharetta • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
ApacheAzureCloudETLPythonSparkSQL
About the role
- Design, configure, and optimize data architectures and pipelines to meet business needs.
- Develop and embed data engineering pipelines as part of multi-tenant B2B SaaS product.
- Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.
- Migrating existing data to new data model, including logging, reconciliation, data quality and error handling.
Requirements
- Extensive experience in data engineering, including data warehousing, data lakes, and lakehouses.
- Lead the design and implementation of data pipelines for ingesting, transforming, and loading data into Azure data & analytics services for structured and semi-structured data.
- Experience in developing data services and pipelines with API integration for multitenant application.
- Develop best practices including reusable code, libraries, patterns, and consumable frameworks for cloud-based data warehousing and ETL.
- Design and implement efficient data models and database schemas for structured and unstructured data, optimizing storage and access for performance and scalability.
- Strong analytical and problem-solving skills, with the ability to interpret complex data sets and derive meaningful insights.
- Extensive experience with Azure data & analytics services, including ADLS, Azure SQL, Cosmos DB, Data Factory, Synapse Analytics, Azure Functions, Azure App Service, Apache Spark, Python, Databricks, and other related services.
- Strong understanding and experience designing and development of data warehousing, data modeling, data integration, and ETL/ELT processes.
- Proficiency in scripting languages like Python, SQL, and/or other languages relevant to data engineering tasks.
- Understanding of data governance principles, data security best practices, and compliance requirements.
- Experience with data modeling and database design principles.
- Familiarity with data governance and security best practices.
- Provide advanced troubleshooting and resolution of data pipelines and operations issues.
- Experience with relational databases and data warehouse technologies.
- Proven leadership skills, with the ability to lead, mentor, and motivate a team.
- Oversee a team of data engineers, providing technical guidance, mentorship, and support.
- Excellent written and verbal communication skills, with the ability to effectively communicate technical information to both technical and non-technical audiences.
- Familiarity with Agile project management methodologies
Benefits
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs
- Financial well-being programs such as 401(k) and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized back-up child/elder care and tutoring
- Mentoring, coaching and learning programs
- Employee Resource Groups
- Disaster Relief
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
data engineeringdata warehousingdata lakeslakehousesdata pipelinesETLdata modelingAPI integrationscripting languagesdata governance
Soft skills
analytical skillsproblem-solving skillsleadership skillsmentoringcommunication skills