
Lead Azure Databricks Engineer
Minor Hotels Europe and Americas
full-time
Posted on:
Location Type: Hybrid
Location: Manchester • United Kingdom
Visit company websiteExplore more
Job Level
About the role
- Design, develop, and optimise large-scale cloud data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark, and Unity Catalog
- Collaborate with underwriting, actuarial, Delegated Authority, bordereaux, exposure management, reinsurance, finance, and Solvency II teams to meet Lloyd’s market and regulatory requirements
- Translate business needs into scalable cloud data architectures by partnering with architects, SMEs, product owners, and senior leaders
- Own and resolve complex technical challenges while championing CI/CD automation, cloud-native best practices, data lifecycle management, and high engineering standards
- Oversee end-to-end data engineering delivery, ensuring pipeline reliability, observability, performance, resilience, and continuous improvement
Requirements
- Expert-level hands-on experience with Azure Data Services and Databricks in enterprise, highly regulated environments
- Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, distributed compute, data modelling, and performance optimisation
- Strong programming skills in Python, PySpark, and Spark SQL, with experience implementing CI/CD pipelines (Azure DevOps, branching/merging, automation)
- Solid knowledge of data governance, lineage, access controls, secure cloud engineering, and FinOps principles
Benefits
- Employee wellbeing focus
- Trained ‘Mental Health Champions’
- Access to wellbeing apps such as Thrive and Peppy
- Countless training and development opportunities
- Access to 250,000 courses and external certifications
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Azure Data FactoryData LakeKey VaultAzure FunctionsDatabricksDelta LakePySparkSpark SQLCI/CD automationdata modelling
Soft Skills
collaborationproblem-solvingcommunicationleadership