FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAzureCloudETLPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Lead the design and implementation of scalable data architectures on Azure, leveraging Databricks, Delta Lake, and related Azure data services.
- Build and optimize high‑volume ETL/ELT pipelines using PySpark, SQL, Databricks Workflows, and Delta Live Tables.
- Define and enforce best practices for data engineering across notebooks, jobs, CI/CD, Unity Catalog, security, and workspace governance.
- Integrate and orchestrate data pipelines using Azure Data Factory, Azure Synapse pipelines, or Azure Databricks Workflows.
- Drive performance tuning for Spark jobs, cluster configurations, and data storage layers to balance speed and cost efficiency.
- Implement robust data quality and validation frameworks using tools like Great Expectations, DLT expectations, or custom PySpark checks.
- Ensure compliance, governance, and lineage tracking through Unity Catalog, Purview integration, and RBAC/ABAC policies.
- Architect end‑to‑end data solutions supporting analytics, ML, actuarial models, and business-critical reporting workloads.
- Evaluate new Databricks features, MLflow enhancements, Photon execution, serverless compute, and recommend adoption strategies.
- Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc.
Requirements
What you’ll need- 8-12 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
- Bachelor’s degree in computer science, Information Technology, or related field.
- Strong proficiency in PySpark, Python, SQL.
- Strong experience in data modeling, ETL/ELT pipeline development, and automation
- Hands-on experience with performance tuning of data pipelines and workflows
- Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
- Experience with data modeling, ETL processes, Delta Lake and data warehousing.
- Experience on Delta Live Tables, Autoloader & Unity Catalog.
- Preferred - Knowledge of the insurance industry and its data requirements.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
- Excellent communication and problem-solving skills to work effectively with diverse teams
- Excellent problem-solving skills and ability to work under tight deadlines.
Benefits
Comp & perks- 🌐 Worldwide ❌ Jobs You've Hidden ⭐️ Saved Jobs ✅ Applied Jobs ✉️ Email Alerts 👤 Account EXL Website LinkedIn All Job Openings 10,000+ employees 💰 $2M Venture Round on 2015-01 Choosing a digital partner is about more than capabilities — it’s about collaboration and character. Lead Data Engineer 🔥 57 minutes ago 🏢🏡 Gurugram – Hybrid ⏰ Full Time 🟠 Senior 🚰 Data Engineer Azure Cloud ETL PySpark Python Spark SQL Unity Apply Now Find Hiring Managers Customize resume + cover letter Report problem ☆ Save ☑️ Mark as applied ❌ Hide 📋 Description
- Lead the design and implementation of scalable data architectures on Azure, leveraging Databricks, Delta Lake, and related Azure data services.
- Build and optimize high‑volume ETL/ELT pipelines using PySpark, SQL, Databricks Workflows, and Delta Live Tables.
- Define and enforce best practices for data engineering across notebooks, jobs, CI/CD, Unity Catalog, security, and workspace governance.
- Integrate and orchestrate data pipelines using Azure Data Factory, Azure Synapse pipelines, or Azure Databricks Workflows.
- Drive performance tuning for Spark jobs, cluster configurations, and data storage layers to balance speed and cost efficiency.
- Implement robust data quality and validation frameworks using tools like Great Expectations, DLT expectations, or custom PySpark checks.
- Ensure compliance, governance, and lineage tracking through Unity Catalog, Purview integration, and RBAC/ABAC policies.
- Architect end‑to‑end data solutions supporting analytics, ML, actuarial models, and business-critical reporting workloads.
- Evaluate new Databricks features, MLflow enhancements, Photon execution, serverless compute, and recommend adoption strategies.
- Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc. 🎯 Requirements
- 8-12 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
- Bachelor’s degree in computer science, Information Technology, or related field.
- Strong proficiency in PySpark, Python, SQL.
- Strong experience in data modeling, ETL/ELT pipeline development, and automation
- Hands-on experience with performance tuning of data pipelines and workflows
- Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
- Experience with data modeling, ETL processes, Delta Lake and data warehousing.
- Experience on Delta Live Tables, Autoloader & Unity Catalog.
- Preferred - Knowledge of the insurance industry and its data requirements.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
- Excellent communication and problem-solving skills to work effectively with diverse teams
- Excellent problem-solving skills and ability to work under tight deadlines. Apply Now 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score Similar Jobs Graph Data Engineer 🕒 June 26 S&P Global 10,000+ employees 💸 Finance 🏢 Enterprise 🤖 Artificial Intelligence Website LinkedIn All Job Openings Graph Data Engineer creating graph-powered data solutions leveraging AI for S&P Global. Collaborating with cross-functional teams to enhance data-driven decision-making through innovative approaches. 🏢🏡 Gurugram – Hybrid ⏰ Full Time 🟡 Mid-level 🟠 Senior 🚰 Data Engineer AWS Azure Cloud Neo4j Node.js Python SQL Senior Data Engineer 🕒 April 20 Alkami Technology 501 - 1000 🏦 Banking 💳 Fintech ☁️ SaaS Website LinkedIn All Job Openings Senior Data Engineer building data lakes and warehousing solutions for a B2B multi-tenant SaaS. Leading technical processes and collaborating with cross-functional teams. 🏢🏡 Gurugram – Hybrid 💰 $300M Post-IPO Debt - Alkami Technology on 2025-03 ⏰ Full Time 🟠 Senior 🚰 Data Engineer AWS Cassandra Cloud DynamoDB ETL Kafka Kubernetes MongoDB NoSQL Postgres Python SQL Terraform View More Data Engineer Jobs 🌐 Worldwide Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com Search Search Jobs by country Search jobs by city Search jobs by job title Search entry-level jobs Search junior-level jobs Search senior-level jobs Search jobs by tech stack Search jobs by contract type Search remote internships Search remote part-time jobs Remote jobs Anywhere in the World Companies Hiring Anywhere in the World Companies Hiring Sales People Anywhere in the World Companies Hiring Software Engineers Anywhere in the World Resources Advice Tips for finding remote jobs Interview questions and answers Resume examples Cover letter examples Post a job Affiliates Privacy policy Terms of service Job board SEO course AI Apply Copilot OpenClaw job finder Find jobs using your resume Jobs by Country Remote jobs anywhere in the world (Worldwide remote jobs) Remote jobs United States Remote jobs Australia Remote jobs Brazil Remote jobs Canada Remote jobs France Remote jobs Ireland Remote jobs Germany Remote jobs Netherlands Remote jobs Spain Remote jobs UK Popular Jobs Remote data analyst jobs Remote customer support jobs Remote executive assistant jobs Remote marketing jobs Remote product designer jobs Remote product manager jobs Remote project manager jobs Remote recruiter jobs Remote sales jobs Remote software engineer jobs Jobs by Type Remote full-time jobs Remote part-time jobs Remote contract jobs Remote internship jobs Remote entry-level jobs Remote jobs with no experience required Remote junior jobs (1-3 years of experience) Digital nomad jobs Remote jobs with no degree required Freelance remote jobs Temporary remote jobs Remote jobs hiring now Stay at home mom jobs
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Data ModelingSQLPerformance TuningAutomationDelta LakeDelta Live TablesAzure Data FactoryAzure DataBricksAzure Data LakeUnity Catalog
Soft Skills
Analytical SkillsCommunication SkillsProblem-Solving Skills