3Pillar Global

Azure Data Engineering Lead, 10+ Years of Experience

3Pillar Global

full-time

Posted on:

Location Type: Remote

Location: Remote • 🇮🇳 India

Visit company website
✨ AI Apply
Apply

Job Level

Senior

Tech Stack

AzureETLPythonSQL

About the role

  • Lead the design, development, and implementation of scalable data engineering solutions on the Azure platform.
  • Architect and manage enterprise data platforms using Azure Data Lake (ADLS Gen2) and Microsoft Fabric (Lakehouse, Data Factory, Synapse, Power BI).
  • Design and optimize ETL/ELT pipelines for structured and unstructured data using Azure-native tools.
  • Build and maintain data ingestion, transformation, and orchestration pipelines using Azure Data Factory / Fabric Data Pipelines.
  • Ensure data quality, security, governance, and compliance across data platforms.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets.
  • Lead and mentor junior data engineers, providing technical guidance and best practices.
  • Optimize performance, cost, and scalability of data workflows and storage solutions.
  • Implement CI/CD pipelines and follow DataOps best practices for deployment and monitoring.
  • Troubleshoot production issues and drive continuous improvement across data systems.

Requirements

  • 10+ Years of Experience in IT Industry
  • 6+ years of experience in Data Engineering, with strong expertise in Azure Data Platform.
  • Hands-on experience with Azure Data Lake (ADLS Gen2) and Microsoft Fabric.
  • Strong proficiency in SQL and Python for data processing and transformation.
  • Experience with Azure Data Factory, Fabric Lakehouse, Synapse, and Power BI.
  • Solid understanding of data warehousing concepts, data modeling, and big data processing.
  • Experience implementing data security, access control, and governance in Azure.
  • Familiarity with CI/CD, DevOps, and version control (Git).
  • Excellent communication and leadership skills with experience leading technical teams.

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
data engineeringETLELTSQLPythondata warehousingdata modelingbig data processingCI/CDDataOps
Soft skills
communicationleadershipmentoringcollaborationtechnical guidance