Architect and implement scalable data integration and analytics solutions using Azure Data Services (Databricks, Synapse, ADF).
Lead development of reusable frameworks for data ingestion, transformation, and analytics.
Ensure delivery excellence through code quality, performance optimization, and best practices in Python, PySpark, and SQL. (C# will be a plus)
Apply Azure identity and security principles including Managed Identities, Azure AD authentication, Key Vault integration, Networking (VNETs, private endpoints), and RBAC.
Maintain a high standard of documentation hygiene across solution components and processes.
Mentor and guide a team of data engineers and developers, fostering a culture of accountability.
Conduct regular code reviews, pair programming sessions, and internal knowledge sharing session with delivery team.
Plan and manage workstreams, delegating effectively to reduce dependencies and minimize technical debt.
Lead technical discussions with client, clear documenting assumptions, expectations and solution design.
Collaborate with business stakeholders to understand requirements, translate them into technical solutions, and manage expectations.
Communicate status, risks, decisions and mitigation strategies to both technical and non technical audiences with clarity.
Define solution roadmaps aligned to enterprise strategy, business priorities, and architectural standards.
Proactively identify risks and drive alignment to ensure predictable, high quality delivery.
Champion modern engineering practices including DevOps, CI/CD pipelines, IaC, automated testing, and repeatable deployment patterns.

Requirements

10+ years of experience in data engineering, analytics, or solution architecture.
Strong hands-on experience with: Azure Databricks (Spark, Delta, ML runtime)
Azure Synapse Analytics (serverless, pipelines, dedicated pools)
Azure Data Factory / Synapse Pipelines
Data Lake Storage Gen2, Databricks Unity Catalog, Spark SQL
Python, PySpark, Spark optimization
Azure DevOps, CI/CD, and Infrastructure as Code
Cloud security & identity: Managed identities, Azure AD, Key Vault, RBAC, networking fundamentals
Proven experience in leading technical teams and managing delivery in Agile framework.
Excellent communication and interpersonal skills; able to influence and lead cross-functional teams.
Experience in stakeholder management, risk assessment, and project planning
**Preferred Qualifications:**
Azure certifications (e.g., Azure Solutions Architect Expert, Azure Data Engineer Associate, Databricks certifications).
Experience in oil & gas, industrial or asset-heavy domains.

Benefits

📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data integrationanalytics solutionsAzure Data ServicesPythonPySparkSQLDevOpsCI/CDInfrastructure as Codedata engineering

Soft Skills

mentoringcommunicationstakeholder managementrisk assessmentproject planningteam leadershipcollaborationaccountabilityinfluencedocumentation

Certifications

Azure Solutions Architect ExpertAzure Data Engineer AssociateDatabricks certifications