Serve as a Databricks-first data engineer, designing, building, and supporting scalable Lakehouse data pipelines (ETL/ELT) using Spark and Delta Lake.
Develop and maintain Databricks notebooks, workflows, and jobs, with secondary support for On-Premise SQL Server integrations.
Build analytics-ready data models in Databricks, supporting limited dimensional and reporting models on SQL Server as needed.
Drive data ingestion, migration, and integration between Databricks and On-Premise systems as part of platform modernization.
Collaborate with analysts, data scientists, business stakeholders, and all teams under the Data Enterprise organization (including Data Operation and MDM) to translate requirements into scalable, maintainable solutions
Optimize Spark jobs and Databricks workflows for performance, reliability, and cost efficiency.
Implement enterprise data quality checks, security best practices, and governance standards across Databricks and SQL environments.
Support production pipelines with CI/CD and automated deployment for reliable, repeatable releases.

Requirements

Bachelor's Degree in Computer Science, or a closely related field, or the equivalent
Databricks and Spark: 2–5 years of hands‑on experience with Databricks notebooks, Spark transformations, and Delta Lake for scalable
Strong Python, Scala, and SQL skills for building and maintaining data pipelines.
Exposure to automated deployment pipelines using tools such as Azure DevOps and Databricks Asset Bundles (DABs) for reliable, production-ready workflows.
Understanding of enterprise data quality checks, security practices, and governance frameworks.
Ability to work effectively with analysts, stakeholders, and cross-functional teams to troubleshoot and optimize pipelines.

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

DatabricksSparkDelta LakePythonScalaSQLETLELTCI/CDautomated deployment

Soft Skills

collaborationtroubleshootingoptimizationcommunicationstakeholder engagement

Certifications

Bachelor's Degree in Computer Science