FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesApacheAWSAzureCloudETLGoogle Cloud PlatformPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake.
- Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards.
- Optimize Spark jobs and cluster configurations for performance and cost, including partitioning, caching, and autoscaling strategies.
- Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing.
- Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products.
- Establish engineering best practices, conduct code reviews, and mentor junior data engineers.
- Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement.
Requirements
What you’ll need- 5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark.
- Expert proficiency in Python (PySpark) and advanced SQL.
- Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern.
- Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services.
- Proven track record optimizing Spark performance and managing cluster cost.
- Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets.
- Proficiency with Git-based version control, CI/CD, and infrastructure-as-code.
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
Benefits
Comp & perks- Accommodation provided during hiring process
- Willingness to sponsor employment visas
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLELTPySparkSpark SQLDelta Lakedata architecturedata qualitydata governancedata modelingSQL
Soft Skills
collaborationmentoringtroubleshootingroot-cause analysiscontinuous improvement
Certifications
Bachelor's degree in Computer ScienceBachelor's degree in Engineering