Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
JobTailor Logo

See all jobs on JobTailor

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Brillio

Lead Data Engineer, Databricks

Brillio

Lead Data Engineer with Databricks expertise designing and building data platforms. Collaborate with teams to deliver high-performance data pipelines for a leading digital transformation partner.

Posted 6/22/2026full-timeBangalore • 🇮🇳 IndiaSeniorWebsite

Tech Stack

Tools & technologies
CloudETLPySparkSparkSQL

About the role

Key responsibilities & impact
  • Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and PySpark
  • Build and optimize data lakehouse architectures (Bronze–Silver–Gold layers)
  • Develop data ingestion frameworks from multiple sources (batch & real-time)
  • Implement Delta Lake features including schema evolution, ACID transactions, and optimization
  • Create and manage Databricks notebooks, workflows, and jobs for production pipelines
  • Ensure data quality, governance, and lineage across pipelines
  • Optimize Spark jobs for performance (partitioning, caching, tuning)
  • Collaborate with cross-functional teams (Data Scientists, Analysts, Architects)
  • Support production deployments, monitoring, and troubleshooting of data pipelines
  • Contribute to migration of legacy data platforms to modern cloud-based architecture

Requirements

What you’ll need
  • 5–10 years of experience in Data Engineering
  • Minimum 2–4 years of hands-on Databricks experience
  • Proven experience building enterprise-scale data platforms and pipelines
  • Strong experience in Databricks (Workflows, Notebooks, Jobs)
  • PySpark / Spark SQL
  • SQL & Data Warehousing concepts
  • Hands-on experience with Delta Lake / Lakehouse architecture
  • Data pipeline development & orchestration

Benefits

Comp & perks
  • Work on cutting-edge data & AI programs
  • Opportunity to build large-scale data platforms
  • Collaborative and innovation-driven culture

ATS Keywords

✓ Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
ETLELTDatabricksPySparkDelta LakeSpark SQLSQLData Warehousingdata pipeline developmentdata orchestration
Soft Skills
collaborationtroubleshootingdata governancedata quality