Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
JobTailor Logo

See all jobs on JobTailor

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Brillio

Lead Data Engineer – AWS

Brillio

Senior Data Engineer at Brillio Technologies with strong Databricks expertise. Responsible for designing, building, and optimizing scalable data pipelines and platforms.

Posted 6/22/2026full-timeBangalore • 🇮🇳 IndiaSeniorWebsite

Tech Stack

Tools & technologies
AirflowApacheAWSDistributed SystemsElasticSearchETLHadoopPostgresPySparkPythonScalaShell ScriptingSparkSQLSubversionUnix

About the role

Key responsibilities & impact
  • Design and build scalable data pipelines using Spark / PySpark on Databricks
  • Develop and optimize ETL/ELT workflows for large-scale data processing
  • Work with AWS EMR, S3, and Hadoop ecosystem for distributed data processing
  • Build and maintain data lake and data warehouse solutions
  • Develop and integrate APIs for data ingestion and consumption
  • Implement data processing workflows using Airflow / Autosys
  • Optimize data performance using partitioning, caching, and query tuning
  • Handle structured and semi-structured data from multiple sources
  • Ensure data quality, governance, and reliability of pipelines
  • Collaborate with cross-functional teams (Analytics, Product, Engineering)

Requirements

What you’ll need
  • Minimum 5+ years of Data Engineering experience
  • Strong hands-on experience in Databricks + Big Data stack
  • Proven experience working on large-scale distributed systems
  • Strong expertise in Apache Spark / PySpark
  • Databricks (mandatory)
  • SQL (PostgreSQL or similar)
  • Hands-on experience with AWS EMR, S3
  • Hadoop, Hive ecosystem
  • Programming skills: Python (must-have), Scala (good exposure)
  • Strong knowledge of UNIX / Shell scripting
  • ETL pipelines and data engineering fundamentals
  • Experience with Elasticsearch (data storage & retrieval)
  • Workflow orchestration tools (Airflow, Autosys)
  • Exposure to API development & integration
  • Version control tools (Git / SVN)
  • Basic knowledge of HTML (for web/data tasks)

Benefits

Comp & perks
  • Work on cloud-native, large-scale data platforms
  • Exposure to cutting-edge Databricks & AWS ecosystems
  • Collaborative and high-performance engineering culture

ATS Keywords

✓ Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
SparkPySparkETLELTAWS EMRS3HadoopSQLPythonUNIX
Soft Skills
collaborationcommunicationproblem-solvingteamworkadaptability