FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowApacheAWSDistributed SystemsElasticSearchETLHadoopPostgresPySparkPythonScalaShell ScriptingSparkSQLSubversionUnix
About the role
Key responsibilities & impact- Design and build scalable data pipelines using Spark / PySpark on Databricks
- Develop and optimize ETL/ELT workflows for large-scale data processing
- Work with AWS EMR, S3, and Hadoop ecosystem for distributed data processing
- Build and maintain data lake and data warehouse solutions
- Develop and integrate APIs for data ingestion and consumption
- Implement data processing workflows using Airflow / Autosys
- Optimize data performance using partitioning, caching, and query tuning
- Handle structured and semi-structured data from multiple sources
- Ensure data quality, governance, and reliability of pipelines
- Collaborate with cross-functional teams (Analytics, Product, Engineering)
Requirements
What you’ll need- Minimum 5+ years of Data Engineering experience
- Strong hands-on experience in Databricks + Big Data stack
- Proven experience working on large-scale distributed systems
- Strong expertise in: Apache Spark / PySpark, Databricks (mandatory), SQL (PostgreSQL or similar)
- Hands-on experience with: AWS EMR, S3, Hadoop, Hive ecosystem
- Programming skills: Python (must-have), Scala (good exposure)
- Strong knowledge of: UNIX / Shell scripting, ETL pipelines and data engineering fundamentals
- Experience with: Elasticsearch (data storage & retrieval), Workflow orchestration tools (Airflow, Autosys)
- Exposure to: API development & integration, Version control tools (Git / SVN)
- Basic knowledge of HTML (for web/data tasks)
Benefits
Comp & perks- Work on cloud-native, large-scale data platforms
- Exposure to cutting-edge Databricks & AWS ecosystems
- Collaborative and high-performance engineering culture
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Data EngineeringSQLPythonScalaUNIX / Shell ScriptingData Processing WorkflowsAPI DevelopmentElasticsearchWorkflow OrchestrationData Quality
Soft Skills
CollaborationCross-Functional Teamwork
