FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowAWSAzureBigQueryGoogle Cloud PlatformHadoopJavaKafkaLinuxPythonScalaSparkSQL
About the role
Key responsibilities & impact- Design and build data pipelines to analyse huge datasets
- Create powerful visualisations to derive insights
- Partner with the product team to brainstorm and act on opportunities
- Develop and implement best-in-class Data pipeline and Data lake
- Ensure best capacity utilisation and meet SLAs
- Transform business requirements to code and analytical reports
- Collaborate closely with product owner and technical lead
- Document requirements, data lineage, subject matter in both business and technical terminology
Requirements
What you’ll need- Bachelor’s degree in computer science or related discipline with 3+ years’ experience
- Minimum 2 years of experience in Big Data and distributed computing
- Proven experience building pipelines on Big Data Technologies/Stack – Hadoop, Spark, Hive, dataproc, BigQuery, Kafka and Airflow Scheduler
- Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components
- Experience working on at least one Big Data technology with Java, Python or Scala
- Strong knowledge of deploying and managing applications in AWS or Azure or GCP
- Strong scripting skills to process large amount of data and highly proficient in SQL
- Solid knowledge of Linux systems
- Experience in secure, scalable and highly available services
- Experience with data science and machine learning is a plus
Benefits
Comp & perks- Incentive awards for performance
- Maternity and parental leave
- PTO
- Health benefits
- Best-in-class benefits
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipelinesdata lakeBig DataHadoopSparkHiveBigQueryKafkaAirflow SchedulerSQL
Soft Skills
collaborationcommunicationproblem-solvingdocumentation
