FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAirflowAzureBigQueryCloudGoogle Cloud PlatformHadoopJavaKafkaKubernetesPythonScalaSpark
About the role
Key responsibilities & impact- Understands, articulates and applies principles of the defined strategy to routine business problems that involve a single function.
- Extracts data from identified databases.
- Creates data pipelines and transform data to a structure that is relevant to the problem by selecting appropriate techniques.
- Develops knowledge of current analytics trends.
- Supports the understanding of the priority order of requirements and service level agreements.
- Helps identify the most suitable source for data that is fit for purpose.
- Performs initial data quality checks on extracted data.
- Analyses complex data elements, systems, data flows, dependencies, and relationships to contribute to conceptual, physical and logical data models.
- Develops the Logical Data Model and Physical Data Models including data warehouse and data mart designs.
- Defines relational tables, primary and foreign keys and stored procedures to create a data model structure.
- Evaluates existing data models and physical databases for variances and discrepancies.
- Develops efficient data flows.
- Writes code to develop the required solution and application features.
Requirements
What you’ll need- 6+ years of experience in Data Engineering.
- Well versed with Hadoop, Hive, Spark using Scala, Kubernetes, Cloud, API and Data Lake concepts.
- Proven track record coding with at least one programming language (e.g., Java, Python).
- Experienced in computing platforms (e.g., GCP, Azure).
- Skilled in data modelling & data migration protocols.
- Experience with Kafka connect, Druid, Big Query and Looker is added advantage.
- Experience with the integration tools like Automic, Airflow.
Benefits
Comp & perks- Beyond our great compensation package, you can receive incentive awards for your performance.
- Other great perks include a host of best-in-class benefits maternity and parental leave, pto, health benefits, and much more.
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data engineeringdata pipelinesdata quality checksdata modellingdata migrationHadoopHiveSparkScalaprogramming languages
Soft Skills
problem solvinganalytical thinkingcommunicationcollaborationattention to detail