FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesApacheAzureETLPySparkPythonSparkSQL
About the role
Key responsibilities & impact- Implement and optimize ETL process to ensure data accuracy, consistency, and scalability.
- Support the buildout, migration, and maintenance of the company’s Enterprise Data Lake house.
- Work with senior engineers to design and develop data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems.
- Work closely with Information Technology teams to implement continuous integration and deployment (Cl/CD) pipelines using Azure DevOps.
- Assist in administering and optimizing Azure Databricks clusters and ensure efficient data processing.
- Collaborate with analysts and business units to design and implement efficient data models.
- Determine data tracking and storage needs, perform data auditing and validation, perform data mapping, loading and conversion planning, and resolve data issues or discrepancies.
Requirements
What you’ll need- Bachelor’s degree or foreign equivalent in Data Science, Computer Science, Data Analytics, Management Information Systems, or related field
- 3 years of experience in the following: Data engineering and/or data architecture, SQL, Python, PySpark, or Bash, Azure DevOps for CI/CD, Version control such as Git, GitHub, or Azure DevOps, Developing ETL pipelines, Working in data management and transformation processes, Azure Databricks, Using advanced performance tuning, Data validation, Apache Spark and Delta Lake.
- 2 years of experience with Cluster management
Benefits
Comp & perks- Hybrid availability
- 401(k) with company match
- Health insurance
- Paid time off, holidays
- Volunteer time off
- Lifestyle Spending Account (LSA)
- Paternity leave
- Growth opportunities
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
ETLSQLPythonPySparkBashAzure DevOpsGitGitHubApache SparkDelta Lake
