FREE ACCESS
5,000–10,000 jobs/day

See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAzureCloudETLKubernetesPySparkPythonShell ScriptingSparkSQLTerraform
About the role
Key responsibilities & impact- Develop, maintain, and optimize data processing systems and ETL pipelines using tools such as Azure Data Factory and Azure Databricks
- Collaborate with the Data Architect to implement data models and architectures that support scalable and reliable data flows
- Ensure data quality and integrity through unit tests with Pytest and component and integration tests with Behave
- Work with cross-functional teams to integrate data from various sources, utilizing PySpark processes executed in Databricks and orchestrated by Azure Data Factory
- Manage infrastructure components in the Azure Cloud, including role-based access control and Infrastructure as Code (IaC) practices
- Contribute to continuous integration and continuous deployment (CI/CD) processes using Azure DevOps and related tools
- Perform data analysis and processing using SQL, Python, and Spark to support business intelligence and reporting needs
Requirements
What you’ll need- 5+ years of experience in data engineering or a related field
- Proficiency in SQL, Python, and Spark for data processing and analysis
- Extensive experience with Azure Data Factory and Azure Databricks for ETL and data pipeline development
- Familiarity with data modeling and architecture principles
- Experience with data quality tools and practices, including automated tests with PyTest and Behave
- Basic knowledge of Azure Kubernetes Service (AKS) and event-driven architectures
- Familiarity with CI/CD practices and tools such as Azure DevOps, YAML, and shell scripting
- Experience with infrastructure management in Azure, including basic knowledge of Terraform and role-based access control
Benefits
Comp & perks- Competitive compensation and benefits
- Ground Floor opportunity with a purpose-driven mentality
- Development and career paths to enhance your skills
- Generous bonus potential from day one
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data processingETLdata modelingdata analysisSQLPythonSparkPytestBehaveInfrastructure as Code
Soft Skills
collaborationcommunicationproblem-solvingteamworkattention to detail
