Explore more
About the role
- Design, build, and optimize ETL/ELT workflows using tools like Databricks, SQL, Python/pyspark & Alteryx (Good to have)
- Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets
- Work on cloud platforms (Azure, AWS) to build and manage data lakes, data warehouses, and scalable data architectures
- Utilize cloud services like Azure Data Factory, AWS Glue, or similar for data processing and orchestration
- Use Databricks for big data processing, analytics, and real-time data processing
- Create and manage SQL-based data solutions, ensuring high availability, scalability, and performance
- Collaborate with cross-functional teams to deliver impactful data solutions
- Leverage CI/CD pipelines to streamline development, testing, and deployment of data engineering workflows
- Maintain clear documentation for data workflows, pipelines, and processes
Requirements
- 3–6 years of experience in Data Engineering or related roles
- Proficiency in Python, SQL, and PySpark for data processing and manipulation
- Proven experience in Databricks and Apache Spark
- Expertise in working with cloud platforms like Azure, AWS
- Sound knowledge of ETL processes and tools like Alteryx (Good to have)
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field
- Familiarity with data visualization tools like Power BI, Tableau, or similar is a plus
- Knowledge of streaming technologies such as Kafka or Event Hubs is desirable
- Strong problem-solving skills and a knack for optimizing data solutions
- Excellent communication (oral and written) skills
Benefits
- N/A 📊 Check your resume score for this job Improve your chances of getting an interview by checking your resume score before you apply. Check Resume Score
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLELTPythonSQLPySparkDatabricksApache Sparkdata pipelinesdata processingdata visualization
Soft skills
problem-solvingcommunication
Certifications
Bachelor's degreeMaster's degree