Design and build scalable data pipelines and infrastructure that fuel AI and analytics
Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage
Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure
Create data models for analytics purposes
Utilize Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations
Implement data validation and cleansing procedures for data integrity
Ensure data security and compliance
Collaborate with data engineers and stakeholders to understand requirements and translate them into data platform architectures

Requirements

Must have 5+ years of experience with Data Engineering using Azure
Should be a blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams
Should be well versed in coding, spark core and data ingestion using Azure
Core Azure DE skills and coding skills (pyspark, python and SQL)
Must have experience with Azure DevOps, Apache Spark, Python, SQL proficiency, Azure Databricks knowledge and Big data technologies

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringdata pipelinesdata ingestiondata processingdata transformationdata modelingETLpysparkpythonSQL

Soft Skills

analytical problem-solvingcollaborationcross-functional teamwork