Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage
Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure
Create data models for analytics purposes
Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations
Use Azure Data Factory and Databricks to assemble large, complex data sets
Implementing data validation and cleansing procedures to ensure the quality, integrity, and dependability of the data
Ensure data security and compliance
Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures

Requirements

Must have 5+ years of experience with Data Engineering using Azure
Should be a blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams
Should be well versed in coding, spark core and data ingestion using Azure
Core Azure DE skills and coding skills (pyspark, python and SQL)
Must have experience with Azure DevOps, Apache Spark, Python, SQL proficiency, Azure Databricks knowledge and Big data technologies

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringETLdata modelingdata validationdata cleansingpysparkpythonSQLApache SparkBig data technologies

Soft Skills

analytical problem-solvingcollaborationcommunication