Design and develop an ingestion process for big data processing
Translate business requirements into specifications for the data ingestion process
Understand and deliver data solutions leading to end-to-end delivery
Develop and implement data pipelines to support organizational initiatives
Build and maintain ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) pipelines to move data from various sources
Ensure data accuracy, consistency, and compliance with policies and regulations
Collaborate with data scientists, analysts, and other stakeholders to meet data needs
Optimize data systems for efficiency, scalability, and performance
Create functional and technical design documents and maintain documentation for data processes

Requirements

5+ years of experience building data ingestion processes and tools
5+ years of experience with DataBricks, Scala, Azure Data Factory (ADF) and SQL Server
5+ years’ database experience with MS SQL Server
5+ years of experience in healthcare industry with proven understanding of data terminology
Healthcare experience and clear understanding and working knowledge of HIPAA protocols
Experience with Microsoft’s Power-BI/SSRS/SSAS/Azure Data Factory and other cloud based BI and reporting services is a plus
BS in Computer Science, IT or equivalent or 4 additional years of relevant experience
Microsoft Azure Certification is a plus

Benefits

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data ingestionETLELTdata pipelinesdata processingSQLScalaDataBricksAzure Data Factorydata accuracy

Soft Skills

collaborationcommunicationproblem-solvingdocumentationorganizational skills

Certifications

Microsoft Azure Certification