Data Engineer
Surgery Partners, Inc
full-time
Posted on:
Location Type: Hybrid
Location: Nashville • Tennessee • United States
Visit company websiteExplore more
About the role
- This role requires a highly technical Data Engineer with expert-level proficiency in Azure Databricks, distributed data pipelines, and large-scale healthcare data processing.
- This role focuses on designing and implementing high-throughput ingestion pipelines, transactional lakehouse layers, and secure PHI data flows using Azure-native services and Databricks runtime optimizations.
- You will build and operate production-grade data pipelines that meet rigorous requirements for security, lineage, compliance (HIPAA), observability, and operational SLAs, supporting analytics, AI, and clinical insights across the organization.
Requirements
- 5+ years of experience in modern data engineering roles
- Expert-level proficiency in: PySpark and Spark SQL
- Databricks (Jobs, Workflows, Repos, Delta Live Tables)
- Delta Lake architecture and transactional design patterns
- Azure Data Factory or Azure Synapse Pipelines
- Cloud-native data security (RBAC, ABAC, privilege boundary enforcement)
- Strong experience working with healthcare data formats and standards: FHIR (JSON)
- HL7 v2/v3
- X12 EDI claims data
- Deep understanding of distributed systems, data partitioning strategies, concurrency, and cluster resource tuning
Benefits
- Comprehensive health, dental, and vision insurance
- Health Savings Account with an employer contribution
- Life Insurance
- PTO
- 401(k) retirement plan with a company match
- And more!
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Azure DatabricksPySparkSpark SQLDelta Lake architectureAzure Data FactoryAzure Synapse Pipelinesdistributed data pipelinesdata partitioning strategiesconcurrencycluster resource tuning