Senior Data Engineer
The Baldwin Group
full-time
Posted on:
Location Type: Hybrid
Location: Tampa • Florida • United States
Visit company websiteExplore more
Job Level
About the role
- Design, build, maintain, and optimize scalable data pipelines and ELT/ETL processes to ingest, process, and store large volumes of data from various sources.
- Architect robust batch and streaming solutions using PySpark, Spark SQL, and Databricks Jobs.
- Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and performance.
- Ensure reliability, observability, and SLAs through monitoring, alerting, and automated recovery patterns.
- Implement and maintain data integration solutions, including APIs and data connectors, to facilitate data exchange between systems.
- Build and manage data solutions on AWS, leveraging services such as S3, Lambda, Glue, IAM, EC2, EKS, Step Functions, and EventBridge.
- Implement and maintain CI/CD pipelines.
Requirements
- 7+ years of data engineering experience building production-grade data pipelines.
- Deep expertise in Databricks , Spark , and Delta Lake .
- Hands-on experience with AWS cloud services.
- Strong proficiency in Python , SQL , and distributed computing patterns.
- Experience with Terraform and cloud-native CI/CD.
- Strong understanding of data modeling, orchestration, and data quality frameworks.
- Ability to operate autonomously while collaborating in a team environment.
Benefits
- Must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future.
- No sponsorship is available for H-1B, L-1, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data engineeringdata pipelinesELTETLPySparkSpark SQLDatabricksPythonSQLTerraform
Soft Skills
collaborationautonomy