Senior Data Engineer – Databricks, AWS

Booker DiMaio

Senior Databricks Data Engineer specializing in AWS cloud-native data solutions. Supporting federal client data platform modernization initiatives with expertise in data pipelines and governance.

Posted 6/10/2026full-timeRemote • Maryland • 🇺🇸 United StatesSeniorWebsite

Tech Stack

Tools & technologies

Amazon RedshiftAWSCloudCyber SecurityETLPythonSQLUnity

About the role

Key responsibilities & impact

Design, develop, and maintain scalable data ingestion, transformation, and publishing pipelines utilizing Databricks and AWS services.
Implement and optimize Databricks Lakehouse capabilities including Unity Catalog, Delta Live Tables, Auto Loader, Databricks SQL, and Delta Sharing.
Build and maintain governed data products supporting operational, analytical, reporting, and machine learning workloads.
Develop and support medallion architecture data pipelines and enterprise data quality frameworks.
Implement data governance controls, metadata management, lineage tracking, and data retention policies.
Collaborate with cloud engineers, architects, cybersecurity specialists, and business stakeholders to deliver secure, production-ready solutions.
Optimize platform performance through partitioning, clustering, caching, workload tuning, and query optimization techniques.
Support analytics enablement through semantic layers, dashboards, reporting solutions, and self-service data access capabilities.
Participate in architecture reviews, operational readiness activities, platform modernization initiatives, and continuous improvement efforts.
Create and maintain technical documentation, design artifacts, operational procedures, and engineering standards.

Requirements

What you’ll need

Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related discipline.
Minimum eight (8) years of experience in cloud-based data engineering, platform development, or data architecture.
Minimum three (3) years of hands-on Databricks experience in production environments.
Experience designing, developing, and supporting large-scale ETL/ELT solutions.
Strong experience with AWS services including S3, IAM, Glue, Athena, Lambda, Redshift, and CloudWatch.
Experience implementing enterprise data governance and security controls.
Strong SQL and Python development skills.
Experience working with data lakes, data warehouses, and cloud-native analytics platforms.
Strong troubleshooting, performance tuning, and optimization experience.

Benefits

Comp & perks

Health insurance
401(k) matching
Flexible work hours
Paid time off
Remote work options

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

DatabricksAWSETLELTSQLPythondata governanceperformance tuningdata ingestiondata transformation

Soft Skills

collaborationtroubleshootingoptimizationcommunicationproblem-solving