Senior Databricks Engineer

HIKE2

Senior Data Engineer building enterprise-grade Databricks solutions for complex data environments. Leading architectural decisions and optimizing data platforms at Hike2.

Posted 5/13/2026full-timeRemote • Pennsylvania • 🇺🇸 United StatesSenior💰 $135,000 - $185,000 per yearWebsite

Tech Stack

Tools & technologies

AirflowAmazon RedshiftAzureBigQueryCloudKafkaSparkTerraformUnity

About the role

Key responsibilities & impact

Design and build large-scale data platforms on Databricks (Delta Lake, Spark, Unity Catalog) in Azure
Develop and maintain batch and streaming data pipelines for high-volume, complex data sources
Implement medallion/lakehouse architectures from the ground up in greenfield environments
Build and optimize data models to support analytics, reporting, and downstream applications
Integrate Databricks with enterprise systems (APIs, event streams, warehouses, ML workflows)
Tune Spark jobs and pipelines for performance, reliability, and cost at scale
Support production deployments, including CI/CD pipelines, testing, and release management
Partner directly with enterprise clients to translate requirements into working technical solutions
Collaborate with architects, engineers, and data scientists across multiple workstreams
Balance speed and quality, knowing when to move fast and when to harden solutions
Make pragmatic decisions in ambiguous, evolving environments (especially greenfield builds)
Contribute hands-on while also guiding design and approach across the team
Communicate tradeoffs clearly to both technical and non-technical stakeholders
Work within modern engineering practices (version control, code reviews, automated testing)
Demonstrated ability to mentor and guide data engineers and analysts

Requirements

What you’ll need

Deep Databricks-native expertise, including experience architecting and implementing end-to-end lakehouse solutions that run primarily or entirely on Databricks.
Advanced experience with modern Databricks architecture patterns, including declarative pipelines / Delta Live Tables, Unity Catalog, Delta Lake, workflow orchestration, governance, performance tuning, and operational monitoring.
Familiarity with infrastructure-as-code (Terraform, Bicep), environment provisioning, and CI/CD automation (Github, Azure DevOps) for Databricks-based platforms.
Strong learning agility, technical curiosity, and comfort using AI-enabled development workflows or automation tools to accelerate delivery and improve quality.
Familiarity with other modern cloud data architectures and tools, including cloud-native data warehouses (Snowflake, BigQuery, Redshift), data lakes, orchestration frameworks (Airflow/Astronomer), transformation tools (dbt), catalog/governance platforms, and scalable batch or streaming data processing services (Kafka, Kinesis).

Benefits

Comp & perks

medical
dental
vision
401k
holiday pay
vacation
personal and family sick leave
and more.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

DatabricksDelta LakeSparkUnity CatalogCI/CDTerraformBicepdata pipelinesdata modelingperformance tuning

Soft Skills

communicationmentoringcollaborationdecision makinglearning agilitytechnical curiosityproblem solvingadaptabilityguidancebalancing speed and quality