Risepoint

Senior Data Engineer – Databricks

Risepoint

full-time

Posted on:

Location Type: Remote

Location: United States

Visit company website

Explore more

✨ AI Apply
Apply

Job Level

Senior

Tech Stack

ApacheAWSAzureCloudETLPySparkPythonSparkSQLTerraformUnity

About the role

  • Build reliable, scalable data pipelines on Databricks
  • Turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components
  • Implement and improve reference patterns, optimize Spark for performance and cost
  • Apply best practices with Unity Catalog and workflow orchestration
  • Ship high-quality code others can build on
  • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
  • Execute complex ad-hoc queries using Databricks SQL
  • Develop robust data transformation workflows using PySpark and SQL
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Build ETL/ELT workflows with AWS and Azure Services
  • Optimize Spark jobs for performance and cost
  • Collaborate with data scientists, ML engineers, and business analysts
  • Contribute to the development of AI-powered solutions
  • Implement CI/CD pipelines for Databricks jobs

Requirements

  • Bachelor's degree in computer science, Engineering, or a related field
  • 5+ years of experience in software/data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others
Benefits
  • Health insurance
  • Flexible work arrangements
  • Professional development opportunities
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
DatabricksELTETLDelta LakeSparkPySparkSQLAWSAzureCI/CD
Soft Skills
analytical skillstroubleshooting skillscollaboration skillscommunication skillsdocumentation skillsleadershipstrategic inputmentoring