Senior Data Engineer, Databricks
Factorial
full-time
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
Job Level
About the role
- Own end-to-end implementation of data solutions, from problem definition through production deployment
- Design scalable data models and data pipelines that support business-critical use cases
- Improve the performance, reliability, and cost-efficiency of our Databricks environment
- Lead technical decisions around data architecture and deployment patterns
- Ensure production-grade quality through testing, code review, observability, and monitoring
- Remove blockers independently, including configuring infrastructure when necessary
Requirements
- Strong SQL skills (query optimization, partitioning, performance tuning)
- Strong Python skills
- Experience building and deploying jobs on Databricks
- Solid understanding of distributed data processing
- Experience working with large datasets
- Ability to design and implement end-to-end solutions independently
- Comfortable using Bash and cloud CLIs (AWS/Azure) when needed
- Experience with Infrastructure as Code (Terraform, ARM, CloudFormation) (preferred)
- Experience with Docker and CI/CD pipelines (preferred)
- Experience deploying databases or services in cloud environments (preferred)
- Experience with NoSQL databases (e.g., MongoDB) (preferred)
- Understanding of Lakehouse architectures (preferred)
Benefits
- Flexible work arrangements
- Opportunities for growth and development
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
SQLPythonDatabricksdistributed data processingBashInfrastructure as CodeTerraformDockerCI/CD pipelinesNoSQL databases
Soft Skills
problem definitionindependent workleadershiptechnical decision makingremoving blockers