FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Databricks Data Engineer
State StreetSr. Databricks Data Engineer developing financial products in a strong development team using Azure and Databricks.
Posted 5/12/2026full-timeQuincy • Massachusetts, New Jersey • 🇺🇸 United StatesSenior💰 $120,000 - $202,500 per yearWebsite
Tech Stack
Tools & technologiesApacheAzureCloudDockerETLKubernetesScalaShell ScriptingSparkSQLUnix
About the role
Key responsibilities & impact- Design, build and test end to end data pipeline including data ingestion (streaming, events, and batch) on cloud-based infrastructure using Azure, Cosmos DB
- Develop and implement ETL processes for data ingestion, transformation and loading data into data lakes
- Work extensively on Databricks and data warehousing concepts
- Design & develop custom high throughput and configurable frameworks/libraries
- Ability to drive change through collaboration, influence and demonstration of POCs
- Responsible for all aspects of the software development lifecycle, including design, coding, integration testing, deployment, and documentation
- Work collaboratively within an agile project team
- Follow best practices and coding standards
- Grow your personal skillset
Requirements
What you’ll need- Bachelor’s Degree level qualification in a computer or IT related subject
- 10+ years of overall Bigdata data pipeline experience
- 5+ years of Databricks hands on experience
- 5+ years of experience on cloud-based development including Azure Services, Azure Devops, Kubernetes, Docker
- Experience on Snowflake is plus
- Experience in micro-services architecture and understanding of Cloud Computing is highly desirable (Azure preferred)
- Proficient working knowledge on Data Warehousing platforms as Databricks, Delta lake and Apache spark
- Hands on development experience in Databricks SQL and Scala
- Strong understanding of Databricks platform including clusters, jobs and other resources
- Monitor and troubleshoot data pipelines to identify and resolve issue
- Implement Data quality checks and validations to ensure data accuracy
- Experience performing data analysis and data exploration
- Strong hands-on experience in troubleshooting Devops pipelines (ADO and Harness)
- Experience working in a multi-developer environment, using version control (i.e. Git)
- Strong critical thinking, communication, and problem-solving skills
- Experience in handling semi-structured data (Avro, JSON and XML)
- Basic knowledge on shell scripting, UNIX, TOAD, SQL developer.
Benefits
Comp & perks- generous medical care
- insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages
- retirement savings plan (401K) with company match
- paid-time off including vacation, sick leave, short term disability, and family care responsibilities
- access to our Employee Assistance Program
- incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans)
- eligibility for certain tax advantaged savings plans
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data pipelineETL processesdata ingestiondata transformationdata loadingDatabricksdata warehousingDatabricks SQLScaladata analysis
Soft Skills
collaborationinfluenceproblem-solvingcritical thinkingcommunication
Certifications
Bachelor’s Degree in Computer Science or IT