Data Engineer, Assistant Vice President

State Street

Data Engineer focused on building scalable data pipelines using AWS and Databricks for legal operations. Support compliance analytics and reporting with high-performance data solutions.

Posted 5/17/2026full-timeQuincy • Massachusetts, New Jersey • 🇺🇸 United StatesLead💰 $110,000 - $177,500 per yearWebsite

Tech Stack

Tools & technologies

ApacheAWSETLPySparkPythonSparkSQL

About the role

Key responsibilities & impact

Design, build, and maintain scalable data pipelines using PySpark, Python, and Spark SQL
Develop and optimize ETL/ELT workflows on Databricks using Delta Lake
Implement Lakehouse architecture (Bronze/Silver/Gold layers) for enterprise data platforms
Build and manage Databricks Jobs, Workflows, and Notebooks for batch and streaming workloads
Ensure data quality using unit testing, validation frameworks, and automated checks

Requirements

What you’ll need

8+ years of experience in Data Engineering or data platform development
Strong hands-on experience with Databricks and Apache Spark
Proficiency in PySpark, Python, and SQL
Experience with AWS data platform services, including: S3 Glue Lambda IAM
Experience working with Delta Lake and lakehouse architecture
Solid understanding of: Distributed data processing ETL/ELT frameworks Data modeling techniques

Benefits

Comp & perks

Retirement savings plan (401K) with company match
Insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages
Paid-time off including vacation, sick leave, short term disability, and family care responsibilities
Access to Employee Assistance Program
Incentive compensation including eligibility for annual performance-based awards

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PySparkPythonSpark SQLETLELTDelta Lakedata modelingunit testingvalidation frameworksdistributed data processing