Senior Data Engineer
Quantiphi
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
AWSAzureCloudGoogle Cloud PlatformPySparkSQLUnity
About the role
- Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks
- Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows
- Implement data models optimized for analytics, performance, and operational excellence
- Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency
- Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices
- Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions
- Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness
Requirements
- 8+ years of experience in data engineering or a related field
- Strong expertise in PySpark, SQL, and data modeling for high-volume datasets
- Hands-on experience building and optimizing data pipelines in AWS or GCP environments
- Track record of working with complex source systems and developing accurate extraction and transformation logic
- Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions
- Solid understanding of distributed computing, data partitioning, and performance tuning
- Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework (nice to haves)
- Familiarity with Delta Lake, orchestration tools, or Unity Catalog (nice to haves)
- Experience with CI/CD for data pipelines and automated testing frameworks (nice to haves)
Benefits
- Join a high-growth, AI-first digital engineering and transformation company
- Work with Fortune 500 clients and cutting-edge market disruptors
- Collaborate with a talented, dynamic, and driven team
- Gain exposure to the latest technologies in AI, ML, cloud, and data engineering
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PySparkSQLdata modelingdata pipelinesdistributed computingperformance tuningAWSGCPAzureDatabricks
Soft skills
mentorshipcode reviewstechnical design discussionscollaborationtroubleshootingownershipleadership