Staff Data Engineer, Spark

Wizard AI

full-time

Posted on: 9/18/2025

Origin: • 🇺🇸 United States

✨ AI Apply

💰 $208,000 - $235,000 per year

Lead

CassandraCloudDynamoDBMongoDBMySQLNoSQLPostgresPythonSpark

About the role

Design and evolve scalable, distributed data infrastructure across cloud platforms
Build and maintain real time and batch data processing pipelines supporting analytics and AI/ML workloads
Develop and manage integrations with third party e-commerce platforms to expand our data ecosystem
Ensure data availability, reliability and quality through monitoring and automated auditing
Partner with engineering, AI and product teams on data solutions for business critical needs
Mentor and support data engineers, establishing best practices and code quality standards

5+ years of software development and data engineering experience with demonstrated ownership of production grade data infrastructure
Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
Deep expertise scaling Spark in production (Databricks, EMR, etc)
Strong understanding of distributed computing and modern data modeling for scalable systems
Proficient in Python with experience implementing software engineering best practices
Hands-on experience with both relational (MySQL / PostgreSQL) and NoSQL (MongoDB, DynamoDB, Cassandra) databases
Strong communicator with experience influencing cross functional stakeholders