Senior AI Data Engineer

Setton Industries Inc.

Senior Data Engineer building Scorpion's analytical data platform to support AI products. Collaborating with teams to design scalable systems and ensure data quality standards.

Posted 6/2/2026full-timeRemote • 🇺🇸 United StatesSenior💰 $155,000 - $185,000 per yearWebsite

Tech Stack

Tools & technologies

AirflowApacheAzureBigQueryCloudPythonSparkSQL

About the role

Key responsibilities & impact

Evaluate and improve data quality, completeness, and consistency across 30+ databases, applications, platforms, and APIs.
Design and build Scorpion's analytical data platform, creating a trusted source of truth for business and client data.
Develop and maintain scalable data pipelines that efficiently move data from operational systems into the analytical platform.
Help teams transition from querying production databases directly to using trusted analytical data sources.
Design data access patterns that enable AI agents and applications to quickly retrieve relevant client and business information.
Build secure, scalable solutions that deliver client context and business insights to internal applications and AI-powered experiences.
Define, monitor, and improve service level agreements (SLAs) for data freshness, availability, reliability, and performance.
Partner with engineering, product, and data science teams to establish data standards, governance practices, and data contracts.
Continuously improve the scalability, performance, and reliability of Scorpion's data ecosystem.

Requirements

What you’ll need

Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related technical field, or equivalent practical experience.
7+ years of data engineering experience, including designing and operating production-scale analytical data platforms.
Experience building scalable data pipelines, analytical systems, and data platforms in modern cloud environments.
Experience integrating and unifying data from multiple systems into trusted, business-ready analytical platforms.
Experience supporting data access and consumption patterns for applications, analytics, machine learning, or AI-powered solutions.
Experience designing scalable data models that support analytics, reporting, and AI-driven applications.
Experience establishing data governance standards, data contracts, and documentation practices across teams.
Deep expertise with Databricks, Delta Lake, and Apache Spark for large-scale data processing, streaming ingestion, and data transformation.
Experience working with Snowflake, BigQuery, ClickHouse, Azure Synapse, or similar analytical database technologies.
Advanced SQL skills, including query optimization, execution planning, and performance tuning.
Strong Python skills for data pipeline development, automation, transformation, and integration with production systems.
Experience building and managing data pipelines using dbt, Airflow, Prefect, or similar orchestration and transformation tools.
Strong understanding of lakehouse architecture, data partitioning strategies, metadata management, and data security best practices.

Benefits

Comp & perks

100% employer-paid medical, dental, and vision insurance
Flexible paid time off, so you can rest, relax, and recharge away from work
Paid parental leave
Paid cell phone and service
Remote office allowance
Professional development and development courses
Regular manager check-ins to drive performance and career growth through Lattice

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

data engineeringdata pipelinesanalytical data platformsdata modelingSQLPythonDatabricksApache SparkDelta Lakedata governance