VP II, AI, Machine Learning

Circana

Senior Big Data Engineer responsible for designing and delivering ETL solutions for Circana. Collaborating with teams and leveraging modern big data frameworks and cloud platforms.

Posted 6/6/2026full-timeRemote • Illinois • 🇺🇸 United StatesLead💰 $202,000 - $210,000 per yearWebsite

Tech Stack

Tools & technologies

AzureCloudETLHadoopHDFSMapReduceOraclePostgresPySparkPythonScalaSparkSQL

About the role

Key responsibilities & impact

Designing, building, and delivering highly scalable big data and ETL solutions across distributed environments.
Supporting projects at various and unanticipated client worksites throughout the United States.
Working closely with cross-functional teams to develop, test, and deploy data solutions that meet business and operational needs.
Leveraging modern big data frameworks, cloud platforms, and agile development practices.
Preparing technical design documentation for implemented solutions.
Identifying and resolving data pipeline issues and providing timely solutions.

Requirements

What you’ll need

Design and implement highly scalable ETL applications using Hadoop and Big Data ecosystems.
Develop new scripts, tools, and methodologies to streamline and automate ETL workflows.
Deliver big data solutions using Spark, Python, Scala, SQL, and Hive.
Design and create use cases and scenarios for functional, integration, and system testing.
Collaborate closely with Data Science, QA, Operations, and other teams to meet aggressive deadlines.
Participate in daily Agile/Scrum meetings and conduct code reviews.
Coordinate with cross-functional operational teams to manage end-to-end data delivery.
Write efficient, reusable, and well-documented code.
Prepare technical design documentation for implemented solutions.
Identify and resolve data pipeline issues and provide timely solutions for incorrect or undesired system behavior using ILD solutions.
Work within complex technical environments that include: ETL Spark applications in PySpark and Scala Spark architecture, data frames, and performance tuning Hadoop ecosystem tools such as Flume, MapReduce, and HDFS Relational databases (Oracle, PostgreSQL) Big Data querying tools (Hive, Pig, Impala) Databricks, distributed computing principles, and Lambda Architecture Cloud platforms such as Microsoft Azure

Benefits

Comp & perks

paid time off
medical/dental/vision insurance
401(k)

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

ETLHadoopBig DataSparkPythonScalaSQLHiveAgileperformance tuning

Soft Skills

collaborationproblem-solvingcommunicationdocumentationtime managementadaptabilityteamworkattention to detailcritical thinkingcode review