Senior Data Engineer
Cargill
full-time
Posted on:
Location Type: Office
Location: Wayzata • Minnesota • United States
Visit company websiteExplore more
Salary
💰 $105,000 - $175,000 per year
Job Level
About the role
- Designs, builds and maintains complex data systems for analysis and reporting
- Prepares data infrastructure for efficient storage and retrieval
- Examines and resolves data formats to improve usability
- Develops complex data products and solutions using cloud technologies
- Develops and maintains streaming and batch data pipelines
- Reviews existing data systems for improvement and optimization
- Collaborates with multi-functional teams to meet data solutions needs
- Builds prototypes to test new concepts and implements data frameworks
- Develops automated deployment pipelines for code efficiency
- Performs complex data modeling ensuring performance and accessibility
Requirements
- Minimum requirement of 4 years of relevant work experience
- Typically reflects 5 years or more of relevant experience
- Previous experience in the animal nutrition or feed additives industry is highly preferred
- Experience developing data systems on major cloud platforms (AWS, GCP, Azure)
- Hands-on experience building modern data architectures, including data lakes, data lakehouses, and data hubs
- Demonstrated proficiency in data collection, ingestion tools (Kafka, AWS Glue), and storage formats (Iceberg, Parquet)
- Experience developing data pipelines with streaming architectures and tools (Kafka, Flink)
- Expertise in data transformation and modeling using SQL-based frameworks and orchestration tools (dbt, AWS Glue, Airflow)
- Strong background with using Spark for data transformation
- Advanced programming skills in Python, Java, Scala, or similar languages
- Expert-level proficiency in SQL for data manipulation and optimization
- Demonstrated experience in DevOps practices, including code management, CI/CD, and deployment strategies
- Strong background in data governance principles, including data quality, privacy, and security considerations for data product development and consumption.
Benefits
- Minnesota Sick and Safe Leave accruals of one hour for every 30 worked, up to 48 hours per calendar year unless otherwise provided by law
- Discretionary incentive award based on company and personal performance
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data systems designdata infrastructuredata modelingdata transformationdata pipelinesprogramming in Pythonprogramming in Javaprogramming in ScalaSQL proficiencyDevOps practices
Soft Skills
collaborationproblem-solvingcommunicationteamworkcreativity