Lead Data Engineer, Snowflake

Caterpillar Inc.

Lead Data Engineer focused on designing and building scalable data solutions with Snowflake at Caterpillar. Mentor a team and drive data products and analytics initiatives.

Posted 7/14/2026full-timeEast Peoria • Illinois, Texas • 🇺🇸 United StatesSenior💰 $128,470 - $192,710 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and building scalable data ingestion pipelines and enterprise data architectures, with a strong focus on Snowflake and AI-ready data engineering practices. Proficient in implementing data governance, quality frameworks, and collaborating with cross-functional teams to deliver impactful data solutions.

Highest-signal resume keywords

Expert Knowledge Of Snowflake ArchitectureStrong SQL SkillsExperience With ELT/ETL PipelinesProficiency In Python, Java, Or ScalaSnowPro Core Or Advanced Snowflake Certifications

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data ModelingData ArchitectureData Integration SolutionsMachine Learning SupportData Governance FrameworksMetadata ManagementPerformance TuningWorkload ManagementCloud Platforms (AWS, Azure, GCP)CI/CD Practices

Soft Skills

Strong Communication SkillsTechnical LeadershipMentoring

Tools & Technologies

SnowflakeCortex AISemantic ModelsVector SearchData Products

Certifications & Qualifications

SnowPro Core CertificationSnowPro Advanced Certification

Industry Keywords

Data EngineeringData GovernanceData QualityEnterprise Data ArchitectureAI-Ready Data Engineering

Tech Stack

Tools & technologies

AWSAzureCloudETLGoogle Cloud PlatformJavaPythonScalaSQL

About the role

Key responsibilities & impact

Design and build scalable data ingestion pipelines from structured and unstructured data sources into Snowflake.
Develop and maintain ELT/ETL processes to transform, cleanse, and integrate enterprise data.
Design reusable dimensional, semantic, and business-ready data models that support analytics and AI use cases.
Build and maintain consumable data products including curated datasets, data marts, semantic layers, APIs, and AI-ready data assets.
Design and implement enterprise data architectures that support scalability, interoperability, and future AI adoption.
Design and curate AI-ready datasets that support machine learning, generative AI, intelligent agents, and advanced analytics.
Implement metadata, lineage, and semantic modeling capabilities that improve data discoverability and AI readiness.
Collaborate with AI and analytics teams to establish patterns for retrieval, search, knowledge management, and AI-enabled business solutions.
Evaluate and adopt emerging Snowflake capabilities, including Cortex AI, semantic models, vectorized data structures, and AI-related platform services.
Apply Data Product Management principles by establishing ownership, quality standards, service levels, and lifecycle management processes.
Implement data quality monitoring, automated validation, observability, and governance frameworks.
Ensure compliance with enterprise security, privacy, regulatory, and data governance requirements.
Establish and maintain metadata standards, data lineage, business definitions, and cataloging practices.
Optimize Snowflake performance through query tuning, workload management, storage optimization, and architectural improvements.
Ensure high availability, reliability, and scalability across data platforms and pipelines.
Implementing proactive monitoring, alerting, and observability practices.
Drive cloud and Snowflake cost optimization through consumption monitoring, capacity planning, and engineering best practices.
Lead and mentor a team of 3–4 data engineers, providing technical leadership, coaching, and career development.
Serve as the technical subject matter expert for Snowflake, modern data platforms, and AI-ready data engineering practices.
Define and enforce enterprise data engineering standards, architectural patterns, and development best practices.
Collaborate with business stakeholders, product owners, analysts, architects, and data scientists to translate business objectives into scalable data solutions.

Requirements

What you’ll need

Bachelor’s degree in computer science, Information Systems, Data Engineering, Software Engineering, or related technical field (or equivalent experience)
10+ years of experience in data engineering or related disciplines with increasing responsibility
Expert knowledge of Snowflake architecture, security, performance tuning, and workload management.
Strong SQL, data modeling, and data architecture skills.
Experience building enterprise-scale ELT/ETL pipelines and data integration solutions.
Experience with cloud platforms (AWS, Azure, or GCP).
Proficiency in Python, Java, Scala, or similar modern programming languages.
SnowPro Core or Advanced Snowflake certifications.
Experience designing enterprise-scale Snowflake architectures.
Experience supporting machine learning, generative AI, or agentic AI solutions through enterprise data platforms.
Familiarity with Snowflake Cortex AI, semantic models, vector search, and AI-ready data architecture.
Experience working with structured and unstructured data sources at scale.
Experience designing data products and supporting analytics consumption patterns.
Experience implementing data governance, metadata, lineage, and quality frameworks.
Knowledge of CI/CD, DevOps, Infrastructure as Code (IaC), and platform automation practices.
Strong communication skills with the ability to translate technical concepts into business value.

Benefits

Comp & perks

Medical, dental, and vision benefits*
Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
401(k) savings plans*
Health Savings Account (HSA)*
Flexible Spending Accounts (FSAs)*
Health Lifestyle Programs*
Employee Assistance Program*
Voluntary Benefits and Employee Discounts*
Career Development*
Incentive bonus*
Disability benefits
Life Insurance
Parental leave
Adoption benefits
Tuition Reimbursement