Search Relevance Product Manager – eCommerce

Caterpillar Inc.

Search Relevance Product Manager at Caterpillar enhancing search relevance and customer satisfaction in eCommerce. Collaborating with Engineering and Data Science to optimize performance.

Posted 6/22/2026full-timeChicago • Colorado, Illinois, Texas • 🇺🇸 United StatesMid-LevelSenior💰 $128,470 - $208,770 per yearWebsite

Tech Stack

Tools & technologies

AzureElasticSearchSDLC

About the role

Key responsibilities & impact

Own search relevance strategy, including ranking signals and query understanding
Define and evolve ranking policies (availability, price, popularity, fitment, recency)
Lead improvements in query handling (synonyms, typo correction, rewriting)
Run a zero-results reduction program with effective fallbacks
Establish quality gates (offline evaluation + A/B testing) for all releases
Design and evaluate experiments to drive measurable improvements
Build and maintain a gold standard evaluation dataset (“truth set”)
Prioritize and deliver a relevance roadmap across key query types
Work closely with Engineering and Data Science to define features, signals, and evaluation criteria

Requirements

What you’ll need

Business Analysis: Knowledge of business analysis and the set of tasks, techniques and tools required to identify business needs; ability to recommend solutions that deliver value to stakeholders.
Decision Making and Critical Thinking: Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
Software Change Request Management: Knowledge of software change request management; ability to manage software product change requests from customers, prospective customers, vendors, and internal staff.
Software Engineering: Knowledge of software engineering; ability to deliver new or enhanced fee-based software products.
Software Product Business Knowledge: Knowledge of and experience with the business aspects and operation of a software product; ability to manage install base, current uses, future plans, and product vision.
User Acceptance Testing (UAT): Knowledge of UAT activities, tasks, tools and techniques; ability to design, implement and evaluate acceptance tests for end-users.
Consideration for top candidates: Experience with search platforms (e.g., Elasticsearch, Solr, vector or hybrid search)
Experience with LLM-powered search or query understanding, including semantic search, embeddings, or retrieval augmented generation
Experience with eCommerce search behavior (e.g., part number, fitment, attribute-driven queries)
Digital product management, user experience, user research, digital strategy, or related function
Experience managing projects using Product Management and/or Agile software tools such as Aha, Product Board, Azure DevOps
Human-centered design, lean innovation, or design thinking methodologies
Product Owner certification (Certified Scrum Product Owner from Scrum Alliance)
Knowledge of Software Development Lifecycle (SDLC) and demonstrated experience employing SDLC in aspects of the project management process
Improved NDCG@10 and MRR (ranking quality)
Reduced zero-results rate
Fewer manual fixes (boosts, one-off rules) over time
5–7 years of product management experience in search, recommendations, or data-driven products
Hands-on experience designing and interpreting A/B tests and experiments
Strong understanding of ranking, relevance, or information retrieval concepts
Ability to define and use metrics and evaluation frameworks (e.g., NDCG, MRR, CTR)
Experience working closely with Data Science or ML teams
Proven ability to lead complex, cross-functional initiatives
Strong analytical thinking and communication skills

Benefits

Comp & perks

Medical, dental, and vision benefits*
Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
401(k) savings plans*
Health Savings Account (HSA)*
Flexible Spending Accounts (FSAs)*
Health Lifestyle Programs*
Employee Assistance Program*
Voluntary Benefits and Employee Discounts*
Career Development*
Incentive bonus*
Disability benefits
Life Insurance
Parental leave
Adoption benefits
Tuition Reimbursement

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

search relevance strategyranking signalsquery understandingzero-results reductionA/B testinggold standard evaluation datasetbusiness analysissoftware engineeringUser Acceptance Testing (UAT)search platforms

Soft Skills

decision makingcritical thinkingproject managementanalytical thinkingcommunication skillshuman-centered designlean innovationdesign thinkingstakeholder managementcollaboration

Certifications

Certified Scrum Product Owner