Search Test Engineer

Career Area:

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Job Description:

Role Overview: Accountable for end-to-end quality outcomes across functional testing and search-driven user experiences, ensuring release readiness across Dev → QA → Stage → Prod.

Search Quality & Enterprise Search Platform Testing (Coveo / Lucid works Fusion):

• Hands-on validation of search relevance, ranking, facets/filters, sorting, typeahead, synonyms/misspellings, fuzzy matching, and zero-results experience
• Validate headless search / Query API behaviour and downstream integrations, ensuring consistent behaviour across environments
• Support migration/parity testing when moving platforms (e.g., Lucidworks Fusion → Coveo) to maintain functional parity and meet leadership expectations for improved performance and outcomes
• Validate search analytics and success metrics (e.g., zero-results rate, CTR, conversion signals) and partner with Search/Product on tuning opportunities
• Validate index & data integrity across environments (Dev → QA → Stage → Prod) and support promotion readiness (config promotion, environment readiness, and functional validation)

Key Responsibilities:

Functional Testing Strategy:

• Define and drive functional test strategy with risk-based coverage and clear release readiness criteria
• Own test planning, test design, execution, triage, and sign-off across complex user journeys and integrations
• Shift-left quality through requirements and design reviews focused on testability, risks, and acceptance clarity
• Lead cross-team coordination with Product/Engineering/Platform to align scope, quality gates, and delivery timelines

Automation Strategy & Leadership:

• Define automation strategy and roadmap; balance manual + automation to maximize value and reduce cycle time
• Provide framework governance for maintainability, stability, and CI/CD alignment across environments
• Mentor the team through code reviews and automation best practices to raise quality and consistency standards
• Drive reporting and monitoring for coverage, flakiness, trends, and actionable quality metrics

Preferred Qualifications:

• Experience in enterprise eCommerce or platform-based applications
• Experience in migration/parity testing for search platform replatforming (Lucidworks → Coveo or similar)
• Exposure to API testing and performance considerations for search endpoints
• Familiarity with search analytics, experimentation (A/B), and relevance tuning workflows

Posting Dates:

Caterpillar is an Equal Opportunity Employer.  Qualified applicants of any age are encouraged to apply

Not ready to apply? Join our Talent Community.