← Toutes les offres
Equinix

Principal Product Manager (Agent Intelligence)

Equinix

Dallas
CDI
Logiciels
Publié le 20 novembre 2026

Description du poste

This role is for someone who has done this before at scale. You have built or run evaluation or observability for production ML or LLM systems with many moving parts You came up through systems engineering, and you can go from a dashboard to a trace to a root cause yourself. Now you want to apply that to agents working on real enterprise data, at global scale, where being wrong has real consequences A systems engineering background: several years building or operating distributed systems, data platforms, infrastructure or ML systems as an engineer, or equivalent hands-on depth Hands-on data skills: you write SQL, read traces and logs, and can prototype an eval or analysis yourself in Python or similar Direct experience with multi-component systems, such as agents, tool use, retrieval pipelines or orchestrated services, where you had to find which component caused a failure Ability to lead without authority across engineering, data science and business teams, and to explain trade-offs clearly to senior leaders A track record of building and running evaluation, quality or observability systems for production ML or LLM products at scale (many teams, many models, or high request volumes), with results to show for it 7+ years across product management and engineering, including 3+ years as a product manager on technical platform, infrastructure, data or ML products Strong evaluation judgment. You know when to use code-based checks, LLM judges or human review, how to calibrate a judge against experts, and why a metric can look good while quality is poor Experience with experimentation platforms and causal measurement Experience with LLM evaluation and observability tools, tracing standards such as OpenTelemetry, and agent protocols such as MCP and A2A Experience with retrieval, ranking, recommendation, confidence calibration or learning-from-feedback systems Experience with enterprise data such as CRM, billing, product usage, or network and infrastructure data Experience with regulated customers or data governance, such as financial services, privacy or confidentiality controls A degree in computer science, engineering or another quantitative field, or equivalent experience We’re looking for a Principal Product Manager to own Agent Intelligence: the evaluation, observability and feedback systems that tell us how well our agents perform, why they fail, and whether each change makes them better. You will set the quality bar for agents across Equinix and build the platform that enforces it Define what “good” means for each agent and for the system end to end. That covers correctness, grounding in sources, completeness, tool-use accuracy, workflow adherence, latency, cost and business outcome Turn product requirements and acceptance criteria into measurable evals, each with a clear threshold and owner Set scoring standards and rubrics that hold across agents, workflows, regions and industries, and that both experts and automated judges apply consistently Own the roadmap for offline and online evaluation. This includes golden datasets, scenario and regression suites, LLM-as-judge pipelines calibrated against human experts, and human-in-the-loop review Make evaluation part of how agents ship, with eval-based quality gates in CI/CD. No model, prompt, tool or data change reaches users without passing agreed thresholds Measure reliability, not just accuracy, using repeated trials, consistency across runs, confidence intervals and confidence calibration Evaluate each component and the whole system: retrieval, entity resolution, ranking, tool and MCP calls, handoffs between agents, and final outputs Build trajectory- and trace-level evaluation that traces an end-to-end failure back to the component that caused it, and test how errors spread across handoffs Define the contracts between components (schemas, provenance, confidence) so quality can be checked at every boundary Partner with engineering on tracing and telemetry across agents, tools and data sources, so every output can be traced to its inputs, sources and decisions Build monitoring for drift in inputs, data sources, models and tool behavior, with alerts that catch regressions before users do Give leaders and product teams a trusted view of quality, reliability, cost and adoption by agent, workflow and segment Mine production traces, user edits, dismissals, ratings and expert audits for recurring failure modes, edge cases and data gaps Turn every confirmed failure into a regression test, a product requirement, or training and tuning data, and track it through to a fix Run experiments and A/B tests that show whether changes improve accuracy, reliability, adoption and business outcomes Build evals and controls that enforce data boundaries. Internal data stays internal, customer-facing content uses only approved material, and confidential details never cross between accounts Partner with security, legal and data governance to meet regulatory and confidentiality requi