Description
The Cisco AI Software & Platform Group is looking for an Engineering Product Manager to lead the strategy, architecture, and organisational adoption of Cisco's end-to-end evaluation platform.
The platform is designed to empower engineering teams to deploy autonomous AI agents and LLM-powered systems safely, reliably, and with verified accuracy at enterprise scale.
Key responsibilities:
- Define AI Evaluation Platform Strategy: Architect the product vision, staged roadmap, and platform architecture for Cisco's unified offline benchmarking suites, automated LLM judges, and continuous production evaluation systems.
- Operationalize Quality & Safety Standards: Convert ambiguous quality standards into objective, repeatable test suites and structured human-in-the-loop review pipelines.
- Establish Release Gating & Quality Bars: Establish pre-deployment quality bars, risk-based release criteria, and automated regression-detection loops to govern AI model and application rollouts.
- Bridge Offline & Production Telemetry: Connect offline model evaluations directly with live telemetry, product analytics, and real-time user feedback loops.
- Drive Multi-Team Platform Adoption: Partner with research scientists, engineering leaders, and product managers to drive organisation-wide adoption of standardised evaluation frameworks.
Requirements:
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field with 12+ years of product management experience, OR Master's degree with 8+ years, OR PhD with 5+ years of experience.
- Prior experience leading product management for AI/ML platforms, model evaluation frameworks, Large Language Model (LLM) infrastructure, or data-intensive software products.
- Experience designing and operationalising offline benchmarking systems, automated evaluation judges, or real-time production quality monitoring pipelines.
Preferred qualifications:
- Direct experience evaluating Generative AI, Retrieval-Augmented Generation (RAG) pipelines, and autonomous multi-agent systems.
- Familiarity with modern AI evaluation toolkits and enterprise telemetry architectures.
- Prior experience operating across enterprise SaaS, cloud infrastructure, or hyperscaler environments.
The starting salary range for this position is $194,600.00 to $285,700.00, reflecting the projected salary range for new hires in this position in U.S. and/or Canada locations.
Benefits include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance.