# Senior Product Manager, AI Experimentation Platform

**Company**: Backcountry
**Location**: Cottonwood Heights, UT
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Category**: Product Management
**Industry**: Retail

**Apply**: https://jobs.lever.co/cscgeneration-2/6f602e72-5c63-4175-966b-0b3083b1da75?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_571682eb-329

## Description

Adventure is our Culture. Join a team that celebrates a lifestyle as bold as the terrain we love. At Backcountry, we are rooted in adventure, recognition, and wellbeing on and off the mountain. We spotlight employee stories, celebrate milestones, and offer exclusive outdoor perks. Whether you are at HQ, in a retail store, or remote, you will be part of a team that thrives on energy, exploration, and connection.

As Senior Product Manager, AI Experimentation Platform, you will own this platform from the ground up , setting the roadmap, defining where AI agents act autonomously and where humans stay in the loop, and driving measurable gains in conversion and revenue.

**Responsibilities**

- Own the vision, roadmap, and prioritization for the agentic experimentation platform, deciding what gets built first, what waits, and what to buy versus build.

- Define how AI agents participate across the experiment lifecycle , hypothesis generation, variant creation, test setup and QA, live monitoring, and ship-or-rollback decisions.

- Set guardrails that keep autonomous testing safe: statistical standards, sample ratio mismatch and anomaly checks, revenue and margin thresholds, approval workflows, and automatic rollback.

- Build adaptive optimization into the platform using multi-armed and contextual bandits so traffic shifts toward winning experiences while tests are still running.

- Partner with engineering and data science on core infrastructure: assignment and bucketing, feature flags, event tracking, the metrics layer, and the stats engine built on GA4 and BigQuery.

- Define and instrument platform success metrics , test velocity, win rate, revenue impact, and result trustworthiness , from day one.

- Make experimentation self-serve for merchandising, marketing, UX, and engineering teams so they can launch and read out tests without a specialist.

- Create standards and playbooks for metric definitions, test design, and readouts so results are consistent, comparable, and trusted across every site.

- Partner across engineering, design, analytics, merchandising, and marketing to turn business goals into a shipped platform and a culture of testing.

**Requirements**

- 5+ years of product management experience, including ownership of a platform, data, or internal tooling product.

- Hands-on experience running or building A/B testing and experimentation programs at scale in ecommerce or other high-traffic digital products.

- Strong statistical grounding in experiment design: power and sample size calculation, significance, peeking, multiple comparisons, and guardrail metrics.

- Hands-on experience building with AI and LLMs, including agentic workflows, prompt design, tool integrations, and evaluating AI output quality.

- Working knowledge of experimentation infrastructure , feature flagging, randomization, event tracking, and warehouse-native metrics.

- Strong analytical skills with hands-on use of SQL, GA4, BigQuery, Looker, or similar tools.

- Demonstrated impact on conversion, revenue, or testing speed with measurable results.

- Excellent communication skills and the ability to influence engineering, data, and business stakeholders.

**Benefits**

- Paid time off policies

- 401(k) match

- Medical/dental/vision and a variety of supplemental policies

- Employee discounts across our portfolio of brands

## Skills

### Required
- product management
- A/B testing
- experimentation programs
- statistical analysis
- AI
- LLMs
- SQL
- GA4
- BigQuery

### Nice to have
- experimentation platforms
- adaptive experimentation
- Bayesian methods
- variance reduction techniques
- CUPED

---

Source: [Apply at jobs.lever.co](https://jobs.lever.co/cscgeneration-2/6f602e72-5c63-4175-966b-0b3083b1da75?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)