USAHead of Experimentation
3 нед. назад
USAHeadRemote
statistical significancemulti-armed bandits
Lead the experimentation pillar, owning strategy, roadmap delivery, and commercial outcomes for an experimentation platform in an AI-accelerated world.
Обязанности
- Feature management and experimentation have converged into a single market, and the buying dynamic at the top has shifted. Engineering teams are no longer the sole evaluator — data scientists and data-focused PMs now carry equal weight on the largest deals. The bar for statistical depth, warehouse ergonomics, and experiment-first workflows is rising quickly.
- In traditional experimentation we have built the foundation: a trusted runtime control plane, a growing experimentation engine, and early warehouse-native capabilities. We are winning lower-maturity buyers at healthy rates. We are not yet consistently winning the most sophisticated data organizations. Closing that gap is the job.
- In AI experimentation, we have an early lead: the AI-native tooling category has invested in evaluation and conceded production experimentation, and we already have the primitives (statistical significance, multi-armed bandits, experiment-aware guardrails) that no AI-native competitor ships. Extending that lead is the other half of the job.
- This leader will own whether becomes the definitive experimentation platform in an AI-accelerated world.
- Own the Experimentation pillar. Direct leadership of the Product team. Partner with Engineering and Design counterparts in a triad model. Accountable for the pillar's strategy, roadmap delivery, and commercial outcomes. Make the investment case across the in-product experimentation experience, the warehouse-native analysis layer, and the infrastructure that scales them.
- Make experimentation the measurement layer of the AI SDLC. Partner with our AI product, observability, and core feature management leaders to productize the capabilities we already have as AI-native primitives. Build a closed loop from offline evaluation through production experiments, to automatic promotion and rollback, to a self-improving feedback loop for agents.
- Win the high-maturity buyer. Earn the technical confidence of senior data scientists and data-focused PMs. Decide what statistical depth, warehouse coverage, and experiment-first workflow capabilities are non-negotiable, and get them shipped on a timeline that wins pivotal reference deals.
- Make warehouse-native a weapon. Expand coverage across major data warehouses and query layers. Deliver parity on analysis-only mode, variance reduction, ratio and percentile metrics, exposure validation, and arbitrary-window analysis.
- Operate a high-performing function. Run a disciplined roadmap, ship predictably against quarterly commitments, drive AI-assisted engineering productivity inside the org, and hire where gaps exist.
- Be the external face of the category. Credibly represent the product with Data scientists, PMs, experimenters, analysts, and partners. Translate the strategy to the field and equip sales to win head-to-head.
Требования
- Senior product leader (GM, VP, or equivalent) with a track record of owning a product line that competes on statistical rigor and data infrastructure.
- Deep, operator-level fluency in experimentation methodology: causal inference, variance reduction, ratio metrics, sequential testing, exposure design, multi-armed bandits, and composite/multi-objective metrics — and the realities of running these at scale against production data warehouses and against non-deterministic systems where output variance, not just user variance, drives sample-size and significance decisions.
- Has earned credibility with data science leaders and experimentation specialists at sophisticated organizations — and can recruit them.
- Has led a function that includes engineering, design, and data science. Comfortable setting a multi-quarter roadmap, championing investment allocation, and reporting results to an executive team and board.
- Clear, direct communicator. Decides fast with incomplete information. Prefers shipping and learning to requirements documents.
- Opinionated about where experimentation is going in an AI-native world — and specifically, how agents and autonomous systems will use experimentation infrastructure differently than human teams do.
Будет плюсом
- You have built or scaled experimentation at an organization where it was core infrastructure, not a secondary analytics capability.
- You have personally won competitive evaluations where a sophisticated data-science organization was the deciding voice.
- You have shipped warehouse-native data products and understand the operational realities of running experiments directly against customer data infrastructure.
- You see experimentation as how software teams prove that any change — whether built by a person or an AI agent — actually worked. That evidence layer is core infrastructure, not a reporting afterthought.
Другое
- Win rate on experimentation-involved deals, especially head-to-head competitive evaluations — step change in the first year, sustained improvement thereafter.
- Reference-grade customers at the top of the maturity curve, including named strategic logos.
- Monthly active customers and active-account ARR growth against plan.
- Experimentation attach rate on new and expansion enterprise deals.
- Engineering throughput — roadmap delivery velocity and AI-assisted development adoption inside the function.
- Target pay ranges based on Geographic Zones* for Level M5:
- Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $ 301,000 - $414,000 **
- Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $ 271,000 - $373,000 **
- Zone 3: All other US locations - $ 256,000 - $352,000 **
- All Zones inclusive of 20% Bonus
- operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location.
- *Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas. **Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary.
- Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software. The platform helps developers innovate on new features faster while protecting them with a safety valve to instantly rewind when things go wrong. Developers can target product experiences to any customer segment and maximize the business impact of every feature. And by gradually rolling out new application components, they escape nightmare "big-bang" technology migrations.
- The platform was built to guide engineers to the next frontier of DevOps by:
- Improving the velocity and stability of software releases, without the fear of end customer outages
- Delivering targeted experiences by easily personalizing features to customer cohorts
- Maximizing the business impact of every feature through the ability to experiment and optimize
- Coordinating the release and optimization of software to provide consistent experiences across mobile platforms and device types
- Improving the effectiveness and productivity of engineering teams, by providing insights into engineering cadence and stability
- At , we believe in the power of teams. We're building a team that is humble, open, collaborative, respectful and kind. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status. LD invites any applicant to review our written Affirmative Action Plan. To do so, contact People Ops at hr@.com .
- Do you need a disability accommodation?
- Fill out this accommodations request form and someone from our People Operations team will contact you for assistance.
- Your safety matters to us. To protect yourself from potential scams, recruiters will only contact you from @ .com email addresses or via LinkedIn from "Verified Recruiter" accounts. Be cautious of emails from other domains. Legitimate recruiters will never ask for money, fees, or banking information before making a job offer. will never make a job offer without conducting a formal interview process. Our interview process does not involve asking detailed questions by email. If you are ever unsure about a communication that you receive, don't click any links—visit Careers | directly for confirmed job openings and links to apply.
- Please notify us of any fraudulent representation by sending an email to careers@.com .