СШАMember of Product Staff
2 нед. назад
СШАLeadOnsite
Member of Product Staff to be GM and owner of a product pillar, identifying what to build, shipping with engineering and research, driving to measurable outcomes.
О компании
- is the platform for evaluating how AI models perform in the real world. Founded by researchers from UC Berkeley's SkyLab, we're on a mission to measure and advance the frontier of AI for real-world use, and to build the foundation for everyone to understand, shape, and benefit from it.
- Tens of millions of people use each month to evaluate how frontier systems handle the work they actually do. The preferences they share power the most transparent, rigorous, and human-centered evaluations in AI. Leading AI labs, enterprises, and independent researchers rely on our work and open datasets to understand how models behave in real workflows: agentic coding, creative generation, professional productivity, and beyond. We go beyond leaderboards and decompose what human experience reveals about AI, so models advance toward the work people actually do.
- We're a team of researchers, academics, builders, and creatives from UC Berkeley, Google, Stanford, and DeepMind. We seek truth, move fast, and value craftsmanship, curiosity, and impact over hierarchy. We're building a company where thoughtful, curious people from all backgrounds can do their best work together, in an office culture that radiates excellence, energy, and focus.
Обязанности
- We're looking for a Member of Product Staff to be the GM and owner of a product pillar, identifying what to build, building conviction, shipping with engineering and research, and driving it to measurable outcomes. This is a highly cross functional role and You are close to users, close to the data, and close to the code. You write the PRDs, you query the tables yourself, and you stay with the product after launch until it works.
- is small, and the product surface is unusually broad: a consumer product used by tens of millions of people each month, an API and enterprise offering that leading AI labs and enterprises rely on, and the evaluation methodology and leaderboard that sit underneath all of it. Depending on your background, you'll focus on one of the following areas:
- Enterprise & API. The API and enterprise product surface that labs, enterprises, and independent researchers build on. You'll partner directly with customers to integrate models, run evals, and deliver high-quality results; translate their feedback into product and engineering initiatives; and own packaging and monetization so that every new product ships instrumented, billable, and correctly represented in our systems.
- Evaluation. The products that turn human preference into trustworthy evaluation. This is the leaderboard, the methodology, and the tools model developers use. You'll partner with research to develop new metrics, methodologies, and evaluation protocols that go beyond traditional benchmarks, disentangle performance factors like style, reasoning, and robustness, and protect the scientific integrity and transparency of the leaderboard.
- Growth. How tens of millions of people discover, use, and come back to . You’ll run experiments, and partner with design and marketing engineering to turn what we learn about our highest-expectation users into a product they can't stop using.
Будет плюсом
- Production experience with AI/LLM systems — inference pipelines, evaluation workflows, model integration, or AI-powered product features
- Experience with developer- or enterprise-facing products, and fluency in consumption or usage-based revenue models
- Comfort working with real-world usage data and designing metrics beyond standard benchmarks, including experiments run with statistical rigor
- Experience growing a consumer or developer product at scale, with hands-on ownership of experimentation and analytics
- You've raised the bar on a team with measurable before/after — introduced practices, tools, or standards that others adopted
Условия
- We offer competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate’s permanent work location.
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team
- A culture that values transparency, trust, and community impact
- Come help build the space where anyone can explore and help shape the future of AI.
Другое
- Own product areas end to end, from identifying opportunities that aren't on anyone's roadmap, to building conviction, shipping, and driving to measurable outcomes
- Ship and iterate, You measure, course-correct, and drive to sustained impact against the companies north star goals.
- Work with ML researchers to turn research into product, creating new methods, models, and data consumable for the people who need them
- Develop a deep understanding of our highest-expectation users, consumers, labs, enterprises, researchers and how they actually use
- Monitor user feedback, usage data, and analytics to identify trends, prioritize initiatives, and refine what we've shipped
- Write the PRDs, specs, and narratives that align engineering, design, research, and leadership, and create clarity out of ambiguity when needed
- Make high-stakes product decisions under uncertainty, and be accountable for the outcomes
- Raise the product quality bar on the team and introduce practices others adopt, unblock teammates, and hold the line on craft
- 5-10+ years of product management experience on consumer, developer, or enterprise products, ideally including 0-to-1 work at an early-stage company
- A track record of repeated, attributable impact, multiple projects across different roles or companies where you can quantify outcomes (revenue, engagement, efficiency) and the impact sustained after you moved on
- Product judgment, taste and autonomous ownership. You've identified opportunities, validated them with evidence, built buy-in, shipped, and the bet paid off.
- You’ve killed important projects in your career for the betterment of the product.
- Clear, persuasive communication. You build buy-in across engineering, research, design, and leadership. You create clarity for others, not just yourself
- Technical depth to work directly with engineers and researchers
- Genuine conviction about AI evaluation and 's mission — you can articulate why this domain matters and where the product should go
- Comfort with ambiguity. We're a startup. Scope is fluid, context shifts, and you'll wear many hats