OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil (CPO at OpenAI, ex-Instagram, Twitter)

Kevin Weil is the chief product officer at OpenAI, where he oversees the development of ChatGPT, enterprise products, and the OpenAI API. Prior to OpenAI, Kevin was head of product at Twitter, Instagram, and Planet, and was instrumental in the development of the Libra (later Novi) cryptocurrency project at Facebook.

In this episode, you’ll learn:

1. How OpenAI structures its product teams and maintains agility while developing cutting-edge AI

2. The power of model ensembles—using multiple specialized models together like a company of humans with different skills

3. Why writing effective evals (AI evaluation tests) is becoming a critical skill for product managers

4. The surprisingly enduring value of chat as an interface for AI, despite predictions of its obsolescence

5. How “vibe coding” is changing how companies operate

6. What OpenAI looks for when hiring product managers (hint: high agency and comfort with ambiguity)

7. “Model maximalism” and why today’s AI is the worst you’ll ever use again

8. Practical prompting techniques that improve AI interactions, including example-based prompting

—

Brought to you by:

• Eppo—Run reliable, impactful experiments

• Persona—A global leader in digital identity verification

• OneSchema—Import CSV data 10x faster

—

Where to find Kevin Weil:

• X: x.com

• LinkedIn: www.linkedin.com

—

Where to find Lenny:

• Newsletter: www.lennysnewsletter.com

• X: twitter.com

• LinkedIn: www.linkedin.com

—

In this episode, we cover:

(00:00) Kevin’s background

(04:06) OpenAI’s new image model

(06:52) The role of chief product officer at OpenAI

(10:18) His recruitment story and joining OpenAI

(17:20) The importance of evals in AI

(24:59) Shipping quickly and consistently

(28:34) Product reviews and iterative deployment

(39:35) Chat as an interface for AI

(43:59) Collaboration between researchers and product teams

(46:41) Hiring product managers at OpenAI

(48:45) Embracing ambiguity in product management

(51:41) The role of AI in product teams

(53:21) Vibe coding and AI prototyping

(55:55) The future of product teams and fine-tuned models

(01:04:36) AI in education

(01:06:42) Optimism and concerns about AI’s future

(01:16:37) Reflections on the Libra project

(01:20:37) Lightning round and final thoughts

—

Referenced:

• OpenAI: openai.com

• The AI-Generated Studio Ghibli Trend, Explained: www.forbes.com

• Introducing 4o Image Generation: openai.com

• Waymo: waymo.com

• X: x.com

• Facebook: www.facebook.com

• Instagram: www.instagram.com

• Planet: www.planet.com

• Sam Altman on X: x.com

• A conversation with OpenAI’s CPO Kevin Weil, Anthropic’s CPO Mike Krieger, and Sarah Guo: www.youtube.com

• OpenAI evals: github.com

• Deep Research: openai.com

• Ev Williams on X: x.com

• OpenAI API: platform.openai.com

• Dwight Eisenhower quote: www.brainyquote.com

• Inside Bolt: From near-death to ~$40m ARR in 5 months—one of the fastest-growing products in history | Eric Simons (founder & CEO of StackBlitz): www.lennysnewsletter.com

• StackBlitz: stackblitz.com

• Claude 3.5 Sonnet: www.anthropic.com

• Anthropic: www.anthropic.com

• Four-minute mile: en.wikipedia.org

• Chad: chatgpt.com

• Dario Amodei on LinkedIn: www.linkedin.com

• Figma: www.figma.com

• Julia Villagra on LinkedIn: www.linkedin.com

• Andrej Karpathy on X: x.com

• Silicon Valley CEO says ‘vibe coding’ lets 10 engineers do the work of 100—here’s how to use it: fortune.com

• Cursor: www.cursor.com

• Windsurf: codeium.com

• GitHub Copilot: github.com

• Patrick Srail on X: x.com

• Khan Academy: www.khanacademy.org

• CK-12 Education: www.ck12.org

• Sora: openai.com

• Sam Altman’s post on X about creative writing: x.com

• Diem (formerly known as Libra): en.wikipedia.org(digital_currency)

• Novi: about.fb.com

• David Marcus on LinkedIn: www.linkedin.com

• Peter Zeihan on X: x.com

• The Wheel of Time on Prime Video: www.amazon.com

• Top Gun: Maverick on Prime Video: www.amazon.com

• Thinking like a gardener not a builder, organizing teams like slime mold, the adjacent possible, and other unconventional product advice | Alex Komoroske (Stripe, Google): www.lennysnewsletter.com

• MySQL: www.mysql.com

—

Recommended books:

• Co-Intelligence: Living and Working with AI: www.amazon.com

• The Accidental Superpower: Ten Years On: www.amazon.com

• Cable Cowboy: www.amazon.com

—

Production and marketing by penname.co. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

—

Lenny may be an investor in the companies discussed.