OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil (CPO at OpenAI, ex-Instagram, Twitter)

OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil (CPO at OpenAI, ex-Instagram, Twitter)

April 10, 2025 1 hr 31 min
🎧 Listen Now

🤖 AI Summary

Overview

This episode features Kevin Weil, Chief Product Officer at OpenAI, discussing the transformative impact of AI on product development, creativity, and the future of work. He shares insights into OpenAI's internal processes, the rapid evolution of AI capabilities, and the opportunities for startups in the AI ecosystem. The conversation also touches on his personal journey, lessons from past projects, and his vision for AI's role in education and society.

Notable Quotes

- The AI models that you're using today is the worst AI model you will ever use for the rest of your life.Kevin Weil, on the rapid pace of AI improvement.

- Why can't you send money as immediately, as cheaply, as simply as you send a text message? It should exist.Kevin Weil, reflecting on the unrealized potential of Facebook's Libra project.

- Good work consistently over a long period of time.Kevin Weil, quoting Mark Zuckerberg on the power of persistence.

🚀 The Rapid Evolution of AI

- Kevin Weil emphasizes the unprecedented pace of AI development, noting that every few months, models gain capabilities that were previously unimaginable.

- OpenAI's iterative deployment philosophy allows teams to launch early, learn from user feedback, and improve models in real-time.

- He advises developers to build products that push the boundaries of current AI capabilities, as models will soon catch up and unlock new possibilities.

🛠️ Building AI Products: Evals and Fine-Tuning

- Evals, or model benchmarks, are critical for understanding how well AI performs specific tasks. Kevin predicts writing evals will become a core skill for product managers.

- Fine-tuning models with industry-specific data is key to unlocking their full potential. OpenAI uses ensembles of models internally, combining different sizes and capabilities to optimize performance for specific tasks.

- He encourages startups to focus on vertical-specific applications of AI, as foundational model companies like OpenAI won't tackle every niche.

🎨 AI and Creativity

- AI tools like OpenAI's ImageGen and Sora video model are democratizing creativity, enabling even non-artists to produce high-quality visual content.

- Kevin shares how filmmakers use AI to brainstorm and iterate on visual effects, reducing costs and expanding creative possibilities.

- He sees AI as a collaborator that enhances human creativity rather than replacing it, allowing creators to explore more ideas and achieve better outcomes.

📚 Education and AI Tutoring

- Personalized AI tutoring has the potential to revolutionize education, offering free, tailored learning experiences to billions of children worldwide.

- Despite the capabilities of current models, Kevin is surprised that no large-scale AI tutoring platform exists yet, calling it one of the most impactful opportunities for AI.

- He envisions AI accelerating learning and reskilling, helping individuals adapt to the changing job landscape.

💡 Lessons from Libra and Leadership

- Reflecting on Facebook's Libra project, Kevin describes it as the biggest disappointment of his career, citing challenges with regulation, timing, and public perception.

- He believes the idea of seamless, instant money transfers remains vital and hopes it will be realized in the future.

- On leadership, he highlights the importance of decisiveness, high agency, and persistence, sharing his belief in good work consistently over a long period of time as a recipe for success.

AI-generated content may not be accurate or complete and should not be relied upon as a sole source of truth.

📋 Episode Description

Kevin Weil is the chief product officer at OpenAI, where he oversees the development of ChatGPT, enterprise products, and the OpenAI API. Prior to OpenAI, Kevin was head of product at Twitter, Instagram, and Planet, and was instrumental in the development of the Libra (later Novi) cryptocurrency project at Facebook.

In this episode, you’ll learn:

1. How OpenAI structures its product teams and maintains agility while developing cutting-edge AI

2. The power of model ensembles—using multiple specialized models together like a company of humans with different skills

3. Why writing effective evals (AI evaluation tests) is becoming a critical skill for product managers

4. The surprisingly enduring value of chat as an interface for AI, despite predictions of its obsolescence

5. How “vibe coding” is changing how companies operate

6. What OpenAI looks for when hiring product managers (hint: high agency and comfort with ambiguity)

7. “Model maximalism” and why today’s AI is the worst you’ll ever use again

8. Practical prompting techniques that improve AI interactions, including example-based prompting

Brought to you by:

Eppo—Run reliable, impactful experiments

Persona—A global leader in digital identity verification

OneSchema—Import CSV data 10x faster

Where to find Kevin Weil:

• X: https://x.com/kevinweil

• LinkedIn: https://www.linkedin.com/in/kevinweil/

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

In this episode, we cover:

(00:00) Kevin’s background

(04:06) OpenAI’s new image model

(06:52) The role of chief product officer at OpenAI

(10:18) His recruitment story and joining OpenAI

(17:20) The importance of evals in AI

(24:59) Shipping quickly and consistently

(28:34) Product reviews and iterative deployment

(39:35) Chat as an interface for AI

(43:59) Collaboration between researchers and product teams

(46:41) Hiring product managers at OpenAI

(48:45) Embracing ambiguity in product management

(51:41) The role of AI in product teams

(53:21) Vibe coding and AI prototyping

(55:55) The future of product teams and fine-tuned models

(01:04:36) AI in education

(01:06:42) Optimism and concerns about AI’s future

(01:16:37) Reflections on the Libra project

(01:20:37) Lightning round and final thoughts

Referenced:

• OpenAI: https://openai.com/

• The AI-Generated Studio Ghibli Trend, Explained: https://www.forbes.com/sites/danidiplacido/2025/03/27/the-ai-generated-studio-ghibli-trend-explained/

• Introducing 4o Image Generation: https://openai.com/index/introducing-4o-image-generation/

• Waymo: https://waymo.com/

• X: htt