I listen to startup podcasts so you don’t have to.

How Software Is Evolving with AI

Building
June 20, 2025
Andrej Karpathy explains Software 3.0 and AI-driven design.
Topics discussed in the episode:
-
How can founders utilize the 'autonomy slider' in AI products?
-
Why should founders adjust their digital infrastructure for LLMs?
-
How can LLMs serve as a gateway to software development for founders?
-
What can founders learn from self-driving cars about AI agent development?
-
Why should founders control the autonomy of AI in their products?
-
How does GUI design enhance human-AI collaboration in LLM apps?
-
Why should we build software infrastructure accessible to AI agents?
-
How can 'vibe coding' enable faster product development?
-
How can partial autonomy apps enhance product development?
-
How are LLMs transforming software development?

How can founders utilize the 'autonomy slider' in AI products?

Adjusting the autonomy slider allows founders to balance human oversight with AI autonomy, enhancing product effectiveness over time.

"I think what we'll see over the next decade roughly is we're going to take the slider from left to right. And I'm very interesting, it's gonna be very interesting to see what that looks like and I can't wait to build it with all of you."

  • Gradually increasing AI autonomy can improve product capabilities.
  • Founders should plan for long-term AI integration, balancing control and automation.
  • Embracing gradual autonomy helps in building effective AI-powered products.

Why should founders adjust their digital infrastructure for LLMs?

Optimizing digital infrastructure for LLMs improves AI product functionality and accessibility, enhancing user experience and competitiveness.

"If we can make docs legible to LLMs, it's going to unlock a huge amount of um kind of use and um I think this is wonderful and should happen more."

  • Making documentation and data structures LLM-friendly enhances AI capabilities.
  • Founders should adapt interfaces and tools to be accessible to AI agents.
  • Optimizing for LLMs can improve product functionality and efficiency.

How can LLMs serve as a gateway to software development for founders?

LLMs enable founders without deep coding expertise to enter software development, facilitating the building of AI products and fostering innovation.

"I think this will end up being like a gateway drug to software development... I'm not a doomer about the future of the generation, and I think, yeah, I love this video."

  • LLMs make coding accessible to non-experts, empowering founders to build products.
  • Lowering the barrier to entry accelerates innovation and product development.
  • Founders should leverage LLMs to prototype and iterate quickly.

What can founders learn from self-driving cars about AI agent development?

The challenges faced in developing self-driving cars highlight the need for patience and gradual progress in AI agent development for products.

"So when I see things like '2025 is the year of agents', I get very concerned and I kind of feel like... This is the decade of agents and this is going to be quite some time. We need humans in the loop, we need to do this carefully."

  • Rapid deployment of autonomous AI agents may be unrealistic; gradual progress is key.
  • Keeping humans in the loop ensures safety and effectiveness in AI products.
  • Founders should plan for long-term development when integrating AI agents.

Why should founders control the autonomy of AI in their products?

Controlling AI autonomy is crucial to ensure reliability and effectiveness in AI-powered products, enhancing user trust and product quality.

"We have to keep the AI on the leash. We, I think a lot of people are getting way overexcited with AI agents... It's not useful to me to get a diff of 1000 lines of code to my repo... I have to make sure that this thing is not introducing bugs..."

  • Founders should limit AI autonomy to manageable tasks to ensure quality output.
  • Keeping AI 'on the leash' prevents errors and enhances user confidence.
  • Gradually increasing autonomy while maintaining oversight improves product effectiveness.

How does GUI design enhance human-AI collaboration in LLM apps?

Effective GUI design in LLM apps speeds up the generation-verification loop, enabling founders to build better AI products with enhanced user experience.

"Reading text is effortful and it's not fun, but looking at stuff is fun and it's, it's just a kind of like a highway to your brain. So I think GUIs are very useful for auditing systems and visual representations in general."

  • Designing intuitive GUIs leverages users' visual processing to interact with AI outputs efficiently.
  • GUI aids in faster verification of AI-generated content, improving productivity.
  • Founders should focus on GUI to facilitate seamless human-AI collaboration in their products.

Why should we build software infrastructure accessible to AI agents?

Adjusting infrastructure to be accessible to LLMs enables founders to build AI-powered products more effectively, enhancing their market competitiveness.

"There's a new category of consumer and manipulator of digital information... Agents are their computers, but they are humanlike kind of right? They're people spirits. There's people spirits on the internet and they need to interact with their software infrastructure. What can we build for them?"

  • Making documentation and interfaces LLM-friendly allows AI agents to utilize software effectively.
  • Founders can improve their products by designing for both human and AI agent interaction.
  • Meeting LLMs halfway can unlock new capabilities and efficiency in AI products.

How can 'vibe coding' enable faster product development?

'Vibe coding' allows founders to build products quickly without deep expertise in programming languages, accelerating AI product development.

"By coding is so great when you want to build something super duper custom that doesn't appear to exist and you just wanna wing it because it's a Saturday or something like that."

  • Using LLMs, founders can create prototypes rapidly without extensive coding knowledge.
  • 'Vibe coding' can be a gateway to software development, lowering entry barriers.
  • Embracing AI-assisted coding accelerates innovation and product iteration.

How can partial autonomy apps enhance product development?

Integrating partial autonomy into products allows for efficient collaboration between humans and AI, improving productivity in building AI-powered products.

"I feel like a lot of software will become partially autonomous. I'm trying to think through like what does that look like. And for many of you who maintain products and services, how are you going to make your products and services partially autonomous?"

  • Founders should consider integrating partial autonomy into their products to enhance user experience.
  • Partial autonomy allows collaboration between AI and users, improving efficiency.
  • Thinking about the 'autonomy slider' helps in gradually increasing automation in your product.

How are LLMs transforming software development?

LLMs are introducing a new paradigm in software development, enabling programming through natural language prompts. This shifts how products are built using AI.

"And I think what's changed is that neural networks became programmable with large language models. It's a new kind of a computer. In my mind, it's worth giving it a new designation of software 3.0. Your prompts are now programs that program the LLM, and remarkably, these prompts are written in English."

  • Founders can leverage LLMs to build products by programming in natural language.
  • LLMs lower the barrier to AI integration, making development more accessible.
  • Embracing this new paradigm can accelerate AI-driven product innovation.