back

o3 & o4-mini. Deep dive & secret abilities

OpenAI's o3 reshapes how we search information

OpenAI's latest models o3 and o4-mini have arrived with capabilities that move beyond conventional AI chatbots. After extensive testing over several days, I've discovered these models represent a significant leap in how AI can autonomously research, analyze images, and solve complex problems—all with minimal human guidance.

Key Points

  • Agentic capabilities are the game-changer: Both models can autonomously deploy multiple research agents in parallel, allowing them to search the web, analyze images, and run code simultaneously to solve complex tasks.
  • Visual analysis reaches new heights: o3 can identify restaurants from blurry menu photos, pinpoint geographic locations from ordinary landscapes, and solve visual puzzles—all by combining image analysis with web research.
  • Performance varies by task: While o3 and o4-mini excel at reasoning and creative tasks, they still struggle with hallucinations (6.8% and 4.6% rates respectively) compared to Google's Gemini models.
  • TIFF layering and other visual abilities: Unlike other models, o3 can generate layered image files with transparent elements that can be edited afterward in design software.

The Business Game-Changer: Autonomous Research

The most impressive aspect of these models isn't just their ability to analyze information, but how they autonomously research, verify, and synthesize it. When shown a blurry photo of a yacht sailing through a harbor, o3 identified not just the vessel's name and owner, but also researched its last known location and movement patterns—all in just 35 seconds.

This represents a fundamental shift in how businesses will conduct research and analysis. Instead of employees spending hours searching through multiple sources, verifying information, and piecing together reports, these models can coordinate multiple research streams simultaneously, cross-reference findings, and deliver verified results in seconds.

In the context of business intelligence, this means the time from question to actionable insight shrinks dramatically. A financial analyst won't just receive a summary of earnings reports but a comprehensive analysis that contextualizes it against market trends, competitor performance, and historical patterns—all generated while they grab a coffee.

Beyond the Video: Where This Fits in Business Workflows

While the video demonstrates impressive consumer-facing

Recent Videos

May 6, 2026

Hermes Agent Master Class

https://www.youtube.com/watch?v=R3YOGfTBcQg Welcome to the Hermes Agent Master Class — an 11-episode series taking you from zero to fully leveraging every feature of Nous Research's open-source agent. In this first episode, we install Hermes from scratch on a brand new machine with no prior skills or memory, walk through full configuration with OpenRouter, tour the most important CLI and slash commands, and run our first real task: a competitor research report on a custom children's book AI business idea. Every future episode will build on this fresh install so you can see the compounding value of the agent in real time....

Apr 29, 2026

Andrej Karpathy – Outsource your thinking, but you can’t outsource your understanding

https://www.youtube.com/watch?v=96jN2OCOfLs Here's what Andrej Karpathy just figured out that everyone else is still dancing around: we're not in an era of "better models." We're in a different era of computing altogether. And the difference between understanding that and not understanding it is the difference between being a vibe coder and being an agentic engineer. Last October, Karpathy had a realization. AI didn't stop being ChatGPT-adjacent. It fundamentally shifted. Agentic coherent workflows started to actually work. And he's spent the last three months living in side projects, VB coding, exploring what's actually possible. What he found is a framework that explains...

Mar 30, 2026

Andrej Karpathy on the Decade of Agents, the Limits of RL, and Why Education Is His Next Mission

A summary of key takeaways from Andrej Karpathy's conversation with Dwarkesh Patel In a wide-ranging conversation with Dwarkesh Patel, Andrej Karpathy — former head of AI at Tesla, founding member of OpenAI, and creator of some of the most popular AI educational content on the internet — shared his views on where AI is headed, what's still broken, and why he's now pouring his energy into education. Here are the key takeaways. "It's the Decade of Agents, Not the Year of Agents" Karpathy's now-famous quote is a direct pushback on industry hype. Early agents like Claude Code and Codex are...