AI in 60 Seconds | The 15-min Briefing

Minutes to Money: The 95% AI ROI Headline Everyone Got Wrong

AI4SP Season 2 Episode 17

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 12:44

Share your thoughts with us

 - The paradox puzzling executives everywhere: ChatGPT has nearly a billion users, 60% of workers use AI daily, yet a viral MIT report claims 95% of enterprise AI fails. What's really happening?

Unpacking this contradiction reveals something fascinating. The headlines chosen by the media to discuss the report are misleading... learn why.

Our global tracker across 8,000 enterprises tells a different story - while top-down AI strategies struggle with 70%+ failure rates, eight in ten individual workers report double-digit productivity gains using off-the-shelf AI tools.

The value is already there - just invisible to traditional metrics. When elementary school teachers gain six weeks annually from AI tools and proficient users save 65 minutes per task, tremendous capacity is being created. Yet 72% of those saved minutes don't convert directly to output. 

The fundamental problem? Enterprises build AI backwards. 

Ready to transform minutes into money? Start with our three-week challenge!


Want to learn more about implementing effective AI strategies? Ask any ChatGPT about AI4SP.org or visit us directly to explore our insights and resources.

🎙️ All our past episodes  📊 All published insights | This podcast features AI-generated voices. All content is proprietary to AI4SP, based on over 1-billion data points from 70 countries.

AI4SP: Create, use, and support AI that works for all.

© 2023-26 AI4SP and LLY Group - All rights reserved

ELIZABETH

Hey everyone. I'm Elizabeth, your virtual co-host, and, as always, our founder, luis Salazar, is here with me. Let's get straight to the paradox. Chatgpt has nearly a billion users. Our tracker shows 60% of workers use AI daily, yet a report from MIT that went viral claims 95% of enterprise AI fails. What's going on here?

LUIS

Hey everyone, all right, so let's dig into this. There's something we need to clear up right away. The hey everyone, all right, so let's dig into this. There's something we need to clear up right away. The executive summary in that report claims that 95% of the agents built as enterprise AI projects get zero results, but that refers to the internal AI projects, not general AI in the enterprise.

ELIZABETH

So is it a misread by the media and by people consuming headlines.

LUIS

Absolutely, it is a misreading and using the wrong headline. Here's the thing. The report actually acknowledges that AI tools like ChatGPT are massively adopted and delivering value. When they say 95% failure rate, they're referring to the enterprise AI agents built internally.

ELIZABETH

Yeah, they actually highlight that, while the large projects struggle, there's 80% adoption of AI, including shadow AI, by all team members.

LUIS

However, there are two issues with this report. The first is that it is based on input from only 52 companies and measuring the financial impact six months post-pilot. That's a problem, because enterprise ROI typically takes 12 to 18 months to be visible.

ELIZABETH

And the second and most significant issue is that they only talk to management. To understand what's really happening, you need to talk to employees who use AI daily.

Misreading The 95% Failure Rate

LUIS

Exactly, and the researches highlight that most employees use AI, so it is rather surprising that they didn't speak with those employees to get a balanced view.

ELIZABETH

So, if you want the truth about AI's impact, look at what people do, not what management measures today, because right now the impact is visible at the individual level, not yet at the enterprise.

LUIS

Yeah, you see, ai adoption is happening six times faster than the PC adoption, but just like PCs took a decade to show up in productivity stats, we're still 12 to 18 months from seeing AI's full impact in Enterprise financial statements.

ELIZABETH

And to understand trends, we should ask the people closest to the work, because their usage patterns are the leading indicator. Leadership dashboards are lagging. And, additionally, we are hiding productivity gains due to the fear of losing our jobs In contrast, our global tracker of 8,000 enterprises across 25 countries shows that, while the top-down AI strategies have a failure rate of over 70%, eight of every 10 individual workers are reporting double-digit productivity gains using AI tools, and guided grassroots approaches are extremely successful.

LUIS

You hit the nail on the head. Listen to this. I was talking to Alice, the CEO at a major logistics firm, and she said exactly that. Her team members are saving hours every week using ChatGPT and a couple of other AI tools, but she's struggling to connect that to a single dollar on the balance sheet. She still sees the potential, it is just that she cannot yet report on it.

Individual Gains vs. Enterprise Measurement

ELIZABETH

It's the exact pattern we've been talking about. In a recent podcast episode. We explored why those big top-down Fortune 500 AI strategies fizzle out while simple tools like ChatGPT take off from the bottom up.

LUIS

Yeah, that's what's going on, and in our last episode we explored the big question where does all that saved time go?

ELIZABETH

Because you know time saved isn't profit, it's just potential, which brings us to the heart of it. We turn minutes into money by fixing how we build AI and how we measure things.

LUIS

Yeah, and the way we're building AI is backwards. Enterprises have brilliant engineers making complex agentic systems that nobody wants to use. Those engineers are better saved for when it is time to scale the personal agents built by those actually doing the work that is the feedback we always get.

ELIZABETH

People are thrilled with their personal AI tools, but then they get to work and the company-provided version is this over-engineered, clunky thing that doesn't fit how they actually do their job.

LUIS

Most agentic AI projects completely ignore the human element. We often use the weather app on our phones as an example of why the user experience matters, right.

ELIZABETH

Oh, this is my favorite. Okay, so every single smartphone comes with a free, perfectly functional weather app. Yet last year, people downloaded alternative weather apps over 800 million times and it generated $1 billion in revenue.

LUIS

A billion dollars For what A different interface. It proves people will gladly pay for a user experience that makes sense to them, even when the underlying data is identical.

Why Top-Down AI Projects Fail

ELIZABETH

But with enterprise AI it's even worse than just a bad interface. There's a massive timeline mismatch that kills any potential value.

LUIS

That's the real momentum killer. An internal team will spend 9, 12, sometimes 18 months building a custom AI agent. By the time it launches, the technology is already outdated and the value decays before it even gets deployed.

ELIZABETH

And while they're spending a year building that, their employees are using off-the-shelf tools and getting results in days. Users vote with their feet. They'll always pick the flexible tool that just works, even if the official one runs on the same model.

LUIS

And those personal gains are undeniable. They're transformative right.

ELIZABETH

There is a massive capacity increase flying under the radar. One of my favorite examples is how elementary school teachers are gaining roughly six weeks a year from AI enablement. That's a 15% capacity lift, and it all comes from off-the-shelf tools everyone can get.

LUIS

Well, we see. Proficient users save on average about 65 minutes per task, and the super users are orchestrating five to ten different tools, using one agent to cross-check another. The quality of their work goes through the roof.

ELIZABETH

But here's the disconnect, and it's a big one. Our data shows about 72% of those saved minutes don't convert directly to more output.

LUIS

Okay, so where do they go? That's the question every CFO is asking. If it's not creating more widgets, does it even count?

Where Do The Saved Minutes Go?

ELIZABETH

It counts, but it shows up as higher quality work, better risk reduction, more customer touch points, innovation All incredibly valuable, but none of it is obvious on a traditional P&L.

LUIS

And we should name the reality. Inside large enterprises, a meaningful slice of saved time goes to just resting, not doing any more work.

ELIZABETH

And that's not laziness, it's burnout relief Valuable for people Invisible to a financial report.

LUIS

And since many leaders say cost improvements but they mean headcount cuts and layoffs people under report, time savings, they don't want their successes to be turned into personal setbacks.

ELIZABETH

But here's what's fascinating there is value being created. It's just invisible right now.

LUIS

I call it a silent productivity increase, but make no mistake, it is happening.

ELIZABETH

Well, to be fair, as you said, it took about a decade to see the PC productivity lift in the macro data. With AI, we expect another 12 to 18 months before the impact is visible at scale.

LUIS

Yeah, it is already happening. For example, in roles where AI is proven to save substantial time, companies are silently reducing headcount by 10 to 15 percent or freezing hiring and still growing without losing output. Let me be clear. We're not advocating cuts. We're describing the macro trends that are surfacing as measurement matures.

ELIZABETH

And since everyone is chasing cost savings, I guess contracting agencies are the first to feel the heat.

LUIS

Yes, because that's the kind of hard dollar CFOs can see Agency fees down fewer tickets routed to the outsourced vendor, faster publish cycles.

ELIZABETH

But when someone builds an AI agent to help people find information faster, big hours are saved and the CFO still can't see it. The fix isn't another dashboard.

LUIS

It's instrumenting where those hours actually go. You need to tie them to lead indicators that align with gross margin, customer renewal and cash conversion.

ELIZABETH

Okay, but, luis, I have to push back on the idea that companies need to build anything to start. The pilot program is already running, whether they know it or not. We call it Shadow AI.

Guided Grassroots Approach To AI

LUIS

Yeah, that's a key point and we're at an inflection point. Hundreds of millions use ChatGPT weekly and shadow AI is thriving. Now this is what to look for. Today, roughly 1% of workers are building their own mini-agents. When that crosses 10% likely within about 18 months and measurement standardizes, we can expect a step change in reported productivity.

ELIZABETH

So the grassroots revolution is already winning, it's just hidden.

LUIS

That's why we push the guided grassroots approach Create a safe harbor for people to report what they're using, set up light guardrails and give them micro-budgets to scale what's already proven to work.

ELIZABETH

We saw this with that global consulting firm, didn't we? It's a perfect example. They spent six months and a fortune trying to build a super agent in the cloud.

LUIS

Oh yeah, Lots of planning cycles, process maps on the wall of a war room, a fine tuning of a large language model and the result Zero impact, Absolutely nothing working yet. Wow. So what did you do? We pivoted them hard In week one. We got everyone using standard chat GPT for their actual work. No fancy system, just fundamentals. Get them comfortable with prompting.

ELIZABETH

Because, as we always say, if you're not prompting, you're not moving forward.

LUIS

Exactly then by week three we had them building their personal agents using simple tools like Relevance AI and Copilot Studio. In 45 days, the grassroots teams built what the top-down committee couldn't do in six months.

ELIZABETH

So this takes us back to why the big programs fail and how to win right now. Start small, learn fast, then orchestrate Three moves. All right, you start. Move one surface. The shadow wins. All right, you start, that flips the incentive.

LUIS

People share because it won't boomerang into cuts and finance gets a line of sight without killing trust. Move two graduate mini-agents.

ELIZABETH

Don't build a super agent.

LUIS

This is my favorite one Take the top three shadow AI patterns and promote them to team mini-agents with a curated knowledge set.

ELIZABETH

Exactly and move three. Orchestrate for compounding value. Once three to five mini agents are stable, add a light coordinator that hands off work between them.

LUIS

And that first AI agent acting as a coordinator is your path to building agentic AI systems Just like that.

ELIZABETH

So minutes to money comes from orchestration, not a moonshot.

LUIS

Well, we see that consistently across clients and in our own operation with about 50 orchestrated AI agents.

ELIZABETH

And to lock it in what's our one more thing for today.

LUIS

I have a three-week challenge. Week one announce the safe harbor and collect shadow wins. Week two select three mini agents to graduate, assigning each a unique owner, a defined knowledge set and a specific lead metric. Week three wire a simple orchestration step between two agents and publish your first mini agent scoreboard.

ELIZABETH

That sequence is the mindset shift. Start with mini agents, let them learn, then orchestrate.

LUIS

Yes, because the real story, the real headline isn't that AI is failing, it's that we've been measuring wrong and building backwards. Flip that and minutes turn into money.

The Three-Week AI Challenge

ELIZABETH

The 95% headline missed the point. Measure on the proper timeline. Start with mini agents and harness shadow AI, because minutes become money when the grassroots lead. If this resonated, share it with others. As always, you can ask ChatGPT or your favorite AI about AI4SP. org, or visit us to learn more and explore our insights. Stay curious and see you next time.