Signal Over Noise: The Discernment Newsletter by Jodi Schiller logo

Signal Over Noise: The Discernment Newsletter by Jodi Schiller

Archives
Log in
Subscribe
July 23, 2026

Everyone Is Measuring AI ROI Wrong

Artificial intelligence is a systems wide tool for intelligence amplifying.

Everyone Is Measuring AI ROI Wrong

Most discussions about AI return on investment begin with the wrong question.

How many hours did AI save?

That assumes AI is primarily a labor replacement technology.

It isn't.

I think we've been looking at AI backwards.

AI is really IA: an Intelligence Amplifier.

Once you see it that way, traditional ROI calculations begin to look surprisingly incomplete.

The First Mistake: Counting Only Time Saved

If an employee spends ten hours writing reports and AI reduces that to five, most organizations conclude they saved five hours of labor.

That calculation is technically correct.

It is also almost meaningless.

The real question is:

What became possible because those five hours were returned?

Did the employee produce twice as much work?

Did they pursue opportunities that were previously impossible?

Did they solve problems that had been ignored for years because no one had time?

Traditional ROI stops measuring precisely where the interesting returns begin.

The Missing Piece: Systems and Second-Order Effects

The mistake isn't just mathematical.

It's systemic.

A system is a collection of interconnected parts whose interactions produce outcomes that no single part can explain on its own.

Businesses are systems.

Teams are systems.

Knowledge work is a system.

When you change one part of a system, the effects ripple outward.

Those ripple effects are called second-order effects. They are the consequences that occur because something changed, not the change itself.

Most AI ROI calculations stop at the first-order effect:

Hours saved.

But that's just the pebble hitting the water.

The ripples are where the real value lives.

AI Doesn't Just Reduce Cost. It Expands Human Capacity.

Most companies think AI increases productivity.

The companies that win will realize it increases human capacity.

Every major technological revolution has done more than eliminate labor.

The steam engine didn't simply save muscle.

The spreadsheet didn't simply save accountants.

The internet didn't simply reduce postage.

Each expanded human capacity by allowing people to accomplish more, tackle larger problems, and operate at a scale that was previously impossible.

AI follows the same pattern.

It is not just a tool at the edge of work. It is a system-wide upgrade that changes how decisions get made, how information moves, how teams coordinate, how knowledge is preserved, and how execution happens.

Organizations expecting only cost savings are treating it like a faster photocopier when it is much closer to a cognitive force multiplier.

Consider a marketing manager who once spent two weeks researching competitors, analyzing trends, drafting messaging, and preparing a product launch presentation.

If all you measure is labor savings, AI appears to have returned ten days of work.

But that's the wrong measurement.

The real return is that the same manager can now explore five different market strategies instead of one, test competing messages before launch, identify risks earlier, synthesize customer feedback in hours instead of weeks, and arrive at a stronger strategic decision.

The time wasn't simply saved.

It was reinvested.

That pattern repeats across the organization.

Engineers spend more time solving difficult technical problems instead of searching documentation.

Lawyers spend more time developing strategy instead of assembling first drafts.

Teachers spend more time mentoring students instead of creating repetitive lesson materials.

Researchers spend more time generating new ideas instead of organizing information.

Those are second-order effects.

Nothing about them is adequately captured by the phrase "hours saved."

Compounding Is the Story

Suppose AI saves one hour every day.

The obvious return is one recovered hour.

The hidden return is what happens when that hour is reinvested every day for years.

One more client served.

One more proposal submitted.

One more experiment conducted.

One more article published.

One more product launched.

Knowledge work compounds.

Small increases in intellectual throughput create disproportionately large long-term outcomes.

Traditional ROI models treat each hour independently.

Systems don't.

The effects compound through people, teams, and organizations.

The Biggest Return Is Ambition

Perhaps the greatest return on AI is not speed.

It is ambition.

People begin attempting work they would never have attempted before.

A single person can research like a small team.

Prototype like an agency.

Analyze like a consultant.

Learn like they have a private tutor.

Write at a volume that once required an editorial staff.

The question shifts from:

"How much faster can I do my old job?"

to

"What entirely new work is now within reach?"

That is where the real economics of AI begin.

Measure Systems, Not Tasks

Efficiency is easy to measure.

Capacity is harder.

Systems are harder still.

The organizations that win won't be the ones that save the most labor.

They'll be the ones that understand AI doesn't simply automate tasks.

It changes how the entire system behaves.

They're measuring AI with a linear metric while deploying it inside a complex adaptive system.

That's why they're consistently underestimating its return on investment.

The biggest returns from AI aren't found in the minutes it saves.

They're found in the second-order effects it unleashes throughout the system.

That's why AI is really IA.

An Intelligence Amplifier.

Don't miss what's next. Subscribe to Signal Over Noise: The Discernment Newsletter by Jodi Schiller:
← Newer We Are Building an Ecosystem We May Not Be Able to Govern Older → Bridge Courage America: School of Systems Thinking
Powered by Buttondown, the easiest way to start and grow your newsletter.