01/11/2025

You Centralised AI. That’s the Problem.

ai-centralized-problem

For a while, the story around AI felt neat.

Bigger models would live in bigger data centres. Intelligence would sit far away, running quietly behind layers of abstraction. Businesses would connect to it when needed, much like electricity from the grid.

That idea worked. Until it didn’t.

What’s shifting now isn’t the usefulness of AI. It’s where intelligence lives, how it behaves, and who it truly serves. Many organisations are still chasing scale and central control, while the real change is happening somewhere else, closer to people, closer to operations, closer to daily decisions.

This is not a technical shift alone. It’s a leadership one.

How centralisation became the default – and why it felt safe

Centralised AI made sense early on.

Large models demand dense compute, specialist hardware, and energy budgets that most firms could not justify on their own. This naturally pushed training and early deployment into global platforms such as Amazon Web Services, Microsoft Azure, and Google Cloud, powered by chips from NVIDIA and models developed by organisations like OpenAI.

For executives, this brought comfort.

One vendor relationship. One contract. One place where risk appeared to live. AI stayed distant, which made it feel manageable.

Distance, however, has side effects.

When distance starts to distort decisions

Centralised AI tends to speak in averages.

It smooths behaviour. It irons out local variation. It favours patterns that hold at scale rather than signals that emerge in specific places, teams, or communities.

For senior leaders, that creates a quiet problem.

Decisions begin to rest on views of the business that look clean but feel slightly off. Regional shifts appear late. Customer sentiment changes register after the impact shows up in revenue. Operational strain hides behind blended dashboards.

The system isn’t wrong. It’s just far away.

Decentralisation starts with a simple idea

Decentralised AI does not mean uncontrolled AI.

It means intelligence operates closer to where decisions are made, near customers, near staff, near machines, near communities.

Training large models may still happen centrally. What is changing is inference, the moment when AI produces guidance, recommendations, or automated action.

When that moment moves closer to the point of use, several things shift at once.

Latency drops. Context sharpens. Data moves less. Local constraints become visible rather than hidden.

Why executives see clearer signals

Senior leaders rarely struggle with data volume. They struggle with signal quality.

Decentralised AI reflects how the business behaves locally, not how it averages globally. It shortens feedback loops and keeps context intact.

Executives don’t need more information. They need fewer blind spots.

The human side most strategies miss

AI is often discussed as if it serves systems first and people second.

Customers, employees, patients, and citizens experience AI as behaviour, not architecture.

When intelligence operates closer to them, it absorbs nuance without effort. Language feels natural. Timing makes sense. Recommendations align with lived experience.

Trust behaves differently when intelligence is nearby

People trust what they can question and what feels grounded in their environment.

Decentralised AI allows decisions to be explained locally and responsibility to sit where impact occurs.

Energy, infrastructure, and quiet constraints

Inference consumes electricity. Data movement stresses networks.

Decentralised AI spreads load and limits exposure to single points of failure.

Accountability becomes harder – and better

When AI decisions happen locally, ownership becomes visible.

That pressure is uncomfortable, but it improves decision quality.

A tension worth accepting

Central platforms remain necessary.

Most meaningful decisions will not happen there.

Why many organisations struggle to adapt

This shift is blocked by structure, not talent.

Local discretion challenges central assumptions around budgets, risk, and control.

“Good enough” intelligence changes the equation

Reliable, focused intelligence near the point of use often outperforms distant sophistication.

The questions leaders should already be asking

Where does AI influence decisions today?

How far does data travel before action follows?

Who answers for AI behaviour locally?

This shift will not arrive with fanfare

Change will appear in fragments.

AI that serves customers and society at large cannot remain distant from people.

The organisations that accept this will see clearer signals, make steadier decisions, and carry responsibility with more confidence.

Newsletter

About

Imran Zaman – AI Programme & Transformation Leader. I help C-level to build programmes that land, rescue the ones that don’t and assure the ones that can’t afford to fail. Learn more. Get in touch.

Connect on LinkedIn

Go toTop