AI Is Everywhere. Why Hasn’t the “Agentic Organization” Emerged Yet?

Eighty percent of companies have yet to see AI impact their bottom line. The issue is not just model capabilities, but that enterprises are still jamming agents into legacy processes: workflows, governance, leadership approaches, and talent development must all be rebuilt together.

By Alexis Krivkovich / McKinsey & Company09-17 · 12 min read

AI is everywhere. The agentic organization isn’t—yet

The corporate world is undergoing a massive yet awkwardly unrewarding technological experiment. Nearly every company is launching AI pilots, but over 80 percent of enterprises report that these initiatives have yet to deliver tangible results to the financial bottom line. This disconnect—where AI is being used everywhere, yet financial bottom-line results have yet to materialize—constitutes the single greatest paradox in corporate intelligent transformation today.

Many blame model capabilities or compute costs, but Alexis Krivkovich, a senior partner at McKinsey, points out that the real bottleneck is not the technology, but the organization itself. Companies are accustomed to introducing AI through the legacy logic of software procurement, merely adding scattered point solutions to their existing hierarchical structures. If daily workflows, team collaboration mechanisms, boundaries of authority and oversight, and leadership habits remain anchored in the industrial era, even equipping employees with the most advanced generative AI will only generate more chaotic collaborative friction and ubiquitous content slop. Moving from isolated experiments to genuine enterprise-level returns hinges on reshaping the enterprise into an “agentic organization.”

Why Over 80% of Enterprise AI Investments Have Yet to Impact the Bottom Line: Point Solutions Cannot Save Broken End-to-End Processes

The fundamental reason companies struggle to translate AI pilots into bottom-line gains is that the vast majority of initiatives fall into the trap of “point solutions.” Traditional pilots typically focus on a highly isolated, specific task. While such tools can indeed accelerate localized tasks, enterprise business value is never determined by a single task; rather, it emerges from complete end-to-end processes spanning multiple departments, such as insurance underwriting or the human resources closed loop from recruitment to onboarding.

In traditional enterprises, what genuinely consumes costs and drags down progress is often not just the task itself, but the collaboration and handoffs between nodes. From origination, routing, and compliance review to final delivery, a business process can involve extensive cross-departmental communication and repeated verification. If end-to-end workflows are not redesigned, accelerating a point solution may simply push semi-finished work faster into the next bottleneck. Over 80% of enterprises report that AI investments have yet to translate into bottom-line returns; the question that truly must be answered has shifted from “how to run another pilot” to “how to redesign the entire workflow.”

The core distinction between agentic AI and generative AI point solutions lies in its ability to participate in end-to-end workflows rather than being confined to isolated point tasks. Value at scale emerges only when companies abandon the mindset of merely patching localized tasks and instead reconstruct entire end-to-end processes. Point solutions cannot bridge the fractures in cross-departmental collaboration; the true breakthrough lies in reshaping the entire workflow as an integrated whole, allowing agents to participate in end-to-end process collaboration.

Reshaping End-to-End Processes: Moving from Human in the Loop to Human on the Loop

Reconstructing end-to-end processes is not an abstract slogan; it is design work at the finest level of granularity that requires delving deep into business mechanics. When reshaping processes, business leaders must answer five critical questions one by one: which steps in the process should be executed entirely autonomously by agents; which steps must retain humans in the loop; which steps can allow humans to step back to supervise on the loop; when collaborative teams of multiple specialized agents are required; and how maturely trained agents can be consolidated into reusable assets deployed across scenarios throughout the enterprise.

This also brings a fundamental divergence in ways of working. In the traditional “human-in-the-loop” model, agents merely assist, and once a segment of work is complete, it must be handed off to a human; after the human finishes processing, it is passed back to the machine, keeping humans and machines in a state of frequent, back-and-forth handoffs. The alternative “human-on-the-loop” model operates differently: if a collaborative team of agents can run most, or even all, of the core process end-to-end, humans can step back from daily operational details to focus instead on defining rules, reviewing exceptions, and exercising final judgment.

Interactive Comparison · Workflow Schematic

How AI Enters the Process Dictates Where Humans Spend Their Time

All three modes can coexist. Review all three cards first, then select a mode to observe handoffs, human positioning, and primary risks across the same end-to-end process.

Human initiates task AI completes localized work Human verifies and hands off Next department continues processing
Human role
Execute, verify, and manage handoffs between nodes
Potential value
Accelerated localized tasks
Primary risk
Handoffs remain congested; low-quality output increases review workload

This is a conceptual workflow schematic and does not imply that all companies should immediately leap to “human on the loop.” Both modes of human-machine intervention will coexist long term, depending on process complexity, judgment requirements, and risk.

This model is already taking clear shape in complex professional services scenarios. Take the case processing redesign at the American Arbitration Association (AAA) as an example:

Intelligent redesign of arbitration workflows: Traditional commercial dispute arbitration often involves massive case dockets. In this organization’s exploration, technical teams trained agents on closed historical case files, enabling them to organize timelines, examine factual working papers, review submissions from both parties, and produce summaries of recommended awards.

The role of human arbitrators: This system functions as a decision-support tool embedded within the workflow. Human arbitrators review the overall outcome, asking themselves whether they agree with the decision; the ultimate award judgment and accountability always remain with the human arbitrator.

In the practice of a few early pioneers, models have emerged where 2 to 5 employees oversee 50 to 100 specialized agents, but this is by no means a universal benchmark at this stage. Human in the loop and human on the loop will coexist for the long term, and enterprises must design intervention mechanisms based on process complexity, judgment requirements, and risk levels.

The Complete Upheaval of Daily Work: Time Restructuring, Universal Participation, and Dual Paths for Technical Delivery

When agents integrate into end-to-end workflows, what changes goes far beyond the software being used. How employees allocate their daily time, how managers supervise teams of agents, how teams collaborate to solve problems, and how risk and governance encompass the entire workflow all require redesign. The work of managers will also progressively shift from simply delegating tasks downward to setting objectives, supervising execution, handling exceptions, and bearing final accountability.

This workflow redesign cannot be accomplished by management or technical teams in isolation. Leaders command business goals, resources, and risk boundaries, while frontline employees understand real-world operations, handoff blind spots, and exceptions. People across different levels must collaboratively reflect on how processes can change, bringing strategic judgment and frontline experience into the same design.

In terms of technical organizational models, enterprises currently exhibit two primary archetypes:

SWAT-style Teams: Dedicated strike teams drawn from technical departments to support individual business lines.

Embedded Expertise: Technical capabilities embedded directly within individual business domains.

Leadership Must First Reinvent Itself: Bridging the Trust Gap of Hallucinations and AI Slop, Facing the Reality of Continuous Learning

The ceiling of any organizational transformation ultimately lies in the mindsets and behavioral patterns of top leadership. If leaders demand that the entire organization embrace disruption while their own daily habits remain untouched, transformation is doomed to remain empty talk. Leadership must take a hard look at their calendars and ask themselves a soul-searching question: have they truly reallocated 50% of their time? The purpose of this question is to prompt managers to examine whether they are substantively reallocating their time, rather than to establish a rigid benchmark, let alone superficial experimentation like using AI to polish an email or draft a few query prompts.

The primary friction hindering organization-wide adoption stems not only from fear of job displacement, but also from an existing “trust gap.” People have heard tales of large model hallucinations, and they increasingly encounter low-quality “AI slop” in their daily work. When generated content devoid of substance circulates internally, it saves no time; instead, it burdens colleagues with the added chore of verifying and cleaning up after it.

Managers must take the lead in moving beyond superficial experimentation and examining their own time allocation. While managing risks, they must also help employees recognize the opportunities these new tools can unlock. Driving adoption also requires acknowledging that we remain in a learning phase: early deployments will make mistakes, and sound judgment and risk management cannot be superseded by optimistic narratives; if certain roles undergo profound changes, enterprises must assist employees in learning new tools or pivoting to adjacent positions.

Supervision, Evaluation, and Problem-Solving Grow Increasingly Vital: 75% of Roles Reshaped and the Junior Talent Pipeline Crisis

Generational shifts in productivity tools are triggering an adjustment in the human capability spectrum. AI excels at research, mathematics, and data science, but this does not mean agents have completely taken over these tasks. Human employees still need to understand these domains, yet skills in supervision, evaluation, problem-solving, and operations are growing increasingly vital.

In surveys, nearly half of leaders report a skills gap. Meanwhile, job descriptions will evolve over the next two to three years, and 75% of current roles already require fundamental reshaping. The vast majority of roles will not vanish into thin air, but in day-to-day work, oversight, evaluation, problem-solving, and operational capabilities will grow more critical, rather than evaluation becoming the sole job duty.

However, this capability shift introduces a thorny generational challenge: how do junior employees acquire the experience necessary for growth? Historically, the intuition and judgment of senior professionals were forged through accumulating extensive foundational work early in their careers. In software engineering, for example, if companies eliminate all junior software engineer positions and retain only expensive seniors, where will the next generation of talent come from a decade from now? AI may absorb portions of baseline work, but organizations must still redesign the pathways through which novices receive feedback, develop critical judgment, and progressively take on complex tasks.

Faced with this dilemma, organizational talent development mechanisms must undergo foundational reconstruction:

Training shifts from a periodic sidecar to the core of the employee journey: Traditional corporate training resembled a “sidecar” attached to the organization—run periodically and viewed as a nice-to-have. In the agentic era, however, capability building must be placed at the very center of the employee journey rather than remaining an optional add-on.

Harnessing the advantage of a new generation using tools from day one: The strength of the emerging generation of young employees is that they can leverage these tools from their very first day in the workplace. Business managers must consider how to transform this day-one fluency into a new incubator that accelerates their systems thinking and business judgment.

Establishing change management as an enduring organizational norm: Companies must abandon the outdated view of organizational change as a “periodic campaign” and embrace the dynamic reality of continuous iteration, maintaining order amidst perpetual change without descending into chaos.

Breaking Management Layer Sprawl: Pods, Fluid Talent, and a Culture of Two-Way Door Experiments

Over the past decade, most companies have added at least one management layer between executive leadership and the frontline, with some organizations adding two or three. These surplus layers not only increase overhead, but also involve more people in decision-making, slowing execution. If agents can expand a manager’s effective span of control, companies may be able to delayer, enabling information and decisions to flow faster.

The logic for reshaping organizational structures varies across business domains. In pharmaceutical R&D, large-scale agent clusters may accelerate the pace of innovation while retaining scientists; in back-office functions like HR and finance, the immediate objective of introducing agents is reducing transactional work, freeing human capacity to focus on higher-value activities.

As for the vision of replacing traditional hierarchies with pods, it is too early to determine its ultimate form. Most companies are nowhere near organizing around pods today, and traditional role hierarchies continue to support performance evaluation and management. In the future evolution of organizations, HR functions capable of facilitating fluid talent mobility will likely hold an advantage.

Matching this evolution in organizational structure is an entirely new organizational culture:

Cross-level collaboration and a coaching culture: Companies need to champion organization-wide curiosity and lifelong learning, prioritizing talent capable of breaking down departmental silos, leading cross-functional teams to tackle complex challenges, and acting as coaches who help colleagues overcome fear and embrace new ways of working.

The two-way door experimentation principle: In the face of massive unknowns, organizations must dare to take risks without betting the entire company’s future. Enterprises must design abundant reversible “two-way door” experiments—stepping through the door to explore innovations, while retaining the ability to step back gracefully if things do not work out and pivot swiftly to the next path, resolutely avoiding irreversible “one-way doors” without thorough validation.

Five Pillars Must Stand Together for the Agentic Organization to Truly Function

By now it becomes clear that an agentic organization is not about simply dropping more agents into a legacy enterprise. It requires companies to simultaneously transform their sources of value, workflows, control mechanisms, human roles, and technology foundations. Each of the five pillars answers a distinct question; if any one is missing, end-to-end value will stall in adjacent stages.

Business model answers “where value comes from.” AI-native channels can deliver real-time, hyper-personalized services; AI-first workflows may also drive marginal delivery costs steadily closer to the cost of compute. In this process, licensed proprietary data will become a vital differentiating asset. For instance, customer agents could seamlessly transfer funds across bank accounts to chase higher yields, directly challenging business moats that once relied on friction to retain deposits.

Operating model answers “how value is delivered.” Companies need to redraw end-to-end processes around outcomes, determining which steps to delegate to agents, which nodes to keep humans in the loop, and which workflows to oversee with humans on the loop. Small, outcome-oriented teams can orchestrate fleets of specialized agents, reducing the repetitive handoffs of traditional functions, while humans remain responsible for boundaries, exceptions, and final judgment.

Governance answers “how autonomous execution avoids going off the rails.” Critic agents can challenge outputs, guardrail agents can enforce internal policies, and compliance agents can continuously monitor rules; humans retain ultimate accountability, defining red lines, handling exceptions, and dynamically tuning levels of autonomy according to risk. Here lies an easily overlooked new bottleneck: as agent fleets scale rapidly, limited human oversight and review bandwidth may be exhausted first.

Workforce, people, and culture answers “how humans recreate value.” As execution work recedes, the human focus shifts toward setting objectives, navigating trade-offs, managing exceptions, and driving outcomes. Three archetypes are emerging: “M-shaped” supervisors who orchestrate agents and hybrid teams across domains, “T-shaped” specialists who redraw processes and resolve exceptions, and frontline employees who leverage AI to free up time for human-centric service. Shared context, trust, cohesion, long-term purpose, and continuous learning ensure that decentralized small teams do not operate in silos.

Technology and data answers “what reliably connects all of this.” Enterprises need to connect reusable agents, data products, internal systems, and machinery while safeguarding their proprietary context. Agent architecture, logic, and data should remain as decoupled as possible from underlying vendors to prevent critical capabilities from being locked into any single model or platform.

These five pillars are not a linear checklist to complete from left to right, but an interconnected system: the business model determines what is worth reshaping, the operating model translates value into workflows, governance determines how much autonomy can be granted, talent and culture determine whether people can shoulder new responsibilities, and technology and data connect and institutionalize them. The diagram below introduces no new conclusions; it simply helps you observe why, when one pillar shifts, the others must adjust in tandem.

Systems Relationship Diagram · Conceptual Overview

Click a Pillar to See How It Impacts the Entire System

All five topics were explored in full above. Here they are mapped together to help you see each pillar’s role, where progress stalls if pursued in isolation, and who it must connect with.

All five pillars converge onEnd-to-End Business Value
01
Current Focus

Business Model

What this pillar must achieve
Identify where AI can reshape customer value, revenue models, or marginal delivery costs.
If done in isolation
Commercial ambition exists, but lacks new workflows to reliably deliver value.
How it must connect
Pass value propositions to the operating model to build workflows, supported by reusable capabilities from technology and data.

This is a conceptual relationship map and does not represent a rigid implementation sequence. In practice, all five pillars typically require parallel adjustments and continuous calibration within a specific business domain.

When putting this into practice, organizations can begin with one or two strategically vital “lighthouse business domains”: placing the agentic organization on executive leadership’s regular agenda, establishing a clear vision from the CEO, codifying engineering standards through a Center of Excellence (CoE), and driving organization-wide reskilling. The focus is not on erecting a massive architecture upfront, but on proving out all five pillars together within real business operations, then scaling reusable capabilities across other domains.

Building an agentic organization is not a reckless technological leap. The pace at which agentic organizations take root depends on external compute, regulation, and risk appetite, as well as the pace of foundation model capability gains, the maturity of embodied AI and physical-world interfaces, and broader societal acceptance. It is not an arms race of point solutions, but an organizational reshaping of power, processes, talent, and trust.

Source
AI is everywhere. The agentic organization isn’t—yetAlexis Krivkovich · McKinsey & Company·Read the source
Editorial note
McKinsey podcast transcript and supporting research.
↑ End of article
✓ This article is free to read in full

Members can copy or download the full Markdown, and let their AI subscribe and ask.

Read the original ↗
📮 New explainers, straight to your inbox

Found this useful? Leave your email — every new explainer, the moment it's out. Unsubscribe anytime.