Beyond the Productivity Promise: Measuring the Economic Value of Enterprise AI

The measurement trap

Ask most organizations how their AI investments are performing and the answer arrives as a number of hours. A coding assistant saves developers time. A document tool cuts review time. An internal assistant reduces the minutes spent searching for policies. These figures are popular because they are easy to estimate, easy to aggregate and easy to put on a slide.

They are also a poor guide to value. Hours saved measure activity, not outcomes. They say nothing about whether the saved time was redeployed to anything useful, whether the quality of work improved or deteriorated, or whether the organization is better positioned than it was before. An initiative that saves ten thousand hours and changes nothing else has produced a statistic, not a return.

The gap matters because AI budgets are now large enough to require real justification, and because the most significant benefits of AI rarely show up as time saved. This brief makes two arguments. First, time savings systematically understate some forms of value and overstate others. Second, organizations need a broader framework that connects AI to the outcomes that actually move enterprise performance.

Why time saved is a weak proxy

The redeployment problem

Time saved has economic value only if it is used for something more valuable. In practice, freed time is often absorbed by meetings, by existing backlogs or by small increases in slack that never appear in financial results. Unless an organization deliberately decides what saved capacity is for, whether that is serving more customers, handling more complex cases or reducing headcount growth, the hours on the slide may never reach the income statement.

Quality can move in either direction

The best experimental evidence shows that generative AI can raise both speed and quality, but not uniformly. In a study of customer support agents, access to an AI assistant raised productivity on average, with the largest gains among less experienced workers. In a controlled writing experiment, professionals completed tasks faster and produced higher-rated work. In a field experiment with management consultants, AI improved speed and quality substantially on tasks within its capabilities, but consultants using AI were less likely to reach correct answers on a task that fell outside what the model could do well. The researchers described this as a "jagged frontier."

The implication is that a time-saving metric can hide quality erosion. If people move faster on tasks where AI is unreliable, the organization records an efficiency gain while accumulating errors that surface later as rework, customer complaints or risk events.

Value often arrives later, and through intangibles

Economists have long noted that transformative technologies can take years to appear in productivity statistics. Robert Solow observed in 1987 that computers were visible everywhere except in the productivity data. More recent research describes a "productivity J-curve": when firms adopt a general-purpose technology, they must invest heavily in complementary intangibles such as new processes, skills, data and organizational design. Those investments depress measured productivity at first, and the returns arrive later, once the complements are in place.

Enterprise AI fits this pattern. The organizations that will gain most are redesigning workflows, building data foundations and developing new capabilities. Those investments look like costs in year one. A framework built only on immediate time savings will undervalue exactly the initiatives most likely to matter.

Macro caution is a reason for micro discipline

Some economists estimate that AI's aggregate effect on productivity over the next decade may be modest, because the share of tasks that can be profitably automated or augmented is smaller than headlines suggest. Whether or not those estimates prove right, they are a useful discipline for individual firms. AI will not create value by default. It will create value where organizations choose the right problems and measure the right outcomes.

A five-dimension value framework

A more useful approach starts from the question every investment committee eventually asks: how does this make the enterprise more valuable? Efficiency is part of the answer, but it is the baseline, not the destination. The framework below treats efficiency as table stakes and adds five dimensions where AI's larger effects are likely to appear.

Dimension	What it captures	Example measures	Typical horizon
Efficiency (baseline)	Cost and time to complete existing work	Cost per transaction, cycle time, capacity redeployed to defined priorities	Months
Revenue creation	New or expanded sources of income	Conversion rates, retention, new products launched, revenue from AI-enabled offerings	Quarters to years
Decision quality	Better choices, made faster, with clearer evidence	Forecast accuracy, decision cycle time, share of decisions reversed, error and rework rates	Quarters
Organizational capability	What the organization can now do that it could not before	Time to deploy new use cases, reusable data and model assets, skills and adoption depth	Years
Risk and resilience	Lower exposure to losses, failures and compliance breaches	Detection rates, false positive rates, incident severity, audit findings, time to remediate	Quarters to years
Competitive position	Durable advantage relative to peers	Share of wallet, pricing power, customer experience scores relative to competitors	Years

Revenue creation

The largest AI opportunities are often on the revenue side: personalizing offers, improving conversion, reducing churn, accelerating product development or creating entirely new services. These effects are harder to attribute than cost savings, but they are frequently larger. Measuring them requires connecting AI deployments to commercial outcomes, ideally through controlled comparisons between customers or regions with and without the capability.

Decision quality

Much of what enterprises do is decide: which customers to approve, which risks to escalate, where to invest, what to prioritize. AI that improves the quality of those decisions can be worth far more than AI that speeds up routine work, yet it rarely appears in time-saving calculations. Useful measures include forecast accuracy against outcomes, the share of decisions later reversed, the speed at which decision-makers reach a well-evidenced view and the consistency of decisions across teams.

Organizational capability

Some AI investments are best understood as building capability rather than delivering immediate returns. A well-governed data platform, a reusable retrieval layer for internal knowledge or a trained workforce lowers the cost and time of every future use case. These are the intangible complements that drive the J-curve. They should be measured explicitly, for example as the time and cost required to launch the next use case, so that they are not dismissed as overhead.

Risk and resilience

In regulated industries, AI's contribution to risk management can be among its most valuable effects: earlier detection of fraud and financial crime, more complete monitoring, faster identification of control weaknesses and more consistent compliance reviews. The value lies in losses avoided and exposures reduced, which require measures such as detection rates, false positive rates, incident severity and time to remediate. Risk also runs the other way. AI introduces model risk, data risk and new failure modes, and an honest assessment nets these against the benefits.

Competitive position

Ultimately, the question is whether AI makes the organization stronger relative to its competitors. If every bank in a market adopts the same tools, efficiency gains may be competed away to customers. Durable value comes from capabilities that are hard to copy: proprietary data, integrated workflows, distinctive customer experiences and the organizational ability to deploy AI faster and more safely than peers.

Measuring it in practice

A framework is useful only if it changes how investments are evaluated. Four practices make the difference.

Define the counterfactual before deployment. The most common measurement failure is comparing results to a vague memory of how things used to be. Staggered rollouts, matched comparison groups and controlled pilots allow organizations to estimate what would have happened without the AI capability, which is the only honest basis for claiming impact.

Pair leading and lagging indicators. Revenue and competitive position move slowly. Adoption depth, decision cycle time, error rates and user trust move quickly. Tracking both lets leaders see whether an initiative is on a credible path to value long before the final outcomes are visible.

Decide what saved capacity is for. If efficiency is part of the case, specify in advance where freed capacity will go and measure whether it got there. Unassigned capacity rarely becomes value.

Measure quality, not just speed. Every efficiency metric should have a paired quality metric: accuracy, rework, escalations, customer outcomes. This guards against the jagged-frontier problem, where speed improves while reliability quietly declines.

An executive scorecard

For senior leaders, the framework can be condensed into a short set of questions to ask of any significant AI investment:

1. Which enterprise outcome does this move? Revenue, decision quality, capability, risk or competitive position, not just time.
2. What is the counterfactual? How will we know what would have happened without it?
3. Where does saved capacity go? Is it assigned to a defined priority, and is that being tracked?
4. What could get worse? Which quality or risk measures are we watching alongside the efficiency gains?
5. What does this make possible next? Does it build reusable data, tools or skills that lower the cost of the next initiative?
6. Is the advantage durable? Would competitors gain the same benefit simply by buying the same tool?

Common failure modes

• Counting hours as dollars. Multiplying hours saved by average salary produces impressive figures that rarely materialize.
• Measuring the pilot, not the system. Gains observed in a small, motivated pilot team often shrink at scale unless workflows and incentives change too.
• Ignoring adoption. A tool that is available but lightly used delivers little, however capable it is. Depth of use is a leading indicator of value.
• Treating risk as a footnote. In regulated sectors, model errors and control gaps can erase years of efficiency gains.
• Stopping at year one. Capability investments look expensive early. Judging them on first-year savings guarantees under-investment in the foundations that produce later returns.

Conclusion

Time saved is a convenient metric for an inconvenient question. It tells leaders that AI is being used, not that it is creating value. The organizations that will get the most from AI are those that measure what matters: revenue created, decisions improved, capabilities built, risks reduced and advantages secured.

That requires more discipline than reporting hours. It means defining counterfactuals, pairing speed with quality, assigning freed capacity deliberately and valuing the intangible foundations that make future gains possible. It also means accepting that the most important returns may take longer to appear. The reward for that discipline is a clearer view of which AI investments deserve to scale, and which are producing statistics rather than value.

References

1. Acemoglu, D. (2024). The simple macroeconomics of AI (NBER Working Paper No. 32487). National Bureau of Economic Research.
2. Agrawal, A., Gans, J., & Goldfarb, A. (2018). Prediction machines: The simple economics of artificial intelligence. Harvard Business Review Press.
3. Brynjolfsson, E., Li, D., & Raymond, L. R. (2023). Generative AI at work (NBER Working Paper No. 31161). National Bureau of Economic Research.
4. Brynjolfsson, E., Rock, D., & Syverson, C. (2021). The productivity J-curve: How intangibles complement general purpose technologies. American Economic Journal: Macroeconomics, 13(1), 333–372.
5. Dell'Acqua, F., McFowland, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023). Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality (Harvard Business School Working Paper No. 24-013).
6. Kaplan, R. S., & Norton, D. P. (1992). The balanced scorecard: Measures that drive performance. Harvard Business Review, 70(1), 71–79.
7. Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192.
8. Solow, R. M. (1987, July 12). We'd better watch out. New York Times Book Review, 36.