← back to the archiveCover illustration for “Read the model-share chart's method, not the company's label”
POSTday 85·3w ago·by Andy Padia

Read the model-share chart's method, not the company's label

Ramp’s Fable chart uses token-spend management data. Its 11.4% figure is meaningful within that sample, but neither a market census nor simply a corporate-card statistic.

Ramp's August AI Index reports that Fable 5 accounted for 11.4% of dollars spent on Anthropic models in the sample behind its model-usage chart. The methodology note says that chart uses Ramp's token-spend management product.

That is a material detail in the original report. It is too easy to see Ramp's corporate-card business and assume every number in the report comes from a card panel. The source describes a distinct sample for this chart and says it skews more towards technology businesses than the usual index sample.

My correction is to the shortcut itself: read the method attached to the individual chart before accepting or dismissing its headline.

A report can contain several populations

A business-adoption measure and a model-level spending measure need not observe the same set of firms or transactions. Even within one publication, the population, denominator and collection method can change from section to section.

The Fable figure is a share of Anthropic-model spending in the specified sample. It does not mean that 11.4% of all businesses use the model. It also does not establish the share of every enterprise contract worldwide.

But the opposite claim needs evidence too. We should not declare that all committed-use contracts are excluded merely because the publisher also issues corporate cards. The methodology must establish the relevant inclusion and exclusion rules; the company's business category cannot stand in for them.

As an illustration, I would review a hypothetical procurement presentation with two charts from the same vendor. One measures how many customers paid an AI provider. Another measures how those participating customers divided token usage across models. I would ask the presenter to write the denominator beneath each before connecting the trends.

A provider can gain business customers while a particular model remains a small part of usage. Those observations can coexist. They do not automatically establish that existing customers downgraded, because a different customer mix could also change the aggregate.

A small share can still describe a useful role

The report also gives Fable's token share as 6%. Spending share and token share therefore describe different aspects of the same sampled use. Neither reveals whether the tasks receiving the premium model justified their cost.

For an operating team, I would follow the aggregate with a workload question. Which requests went to the expensive model, what alternative was available and what happened to accepted outcomes? A specialist can be valuable while handling a minority of traffic.

That is an evaluation to perform within the application, rather than a conclusion supplied by the market chart. I would keep the routing policy and failure consequences beside the cost record so the team could explain why the model was used.

The same standard applies to a bearish interpretation. Low uptake in a defined sample is a real observation worth understanding. Calling it a universal limit on willingness to pay requires more evidence about coverage, customer mix and the decisions behind the spend.

Before forwarding another AI-adoption chart, preserve the method note with it. If the note is missing, ask for it. If it changes between charts, make the change visible. This is a small amount of work compared with reversing a procurement decision built on the wrong population.

A model-share statistic belongs to its chart's actual sample, not to assumptions about the company that published it.

#ai-economics#measurement#models
← older drop
Razorpay's Vulcan makes the prediction target the architecture question
newer drop →
An automation can retire before its decision record is needed

related drops

explore all 243 drops →
← back to the archiveday 106