AI agents: orchestration platforms
05
Costs and pricing
7 min read · Chapter 5 of 10
How the money moves
Nine meters run on one agent: input, cached and output tokens (reasoning bills as output), tool fees, runtime or sandbox hours, memory, retrieval, tracing and evals, and the people who take escalations. The platform's fee sits on top.
Top
- Models (October 2026)
- Anthropic Fable 5.1, OpenAI gpt-6-astra
- Input, $ per million tokens
- About $10
- Cache read
- $0.25 to $1
- Output
- About $50
Mid
- Models (October 2026)
- Anthropic Sonnet 5.5, OpenAI gpt-6.1-sol, Google Gemini 3.1 Pro Preview
- Input, $ per million tokens
- About $2
- Cache read
- $0.10 to $0.20
- Output
- $10 to $12
Small
- Models (October 2026)
- Anthropic Haiku 4.5, Google Gemini 3.8 Flash and 3.5 Flash-Lite
- Input, $ per million tokens
- $0.30 to $1
- Cache read
- A few cents to $0.10
- Output
- $2.50 to $5
Smallest
- Models (October 2026)
- OpenAI gpt-6-luna
- Input, $ per million tokens
- About $0.10
- Cache read
- About a cent
- Output
- About $0.50
Rough list prices from the three labs' pricing pages in October 2026; they change often, so treat them as orders of magnitude. Google's Pro Preview costs more above 200,000 input tokens, and Gemini 3.8 Flash doubles on January 1, 2027. All three take 50% off for batch. Anthropic and OpenAI add about 10% for US-only or regional processing on newer models. Cache writes cost extra at Anthropic and OpenAI; Google's implicit cache has no write fee. Every tool definition bills on every call, used or not: in Anthropic's own measurement, 58 tools from five MCP servers took about 55,000 tokens before the conversation began. Web search costs roughly a cent a call at all three, and Google gives a few thousand free calls a month.
One refund run, eight model calls
My assumptions: an 8,000-token stable prefix (system prompt, 12 tool definitions); the eight calls of the refund run, with a policy search returning 4,000 tokens; 2,800 output tokens in all, reasoning included; a prompt growing from 8,150 to 17,650 tokens, 111,200 input tokens in total; "warm" means other runs already cached the prefix; Google's implicit cache assumed to hit; list prices.
Anthropic Sonnet 5.5 ($2 / $10)
- No caching
- $0.25
- Cached, cold
- $0.09
- Cached, warm
- $0.07
- Warm, 3x output
- $0.13
OpenAI gpt-6.1-sol ($2 / $10)
- No caching
- $0.25
- Cached, cold
- $0.08
- Cached, warm
- $0.06
- Warm, 3x output
- $0.12
Google Gemini 3.1 Pro ($2 / $12)
- No caching
- $0.26
- Cached, cold
- $0.09
- Cached, warm
- $0.07
- Warm, 3x output
- $0.14
Anthropic Haiku 4.5
- No caching
- $0.13
- Cached, cold
- $0.05
- Cached, warm
- $0.04
- Warm, 3x output
- $0.06
Google Gemini 3.8 Flash
- No caching
- $0.09
- Cached, cold
- $0.03
- Cached, warm
- $0.03
- Warm, 3x output
- $0.05
OpenAI gpt-6-luna
- No caching
- About a cent
- Cached, cold
- Under a cent
- Cached, warm
- Under a cent
- Warm, 3x output
- Under a cent
OpenAI gpt-6-astra ($10 / $50)
- No caching
- $1.25
- Cached, cold
- $0.45
- Cached, warm
- $0.36
- Warm, 3x output
- $0.64
Caching cuts this run's cost by about 71%. At 100,000 tickets a month, that's about $25,000 uncached against about $7,000 warm on a $2/$10 model, about $400 on the cheapest small model and about $36,000 on a top model. So model choice spreads cost about 100x, caching about 3.5x. Once caching is on, output and cache writes dominate: OpenAI's cheaper reads win at this size, and Google's missing write fee makes up for its higher output price. A runaway loop of 41 extra steps ends at a 69,650-token context and costs almost $4 uncached on any $2/$10 model, about 15 times a normal run. The agent tax: Anthropic prices a single-call support chat at about 3,700 tokens; this run uses about 30 times that.
How companies of different sizes use it
Nobody publishes agent spend by company size, so the spend figures below are my rough estimates from list prices, the refund run above, Ramp's card data and two surveys of large companies. Token spend, not headcount, decides when a company moves up a step. I've kept the usual five headcount steps because they say who owns the agents and how they're bought, but a 30-person company whose product is an agent can outspend a bank's first agent. Anthropic and OpenAI both cap self-serve buying at about $200,000 a month, after which it's a contract; I didn't check where Google, Meta, Mistral or xAI draw that line. The paragraphs describe companies running agents inside the business; where the agent is the product, tokens are a cost of sales and the bill grows with customers.
A startup (under 50 people) runs one or two agents on one lab or one cloud, with an open-source framework and a free tracing tier. The clouds' startup credits, worth up to six figures, now buy frontier models too: AWS Activate covers Anthropic's, Meta's and Mistral's models in Bedrock, Google's AI program covers Gemini, and Microsoft's reportedly cover the models in Foundry. The labs' own programs are smaller (Anthropic gives a one-time API credit and team seats; OpenAI's credits come mostly through investors and partners), so the cheapest tokens come through a cloud. The founders or the CTO own it. My rough estimate runs from nothing to about $150,000 a year, mostly in credits, with the top end a company whose product is the agent. It moves up when the credits expire, when it hits a lab's monthly spend cap and requests fail until the next month, or when a big customer's security review asks about zero data retention and where data is processed.
A scale-up (roughly 50 to 500 people) sells agents to paying customers, or buys a support or IT agent from a system of record it already uses. Those building their own sit on a lab's top self-serve tier or a cloud's catalogue, add a fallback model, move long runs onto a workflow engine such as Temporal, and start paying for tracing and evals (Braintrust, Arize, LangSmith). The head of engineering or an early AI lead owns it, and finance starts asking about the token line. My rough estimate is $70,000 to $1 million a year. It usually moves on after a jolt: hitting the self-serve ceiling or rate limits at peak, a forced model retirement that breaks production and forces a real regression suite, an outage or tighter limits at a lab (OpenAI and Anthropic both rationed capacity in spring 2026), or a bank, insurer or EU customer asking about logs, residency and human oversight.
A mid-market company (roughly 500 to 2,000 people) runs several agents across functions, some bought and some built. It builds on the cloud it already uses (Bedrock and AgentCore, Microsoft Foundry and Copilot Studio, or Vertex AI and Gemini Enterprise), buys agents from its systems of record, and traces runs in the observability tool it already has, such as Datadog. Committed-spend deals with a cloud usually begin here, and a lab's model bought through the cloud counts toward the commitment and skips a new vendor approval, so buying tilts toward the cloud's catalogue. A platform or AI team under the CTO or CIO builds, business units buy, and the CISO and legal review. My rough estimate is $300,000 to $2 million a year in technology. The people cost more: in my rough model of one busy support agent, the staff who take escalations cost far more than the technology, so the share of conversations the agent finishes alone matters more than the token price. It moves on when nobody can say how many agents exist or what they can touch, when auditors or the board ask, or after an incident such as a wrong refund or a leaked document.
An enterprise (roughly 2,000 to 10,000 people) runs dozens of agents across several clouds and labs, with a central platform team running a gateway, an agent registry, evals and policy. It buys the clouds' agent services under its commitment, agents from its systems of record (Agentforce, ServiceNow, Workday, SAP Joule), Microsoft's agent tools in its Microsoft 365 deal and security modules from Palo Alto Networks or CrowdStrike, plus an independent platform where it wants one control layer across labs. The CIO or CTO owns it with a central AI team, the CISO and legal review, and procurement negotiates with labs and clouds. My rough estimate is $1 million to $8 million a year on models and agent tooling, plus systems-of-record licences. Above the self-serve ceiling everything is a contract (OpenAI's Scale and Reserved tiers, Anthropic's Custom tier, a cloud's reserved throughput), carrying the terms in Liability allocation. The hard question becomes how many agents there are, what they can touch and who approved them. Board attention, multi-year capacity deals and regulators in several countries push it further.
A Fortune 500 company (revenue above about $7.5 billion) runs everything at once: hundreds to thousands of agents, every big cloud, several systems of record with their own agents, internal platforms and direct lab contracts. OpenAI named State Farm, Uber and Intuit among early customers of Frontier, its enterprise agent platform, and Google says most of the Fortune 100 use Gemini Enterprise; I found no comparable list for Anthropic, Meta, Mistral or xAI. The CEO and board own the outcome, often with a chief AI officer, while procurement and FinOps own the cloud commitments and multi-year capacity reservations. My rough estimate is $10 million to $50 million or more a year on models and agent platforms, before systems-of-record licences. There's no next size up; the pressure comes from regulators, the board and the market for computing capacity.
What changes as a company grows (spend is my rough estimate):
Startup
- Typical setup
- One lab or cloud on credits, free framework and tracing tiers
- Owner
- Founders or the CTO
- Rough spend a year
- Up to $150,000, mostly credits
Scale-up
- Typical setup
- Top self-serve tier, a fallback model, a workflow engine, paid tracing
- Owner
- Head of engineering or an early AI lead
- Rough spend a year
- $70,000-1 million
Mid-market
- Typical setup
- The committed cloud's agent services, agents from systems of record
- Owner
- Platform or AI team; CISO and legal review
- Rough spend a year
- $300,000-2 million
Enterprise
- Typical setup
- Several clouds and labs, a central gateway and registry, security modules
- Owner
- CIO or CTO, AI platform team, procurement
- Rough spend a year
- $1-8 million
Fortune 500
- Typical setup
- Direct lab deals plus clouds, capacity reservations, internal platforms
- Owner
- CEO and board, often a chief AI officer
- Rough spend a year
- $10-50 million or more
Buying a finished agent moves the risk. By my rough estimate, vendors charging per conversation, action or resolution price at 2 to 10 times their technology cost, because they sell the result, so I'd read the outcome definition first. Intercom counts a resolution when the customer confirms, doesn't ask for more help, or a hand-off completes; if the customer writes back three days later because the fix failed, that wording decides whether you paid. A model change that inflates tokens hits the vendor's margin under outcome pricing and the customer's bill under consumption pricing.