AI Services Companies

AI Inference Cost Statistics 2026

Published November 11, 2026

Our analysts compiled 15 historical price points from Epoch AI's inference price data covering November 2021 to February 2025, the November 11, 2026 list prices of 21 models from OpenAI, Anthropic, and Google, compute spending estimates from the Stanford AI Index 2026, and token volumes reported by Google, to show what AI inference costs as of Q4 2026 and how quickly that cost is changing.

Key Findings

  • The lowest price for a model scoring at GPT-3.5's level on the MMLU knowledge test fell from $20.00 per million tokens in November 2022 to $0.07 in October 2024, making it 286 times cheaper in about 22 months.2,3
  • GPT-4-level capability (MMLU 86 or higher) fell from $37.50 per million tokens in March 2023 to $0.18 in February 2025, a 208-fold drop.2
  • In November 2026, OpenAI's newest top-tier model, GPT-6 Astra, costs $50.00 per million output tokens, 100 times the $0.50 charged for the small GPT-6 Luna and Claude Haiku 5.5 models.5,6
  • OpenAI's compute spending on inference rose from $1.80 billion in 2024 to $8.00 billion in 2025, according to Epoch AI estimates published in the Stanford AI Index 2026.8
  • Gartner forecasts that inference on a 1-trillion-parameter model will cost AI providers over 90% less in 2030 than in 2025, while agentic models use 5 to 30 times more tokens per task than a standard chatbot.11

Inference is the work an AI model does each time it answers a request, as opposed to the one-time work of training it. Companies that use models from OpenAI, Anthropic, or Google through an API pay for inference by the token, a unit of text of roughly four characters, with separate rates for the text sent in (input) and the text the model writes back (output).11 Two claims about these prices circulate at once. One is that the cost of AI has collapsed, with the same capability now costing a tiny fraction of what it did in 2022. The other is that AI bills keep rising, because new models cost more and new uses consume far more tokens. We gathered the numbers behind both claims so they can be compared in one place, with the date and source of each.

Our analysts took Epoch AI's record of the cheapest model reaching set scores on six benchmarks, which tracks blended list prices per million tokens from November 2021 to February 2025. We added the standard, batch, cached, and fast-mode list prices published on the OpenAI, Anthropic, and Google developer pricing pages, checked on November 11, 2026. Spending figures come from Epoch AI estimates of OpenAI and Anthropic compute costs in the Stanford AI Index 2026, token volumes come from Google's May 2026 and October 2026 remarks, and forecasts come from Gartner's March 2026 analysis. All prices are in US dollars.

In the following sections, we compare how the price of fixed capability has fallen, how the rate of decline varies by task, what models cost per token in November 2026, how top-tier prices have moved between model generations, how pricing options change the cost of the same model, and how inference spending and token demand have grown.

The Price of GPT-3.5-Level AI Fell 286-Fold in Under Two Years

The cleanest way to see whether AI is getting cheaper is to hold capability steady and ask what the cheapest qualifying model costs over time. Epoch AI tracks exactly that, so we pulled its price history for models that match GPT-3.5 and GPT-4 on the MMLU general knowledge test.

Lowest Price per Million Tokens at Fixed Capability, 2022 to 2025
Capability levelDateCheapest qualifying modelPrice per 1M tokens
GPT-3.5 level (MMLU 64.8+)Nov 30, 2022GPT-3.5$20.00
GPT-3.5 level (MMLU 64.8+)Mar 6, 2023GPT-3.5 Turbo$2.00
GPT-3.5 level (MMLU 64.8+)Nov 6, 2023GPT-3.5 Turbo (Nov 2023)$0.75
GPT-3.5 level (MMLU 64.8+)Mar 4, 2024Claude 3 Haiku$0.50
GPT-3.5 level (MMLU 64.8+)May 10, 2024Gemini 1.5 Flash (May 2024)$0.13
GPT-3.5 level (MMLU 64.8+)Jul 23, 2024Llama 3.1 Instruct 8B$0.10
GPT-3.5 level (MMLU 64.8+)Oct 3, 2024Gemini 1.5 Flash-8B$0.07
GPT-4 level (MMLU 86+)Mar 14, 2023GPT-4 (Mar 2023)$37.50
GPT-4 level (MMLU 86+)Nov 6, 2023GPT-4 Turbo$15.00
GPT-4 level (MMLU 86+)May 13, 2024GPT-4o (May 2024)$7.50
GPT-4 level (MMLU 86+)May 23, 2024Gemini 1.5 Pro (May 2024)$2.19
GPT-4 level (MMLU 86+)Feb 5, 2025Gemini 2.0 Flash$0.18

Source: AI Services Companies analysis of Epoch AI, LLM inference prices have fallen rapidly but unequally across tasks, lowest inference prices at fixed performance, conducted November 2026. Data: price-per-million-tokens-fixed-capability-2022-2025.csv

Line chart on a log scale of the lowest price per million tokens for fixed AI capability: GPT-3.5-level models fell from $20.00 in November 2022 to $0.07 in October 2024, and GPT-4-level models fell from $37.50 in March 2023 to $0.18 in February 2025

Source: AI Services Companies analysis of Epoch AI inference price data, conducted November 2026.

Key Findings

  • The biggest single step for GPT-3.5-level capability came in March 2023, when OpenAI's GPT-3.5 Turbo cut the price from $20.00 to $2.00 per million tokens. Later steps came from OpenAI's November 2023 GPT-3.5 Turbo update and then from smaller models by Anthropic, Google, and Meta that reached the same score at lower prices.2
  • The Stanford AI Index 2025 reported the same drop as "over 280-fold" between November 2022 and October 2024, and Andreessen Horowitz measured a decline of about 10 times per year for models of equal MMLU performance.3,4
  • These are list prices for the cheapest model that clears a test score, so a buyer who stays on the same model does not see this drop. The savings go to teams that switch to newer, smaller models once those models are good enough for the task.2

Price Declines Ranged From 33-Fold to 857-Fold Depending on the Capability Level

A single headline rate hides a lot of spread. Epoch AI ran the same fixed-capability test on coding, math, science, and chatbot benchmarks, and we compared the first and lowest price it recorded at each level to see where costs fell fastest.

Price Declines at Fixed Capability by Benchmark
Capability levelBenchmarkFirst price (model, date, per 1M tokens)Lowest price (model, date, per 1M tokens)MonthsTimes cheaper
GPT-3 levelMMLUGPT-3, Nov 20, 2021, $60.00Gemini 1.5 Flash-8B, Oct 3, 2024, $0.0734857x
GPT-3.5 levelMMLUGPT-3.5, Nov 30, 2022, $20.00Gemini 1.5 Flash-8B, Oct 3, 2024, $0.0722286x
GPT-4 levelMMLUGPT-4 (Mar 2023), Mar 14, 2023, $37.50Gemini 2.0 Flash, Feb 5, 2025, $0.1823208x
GPT-4 levelHumanEval (coding)GPT-4 (Mar 2023), Mar 14, 2023, $37.50Llama 3.1 Instruct 8B, Jul 23, 2024, $0.1016375x
GPT-4 levelGPQA Diamond (PhD-level science)GPT-4 (Mar 2023), Mar 14, 2023, $37.50Phi 4, Dec 13, 2024, $0.1221312x
GPT-4 Turbo levelMATH-500 (math)GPT-4 Turbo, Nov 6, 2023, $15.00Phi 4, Dec 13, 2024, $0.1213125x
GPT-4o levelGPQA Diamond (PhD-level science)GPT-4o (May 2024), May 13, 2024, $7.50Phi 4, Dec 13, 2024, $0.12762x
GPT-4o levelChatbot Arena ratingGPT-4o (May 2024), May 13, 2024, $7.50Gemini 2.0 Flash, Feb 5, 2025, $0.18942x
Claude 3.5 Sonnet levelGPQA Diamond (PhD-level science)Claude 3.5 Sonnet (Jun 2024), Jun 20, 2024, $6.00Gemini 2.0 Flash, Feb 5, 2025, $0.18833x

Source: AI Services Companies analysis of Epoch AI inference price data, conducted November 2026. Data: price-decline-by-capability-level.csv

Bar chart of how many times cheaper fixed AI capability became: GPT-3 level on MMLU 857x, GPT-4 level on HumanEval 375x, GPT-4 level on GPQA Diamond 312x, GPT-3.5 level on MMLU 286x, GPT-4 level on MMLU 208x, GPT-4 Turbo level on MATH-500 125x, GPT-4o level on GPQA Diamond 62x, GPT-4o level on Chatbot Arena 42x, and Claude 3.5 Sonnet level on GPQA Diamond 33x

Source: AI Services Companies analysis of Epoch AI inference price data, conducted November 2026.

Key Findings

  • Epoch AI's own trend fits put the rate of decline between 9 times and 900 times per year depending on the benchmark and score, and it found that the price of GPT-4's performance on PhD-level science questions fell by 40 times per year.2
  • The largest drops are at the oldest and lowest capability levels, which have had the longest time to fall. GPT-3-level capability went from $60.00 per million tokens in November 2021 to $0.07 in October 2024.2
  • Epoch AI notes that the fastest declines happened in the most recent year of its data, so it is less clear that they will continue. Anyone projecting future prices from these rates should use the slower, longer-run figures as the base case.2

Top-Tier Models Cost 100 Times More per Output Token Than Small Models in November 2026

Historical trend lines matter less to a budget than what a model costs today. We took the standard published rates for the top, middle, and small models in the newest model families at OpenAI, Anthropic, and Google as listed on November 11, 2026.

API List Prices per Million Tokens by Model, November 2026
VendorModelTierInputOutputNote
OpenAIGPT-6 AstraTop tier$10.00$50.00short context
OpenAIGPT-6.1 SolMid tier$2.00$10.00short context
OpenAIGPT-6.1 TerraMid tier$1.00$5.00short context
OpenAIGPT-6 LunaSmall$0.10$0.50short context
AnthropicClaude Fable 5.2Top tier$8.00$40.00
AnthropicClaude Opus 5.5Mid tier$4.00$20.00
AnthropicClaude Sonnet 5.5Mid tier$2.00$10.00
AnthropicClaude Haiku 5.5Small$0.10$0.50prompts up to 100,000 tokens
GoogleGemini 4 CarbonTop tier$2.00$10.00$4.00 / $20.00 from Dec 1, 2026
GoogleGemini 3.8 FlashMid tier$0.75$3.75$1.50 / $7.50 from Jan 1, 2027
GoogleGemini 3.5 Flash-LiteSmall$0.30$2.50

Source: AI Services Companies analysis of OpenAI API pricing, Anthropic Claude API pricing, and Google Gemini Developer API pricing, standard tier, conducted November 2026. Data: ai-model-list-prices-november-2026.csv

Bar chart of output token list prices per million tokens in November 2026: GPT-6 Astra $50.00, GPT-6.1 Sol $10.00, GPT-6.1 Terra $5.00, GPT-6 Luna $0.50, Claude Fable 5.2 $40.00, Claude Opus 5.5 $20.00, Claude Sonnet 5.5 $10.00, Claude Haiku 5.5 $0.50, Gemini 4 Carbon $10.00, Gemini 3.8 Flash $3.75, and Gemini 3.5 Flash-Lite $2.50

Source: AI Services Companies analysis of OpenAI, Anthropic, and Google pricing pages, conducted November 2026.

Key Findings

  • Output tokens cost five times as much as input tokens on every OpenAI and Anthropic model in the table, so tasks that make a model write long answers or reasoning steps cost far more than tasks that mostly read. Google bills the model's thinking tokens at the output rate on Gemini 4 Carbon.5,6,7
  • Google lists promotional prices that end soon. Gemini 4 Carbon moves from $2.00 / $10.00 to $4.00 / $20.00 per million tokens on December 1, 2026, and Gemini 3.8 Flash doubles to $1.50 / $7.50 on January 1, 2027.7
  • OpenAI's and Anthropic's lists span 80 to 100 times from the smallest to the largest model in the table, while three models from different vendors cost the same $10.00 per million output tokens (GPT-6.1 Sol, Claude Sonnet 5.5, and Gemini 4 Carbon before its increase). The choice of model size moves a bill far more than the choice of vendor.5,6,7

Newest Top-Tier List Prices Rose at OpenAI and Google and Fell at Anthropic

The fixed-capability figures above follow the cheapest model that is good enough. Many buyers instead move to each vendor's newest and strongest model, so we lined up the successive top models that remain on each vendor's price list, from oldest to newest.

Standard Prices of Successive Top Models, Oldest to Newest
VendorModelInput per 1M tokensOutput per 1M tokensNote
OpenAIGPT-4o$2.50$10.00
OpenAIGPT-5$1.25$10.00
OpenAIGPT-5.4$2.50$15.00under 272K tokens
OpenAIGPT-5.5$5.00$30.00under 272K tokens
OpenAIGPT-6 Astra$10.00$50.00short context
AnthropicClaude Opus 4$15.00$75.00retired June 15, 2026; price still listed
AnthropicClaude Opus 4.5$5.00$25.00
AnthropicClaude Opus 5$5.00$25.00
AnthropicClaude Opus 5.5$4.00$20.00
AnthropicClaude Fable 5$10.00$50.00
AnthropicClaude Fable 5.2$8.00$40.00
GoogleGemini 2.5 Pro$1.25$10.00prompts up to 200K tokens
GoogleGemini 3.1 Pro Preview$2.00$12.00prompts up to 200K tokens
GoogleGemini 4 Carbon$2.00$10.00$4.00 / $20.00 from Dec 1, 2026

Source: AI Services Companies analysis of OpenAI, Anthropic, and Google pricing pages, conducted November 2026. Data: top-tier-model-prices-by-generation.csv

Slope chart of output prices per million tokens: OpenAI rose from $10.00 for GPT-4o to $50.00 for GPT-6 Astra, Google rose from $10.00 for Gemini 2.5 Pro to $20.00 for Gemini 4 Carbon from December 1, and Anthropic fell from $75.00 for Claude Opus 4 to $40.00 for Claude Fable 5.2

Source: AI Services Companies analysis of OpenAI, Anthropic, and Google pricing pages, conducted November 2026.

Key Findings

  • OpenAI's newest top model, GPT-6 Astra, costs five times as much per output token as GPT-4o ($50.00 vs. $10.00), and each step from GPT-5 onward carried a higher output price.5
  • Anthropic moved the other way within its Opus line, from $75.00 per million output tokens for Claude Opus 4 to $20.00 for Claude Opus 5.5, but added a higher Fable tier at $40.00 to $50.00.6
  • Andreessen Horowitz pointed out in November 2024 that OpenAI's leading model at the time, o1, had the same output price as GPT-3 at launch, $60 per million tokens. The top of the market has kept its price while older capability gets cheaper.4

Processing Options Move the Price of the Same Model From Half to Six Times the Standard Rate

The rate on a price list is only a starting point. Each vendor sells discounts for work that can wait or reuse the same prompt text, and premiums for speed, longer prompts, or keeping data in one region, so we compared those options side by side.

How Pricing Options Change the Cost per Million Tokens, November 2026
OptionWhat it isOpenAIAnthropicGoogle
Batch processingRequests processed asynchronously50% off: GPT-6.1 Sol $1.00 / $5.0050% off: Claude Opus 5.5 $2.00 / $10.0050% off: Gemini 4 Carbon $1.00 / $5.00
Cached inputRepeated prompt text read from cacheGPT-6.1 Sol $0.10 vs. $2.00 input (5%)10% of input on most models; 5% on Opus 5.5 and Sonnet 5.5; 2.5% on Fable 5.1 and 5.2Gemini 4 Carbon $0.10 vs. $2.00 input (5%)
Fast modeFaster output at a premium2x: GPT-6.1 Sol $4.00 / $20.002x: Claude Opus 5.5 $8.00 / $40.00Priority tier offered
UltrafastHighest-speed tier6x: GPT-6.1 Sol $12.00 / $60.00Not offeredNot offered
Long promptsInput above a length thresholdOver 272K tokens: GPT-6.1 Sol $4.00 / $15.00Full 1M context at standard price on Claude 4.6 and later (except Haiku 5.5)Over 200K tokens: Gemini 3.1 Pro Preview $4.00 / $18.00
Data residencyProcessing kept in one region+10% for models released on or after Mar 5, 2026+10% (1.1x) for US-only inference on Claude 4.6 and laterNot covered in this comparison

Source: AI Services Companies analysis of OpenAI, Anthropic, and Google pricing pages, prices shown as input / output per million tokens, conducted November 2026. Data: inference-pricing-options-november-2026.csv

Grouped bar chart of the cost of one million output tokens by processing option: GPT-6.1 Sol costs $5 in batch, $10 standard, $20 in fast mode, and $60 ultrafast; Claude Opus 5.5 costs $10 in batch, $20 standard, and $40 in fast mode, with no ultrafast option

Source: AI Services Companies analysis of OpenAI and Anthropic pricing pages, conducted November 2026.

Key Findings

  • All three vendors charge half price for batch jobs, which return results later in exchange for the discount. On GPT-6.1 Sol, the same million output tokens cost $5.00 in a batch job and $60.00 on the ultrafast tier, a 12-fold spread.5
  • Cached input is the deepest discount. Reading repeated prompt text from cache costs 5% of the input rate on GPT-6.1 Sol and Gemini 4 Carbon and 2.5% on Claude Fable 5.2, which favors applications that send the same long instructions or documents with every request.5,6,7
  • Anthropic notes that its Claude 4.7 and later models use a tokenizer that produces about 30% more tokens for the same text. Comparing per-token prices across model generations can understate the real change in cost per task.6

Inference Spending and Token Volumes Grew Faster Than Prices Fell

Cheaper tokens do not mean smaller bills if usage grows faster. We gathered the few public measures of total inference demand and spending: Google's token counts, Epoch AI's estimates of OpenAI and Anthropic compute costs, and Gartner's forecasts.

Inference Demand and Spending Measures, 2024 to 2026
MeasurePeriodValue
Tokens Google processed per month across its productsMay 20249.7 trillion9
Tokens Google processed per month across its productsMay 2025About 480 trillion9
Tokens Google processed per month across its productsMay 2026Over 3.2 quadrillion9
Tokens processed per minute by Google's model APIsMay 2026About 19 billion9
Tokens processed per minute by Google's first-party model APIsQ3 2026Nearly 32 billion (more than 4x a year earlier)10
Google Cloud customers that each processed over 1 trillion tokens12 months to May 2026Over 3759
OpenAI compute spend on inference2024$1.80 billion of $5.80 billion8
OpenAI compute spend on inference2025$8.00 billion of $16.30 billion8
Anthropic compute spend on inference2025$2.70 billion of $6.80 billion8
Tokens per task for agentic models vs. a standard chatbotGartner, March 20265 to 30 times more11
Forecast cost of inference on a 1-trillion-parameter model, 2030 vs. 2025Gartner, March 2026Over 90% lower11

Source: AI Services Companies analysis of Google I/O 2026 keynote, Alphabet Q3 2026 earnings remarks, Stanford AI Index 2026, Figure 4.2.20, and Gartner, conducted November 2026. Data: inference-demand-and-spending-2024-2026.csv

Stacked bar chart of annual compute spend: OpenAI spent $5.80 billion in 2024 including $1.80 billion on inference and $16.30 billion in 2025 including $8.00 billion on inference; Anthropic spent $2.50 billion in 2024 and $6.80 billion in 2025 including $2.70 billion on inference

Source: AI Services Companies analysis of Epoch AI estimates in the Stanford AI Index 2026, conducted November 2026.

Key Findings

  • OpenAI's inference spending grew about 4.4 times in one year, from $1.80 billion in 2024 to $8.00 billion in 2025, and inference made up 49% of its estimated $16.30 billion compute bill in 2025.8
  • Google processed over 3.2 quadrillion tokens a month across its products in May 2026, about 7 times the roughly 480 trillion a year earlier and over 300 times the 9.7 trillion of May 2024.9
  • Gartner expects token demand to outrun falling unit costs, so that total inference costs rise even as each token gets cheaper. It also expects providers not to pass the full cost savings on to enterprise customers.11

What AI Inference Cost Statistics Mean for Buyers in 2026

For a team building on AI models, the price of a given level of capability has fallen by two orders of magnitude since 2022, and a task that needed a frontier model in 2023 can often run on a small model for cents per million tokens. At the same time, the newest top-tier models from OpenAI and Google cost more per token than the flagships they followed, and agent-style applications use many more tokens per task. Our AI development cost statistics and AI implementation cost by industry cover the build costs that come on top of these usage bills.

Falling unit prices and rising total spending are happening together. Cheap tokens make new uses affordable, those uses consume far more tokens, and the companies selling inference spend more on compute each year to serve them.

So if you are citing an AI inference cost figure, state whether it is a fixed-capability price, a current list price for a specific model, or a total spending figure, since each moves in a different direction.

Data Collection and Methodology

We collected 15 historical price points from Epoch AI's table of the lowest inference prices at fixed performance, published March 12, 2025, which covers models released from November 2021 to February 2025. Epoch AI reports one blended price per million tokens, a 3:1 weighted average of input and output prices taken from the first-party API where one exists and otherwise the median across providers; it excludes reasoning models and records the cheapest model whose score meets or exceeds the stated benchmark threshold at each date. For the decline table, we took the first and the lowest price Epoch AI lists for each threshold; months elapsed are calendar days divided by 30.44 and rounded. Epoch AI's own annual decline rates (9 to 900 times per year, and 40 times per year for GPT-4-level PhD science questions) come from its fitted trends and are quoted as published.

Current prices for 21 models are the standard, batch, cached-input, fast, and long-context rates on the OpenAI, Anthropic, and Google developer pricing pages as displayed on November 11, 2026. OpenAI prices are short-context rates (272K input tokens or fewer) unless noted, Claude Haiku 5.5 prices are for prompts up to 100,000 tokens, and Gemini prices are paid-tier rates for prompts up to 200K tokens where tiered. Promotional prices are shown with their scheduled end dates. Vendor tier labels (top, mid, and small) are our grouping by price within each vendor's newest model family; specialized higher-compute variants such as OpenAI's GPT-5.5 Pro ($30.00 / $180.00) and limited-access models are not included. The "older flagship" comparison uses GPT-4o, Claude Opus 4, and Gemini 2.5 Pro, the oldest general-purpose flagship models whose prices still appear on each vendor's pricing page (Anthropic retired Claude Opus 4 from its API on June 15, 2026, but its price remains on the page).

Compute spending figures are Epoch AI estimates shown in Figure 4.2.20 of the Stanford AI Index Report 2026; Anthropic's 2024 figure is split only into research and development and unattributed spending. Token volumes are as stated by Google's chief executive in May 2026 and October 2026. All money is in US dollars as published. We calculated products, differences, and ratios from the published values.

Sources (11)
  1. AI Services Companies analysis of fixed-capability inference prices, November 2026 API list prices for 21 models, compute spending estimates, and token volume disclosures from 10 published sources, conducted November 2026.
  2. Epoch AI, LLM inference prices have fallen rapidly but unequally across tasks (March 12, 2025)
  3. Stanford HAI, The 2025 AI Index Report, Top Takeaways (April 2025)
  4. Andreessen Horowitz, Welcome to LLMflation: LLM inference cost is going down fast (November 12, 2024)
  5. OpenAI, API Pricing (accessed November 11, 2026)
  6. Anthropic, Claude API Pricing (accessed November 11, 2026)
  7. Google, Gemini Developer API Pricing (accessed November 11, 2026)
  8. Stanford HAI, Artificial Intelligence Index Report 2026, Figure 4.2.20: Annual compute spend of select frontier AI companies (April 2026)
  9. Google, I/O 2026: Welcome to the agentic Gemini era, Sundar Pichai keynote remarks (May 19, 2026)
  10. Google, Q3 2026 earnings call: Remarks from our CEO (October 28, 2026)
  11. Gartner, Gartner Predicts That by 2030, Performing Inference on an LLM With 1 Trillion Parameters Will Cost GenAI Providers Over 90% Less Than in 2025 (March 25, 2026)