Baseten models
Route requests to Baseten through Vercel AI Gateway. Compare the models Baseten serves, with unified billing and automatic failover across providers.
| Model | Context | Latency | Throughput | Input | Output | Cache | Web Search | Capabilities | Providers | ZDR | No Training | Regional Inference | Free Tier | Released |
|---|
| 1M | 0.6s | 156tps | $0.09/M | $0.18/M | Read:$0.0/M Write:— | — | +3 | 07/31/2026 | |||||||
| 1M | 0.2s | 311tps | $0.50/M | $1.20/M | Read:$0.1/M Write:— | — | +2 | 07/30/2026 | |||||||
| 1M | 0.7s | 119tps | $2.90/MFast $4.50/M | $14/MFast $22.50/M | Read:$0.29/M Write:— | — | +2 | +3 | US | 07/16/2026 | |||||
| 256K | 0.2s | 236tps | $1/M | $4.05/M | Read:$0.17/M Write:— | — | +1 | US | 07/15/2026 | ||||||
| 1M | 0.7s | 616tps | $2.10/M | $6.60/M | Read:$0.21/M Write:— | — | US | 06/23/2026 | |||||||
| 1M | 0.3s | 511tps | $0.80/MFast $2.10/M | $2.52/MFast $6.60/M | Read:$0.14/M Write:— | — | +12 | US | 06/16/2026 | ||||||
| 262K | 0.3s | 301tps | $0.74/MFast $1.90/M | $3.50/MFast $8/M | Read:$0.15/M Write:— | — | +2 | +1 | US | 06/12/2026 | |||||
| 1M | 0.2s | 172tps | $0.37/M | $1.08/M | Read:$0.12/M Write:— | — | +1 | US | 06/04/2026 | ||||||
| 1M | 1.6s | 164tps | $0.09/M | $0.18/M | Read:$0.0/M Write:— | — | +5 | 04/23/2026 | |||||||
| 1M | 0.4s | 158tps | $1.74/M$0.43/M | $3.48/M$0.87/M | Read:$0.0/M Write:— | — | +5 | US | 04/23/2026 | ||||||
| 262K | 0.3s | 552tps | $0.95/M | $4/M | Read:$0.16/M Write:— | — | +1 | +2 | US | 04/20/2026 | |||||
| 205K | 0.1s | 419tps | $2.25/M | $2.75/M | Read:$2.25/M Write:— | — | +3 | US | 12/22/2025 | ||||||
| 131K | 0.2s | 444tps | $0.35/M | $0.75/M | Read:$0.25/M Write:— | — | +5 | US | 08/05/2025 |