⚠ Disclaimer: This section may contain incomplete, out of date, or inaccurate entries. It is AI-maintained on a best-effort basis. Do not rely on it as a sole source — verify claims independently using the source materials listed in individual entries.
Overview
If inference compute is going to trade in an open, ad-hoc market — buyers and sellers who have never met, matched request-by-request across whichever provider can serve fastest or cheapest — three technical layers have to exist: a way for a buyer to discover who can serve a given request nearby or cheaply, a matchmaking/pricing mechanism that decides who actually gets the job, and a payment/settlement layer that lets machines pay machines per request without a human in the loop. This section tracks the state of each layer as of mid-2026.
None of the three layers has a dominant, standardized answer yet. Two production-scale marketplaces exist — OpenRouter (posted-price aggregation across 60+ inference providers) and Akash Network (on-chain reverse auction) — but neither routes on measured physical latency the way a CDN or a multiplayer game network does. That gap is the section’s organizing question, which is why latency-based matchmaking in multiplayer gaming — a problem the game industry solved decades ago for a similarly real-time, similarly ad-hoc matching problem — is documented here as the closest existing design comparable, alongside the decentralized libp2p/Kademlia DHT discovery stack used by peer-to-peer inference swarms, the emerging IETF AI discovery drafts, and x402, the leading candidate for the machine-payment layer.
This section is the coordination-layer counterpart to Distributed & Decentralized Compute, which covers where distributed inference hardware is physically sited and powered. This section covers how a buyer finds that hardware and pays for the tokens it produces.
Key Themes
- Two working price-discovery models exist in production — posted-price aggregation (OpenRouter) and on-chain reverse auction (Akash) — but “route to the physically nearest/lowest-latency provider” is still mostly borrowed CDN practice (anycast, GeoDNS, client-measured RTT) rather than a purpose-built inference-marketplace protocol
- The multiplayer gaming industry solved a structurally similar problem — real-time, latency-sensitive matching of ad-hoc clients to the best available server — starting with ping-sorted server browsers in 1996 and maturing into relay networks (Valve’s Steam Datagram Relay) that separate generic latency-measurement/relay transport from game-specific matchmaking policy; that split is a direct design analogy for a compute marketplace
- Peer-to-peer inference swarms (Petals/Hivemind and derivatives) use a libp2p + Kademlia DHT stack for node discovery — a mechanism borrowed wholesale from BitTorrent/IPFs-style file sharing, distinct from and not interoperable with either OpenRouter’s or Akash’s coordination models
- Standards work is nascent: IETF has multiple individual (non-working-group) drafts proposing AI/agent discovery mechanisms as of early-to-mid 2026, none adopted
- Machine-to-machine micropayment rails (x402, built on the revived HTTP 402 status code) are the leading candidate for a settlement layer that lets an AI agent pay per inference call without an account or human approval step — live in production since mid-2025 with meaningful but still small transaction volume as of early 2026
- Unsolved marketplace problem common to every posted-price aggregator: quality/fraud verification (a provider silently serving a more heavily quantized model than advertised) has no standard countermeasure yet
Companies
Startups & Development Partners
| Company | HQ | Stage | Mission |
|---|---|---|---|
| OpenRouter | New York, US | Series B (~$1.3B valuation, May 2026) | Posted-price, multi-provider LLM inference routing gateway/marketplace — 400+ models, 60+ providers. |
| Akash Network | Distributed/DAO (Overclock Labs, San Francisco) | Live mainnet, token-governed | On-chain reverse-auction marketplace for GPU/CPU compute; see full entry in Distributed & Decentralized Compute. |
Public Companies
| Ticker | Company | Mission |
|---|---|---|
| COIN | Coinbase | Developer of x402, the leading HTTP-402-based machine-payment protocol used for per-request AI agent payments. |
Incumbents
| Company | Relevance |
|---|---|
| Valve Corporation | Operates Steam Datagram Relay, the most mature production example of latency-measured relay routing for real-time, ad-hoc client-to-server matching — the closest existing design comparable for latency-aware compute-marketplace routing. Privately held; no public ticker. |
Update all tables whenever a new entry is added that introduces a new company.