Compute Marketplaces

⚠ Disclaimer: This section may contain incomplete, out of date, or inaccurate entries. It is AI-maintained on a best-effort basis. Do not rely on it as a sole source — verify claims independently using the source materials listed in individual entries.

Overview

If inference compute is going to trade in an open, ad-hoc market — buyers and sellers who have never met, matched request-by-request across whichever provider can serve fastest or cheapest — three technical layers have to exist: a way for a buyer to discover who can serve a given request nearby or cheaply, a matchmaking/pricing mechanism that decides who actually gets the job, and a payment/settlement layer that lets machines pay machines per request without a human in the loop. This section tracks the state of each layer as of mid-2026.

None of the three layers has a dominant, standardized answer yet. Two production-scale marketplaces exist — OpenRouter (posted-price aggregation across 60+ inference providers) and Akash Network (on-chain reverse auction) — but neither routes on measured physical latency the way a CDN or a multiplayer game network does. That gap is the section’s organizing question, which is why latency-based matchmaking in multiplayer gaming — a problem the game industry solved decades ago for a similarly real-time, similarly ad-hoc matching problem — is documented here as the closest existing design comparable, alongside the decentralized libp2p/Kademlia DHT discovery stack used by peer-to-peer inference swarms, the emerging IETF AI discovery drafts, and x402, the leading candidate for the machine-payment layer.

This section is the coordination-layer counterpart to Distributed & Decentralized Compute, which covers where distributed inference hardware is physically sited and powered. This section covers how a buyer finds that hardware and pays for the tokens it produces.

Key Themes

  • Two working price-discovery models exist in production — posted-price aggregation (OpenRouter) and on-chain reverse auction (Akash) — but “route to the physically nearest/lowest-latency provider” is still mostly borrowed CDN practice (anycast, GeoDNS, client-measured RTT) rather than a purpose-built inference-marketplace protocol
  • The multiplayer gaming industry solved a structurally similar problem — real-time, latency-sensitive matching of ad-hoc clients to the best available server — starting with ping-sorted server browsers in 1996 and maturing into relay networks (Valve’s Steam Datagram Relay) that separate generic latency-measurement/relay transport from game-specific matchmaking policy; that split is a direct design analogy for a compute marketplace
  • Peer-to-peer inference swarms (Petals/Hivemind and derivatives) use a libp2p + Kademlia DHT stack for node discovery — a mechanism borrowed wholesale from BitTorrent/IPFs-style file sharing, distinct from and not interoperable with either OpenRouter’s or Akash’s coordination models
  • Standards work is nascent: IETF has multiple individual (non-working-group) drafts proposing AI/agent discovery mechanisms as of early-to-mid 2026, none adopted
  • Machine-to-machine micropayment rails (x402, built on the revived HTTP 402 status code) are the leading candidate for a settlement layer that lets an AI agent pay per inference call without an account or human approval step — live in production since mid-2025 with meaningful but still small transaction volume as of early 2026
  • Unsolved marketplace problem common to every posted-price aggregator: quality/fraud verification (a provider silently serving a more heavily quantized model than advertised) has no standard countermeasure yet

Companies

Startups & Development Partners

Company HQ Stage Mission
OpenRouter New York, US Series B (~$1.3B valuation, May 2026) Posted-price, multi-provider LLM inference routing gateway/marketplace — 400+ models, 60+ providers.
Akash Network Distributed/DAO (Overclock Labs, San Francisco) Live mainnet, token-governed On-chain reverse-auction marketplace for GPU/CPU compute; see full entry in Distributed & Decentralized Compute.

Public Companies

Ticker Company Mission
COIN Coinbase Developer of x402, the leading HTTP-402-based machine-payment protocol used for per-request AI agent payments.

Incumbents

Company Relevance
Valve Corporation Operates Steam Datagram Relay, the most mature production example of latency-measured relay routing for real-time, ad-hoc client-to-server matching — the closest existing design comparable for latency-aware compute-marketplace routing. Privately held; no public ticker.

Update all tables whenever a new entry is added that introduces a new company.


Entries

  • IETF AI Service Discovery Drafts — A fragmented, fast-moving set of individual (non-working-group) IETF Internet-Drafts proposing standards for how AI agents, models, and resource providers discover each other — including a well-known-endpoint capability descriptor and a layered discovery-transport architecture — none yet adopted, none interoperable with each other.
  • Latency-Based Matchmaking in Multiplayer Gaming — Ping-sorted server browsers (id Software's QuakeWorld/QuakeSpy, 1996) and relay-network routing (Valve's Steam Datagram Relay) — the multiplayer gaming industry's decades-old solution to real-time, ad-hoc latency-aware matching, and the closest existing design comparable for an inference-compute marketplace.
  • OpenRouter — New York-based posted-price aggregation marketplace and routing gateway for LLM inference — 400+ models across 60+ providers, ~100 trillion tokens/month, $1.3B valuation as of a May 2026 Series B — the largest production example of price/latency-weighted provider selection for inference.
  • P2P Discovery for Inference: libp2p + Kademlia DHT Swarms — The libp2p/Kademlia distributed-hash-table peer-discovery stack — borrowed from BitTorrent/IPFS — used by Hivemind, Petals, and derivative projects (e.g. KwaaiNet) to let volunteer GPU/CPU nodes find each other and jointly serve large models; distinct from and not interoperable with Akash's blockchain-based marketplace matching.
  • x402: Machine-to-Machine Payments — Coinbase's x402 protocol — reviving the unused HTTP 402 'Payment Required' status code to let AI agents pay per API call in stablecoins with no account or human approval step — is the leading candidate settlement layer for an ad-hoc inference-compute marketplace, live since mid-2025 and past 100 million on-chain transactions on Base by mid-2026.