InferenceIntroduction

Inference

Tangle Inference is one OpenAI-compatible endpoint for every model. A single API key routes each request across provider APIs and registered Tangle operators, chosen on price, latency, and reputation.

One key for every provider and operator

  • One key, any model. Reach OpenAI, Anthropic, Google, Groq, Mistral, and every other supported provider through a single API key. The live catalog is at /v1/models.
  • Operator network. Route to operators registered for Blueprints; the gateway selects from their advertised endpoint, model support, price, latency, and reputation data.
  • Compliance routing. Zero Data Retention and no-train filtering with verified provider agreements.
  • BYOK. Bring your own provider keys for zero-markup access.
  • On-chain payments. Pay operators directly via SpendAuth, no credit card required.

Quick example

curl -X POST "https://router.tangle.tools/v1/chat/completions" \
  -H "Authorization: Bearer $TANGLE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "anthropic/claude-sonnet-4-6",
    "messages": [{"role": "user", "content": "Hello"}],
    "stream": true
  }'

Works with any OpenAI-compatible SDK. Change the base URL and you’re done.

Architecture

The gateway routes through two tiers, in order:

TierWhatWhen
OperatorsTangle-registered inference operators with advertised endpointsDefault for operator-pinned requests and SpendAuth
DirectStraight to provider API (OpenAI, Anthropic, etc.)Default for standard requests, and when compliance is required

When Zero Data Retention or no-train is requested, operators are skipped. The gateway routes directly to verified providers only.

Where the gateway sits

Workbench (agents) → Gateway (inference) → Operators (serving) → Protocol (settlement)

The gateway sits between the Workbench where agents run and the Protocol where operators get paid. Agents in the workbench call the gateway for model access. The gateway selects a provider or operator by price, latency, and reputation, routes the request, tracks usage, and settles payment.

Next steps

Getting Started