Dedicated GPU endpoints for open models in Europe

Reserved GPU capacity for one open model, for your organization only, in the EU, the US or on the global host. Munito AI sets it up on request, by contract.

A dedicated endpoint gives your organization reserved GPU capacity for one open model, in the EU, the US or on the global host. Munito AI sets it up on request, by contract. You call it with the same API and the same key as the shared models.

When to ask for one

The shared models serve most traffic. Their rate limits adapt to your usage, and the priority tier makes a 503 less likely. Ask for a dedicated endpoint when you need capacity that no other customer uses, for example for a steady high volume or a fixed latency target.

What to send

Contact us through Support in the console, or write to hello@munito.ai. The "Talk to an engineer" form on munito.ai sends to the same address. Give these facts about your workload:

FactExample
Modelqwen/qwen3.8-27b
Request rate5 req/s at the peak, 1 req/s on average
Input token length3,000 tokens for each request, typical
Output token length400 tokens for each request, typical
Latency targetFirst token in under 1 s for 95% of requests
RegionEU, US or Global

The model catalog lists the public models. The regions page explains what each region keeps.

Munito AI sizes the capacity for your workload. The order form of the contract sets the capacity, the price and the payment terms. See Committed spend for the contract and the invoices.

Call a dedicated endpoint

A dedicated endpoint uses the same API formats and the same API key as the shared models. At setup, Munito AI gives you the model ID or the host to use. Put it in place of the model ID or the base URL below.

pip install openai
export MUNITO_API_KEY="munitoai_..."
import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.eu.munito.ai/inference/v1",
    api_key=os.environ["MUNITO_API_KEY"],
)
response = client.chat.completions.create(
    model="qwen/qwen3.8-27b",  # Use the model ID that Munito gives you at setup.
    messages=[{"role": "user", "content": "Hello!"}],
    max_tokens=2048,
)
print(response.model)
print(response.choices[0].message.content)

The Anthropic SDK uses the base URL https://api.eu.munito.ai/inference. Zero data retention, the data privacy rules and the residency rules are the same as on the shared models.