FAQ: open-model inference API for Europe

Short answers about the Munito AI API. Where requests run, the EU-only host, the open models, the API formats, prices and data retention.

Munito AI is an open-model inference provider for Europe, private by default. Each answer below is short, and its link goes to the page with the details.

Regions and data residency

Where does Munito AI process my requests?

The EU host processes each request in the EU, and the US host processes each request in the US. The global host can process a request in any region. Each response names its region in the munito-region header: EUROPE, US or GLOBAL. See Regions.

Is there an EU-only endpoint for LLM inference?

Yes. Use https://api.eu.munito.ai/inference/v1 with an OpenAI SDK, and https://api.eu.munito.ai/inference with the Anthropic SDK. On the global host, add @eu to the model ID, for example qwen/qwen3.8-27b@eu. See GDPR and EU data residency.

How do I keep LLM prompts and outputs inside the EU?

Send your requests to the EU host. Munito AI keeps no prompts or outputs by default, and the data that you ask it to store stays in the data region of your workspace. EU is the default data region at signup. Residency covers processing and storage. It does not cover the path of your traffic across the internet, or the account, verification and billing services. See What residency covers.

Can I call DeepSeek, Qwen or GLM models through an API in the EU?

Yes. Munito AI serves DeepSeek-V4-Flash, Qwen3.8-27B and GLM-5.3-Flash in the EU. Send the request to the EU host, and it runs in the EU. Each model page lists the regions that serve its model.

Models and APIs

Which open models does Munito AI serve?

Munito AI serves chat models such as Qwen, DeepSeek, GLM and Kolibri, an OCR model that reads documents into Markdown, a speech to text model, and decision models in preview. The model catalog lists each model with its model ID, context and regions.

Is the Munito AI API OpenAI-compatible?

Yes. Munito AI serves the OpenAI Chat Completions, Responses and speech to text APIs, and the Anthropic Messages API. Keep your OpenAI or Anthropic SDK, and change the base URL, the API key and the model name. See Migrate from OpenAI or Anthropic and API compatibility.

SDKGlobalEUUS
OpenAIhttps://api.munito.ai/inference/v1https://api.eu.munito.ai/inference/v1https://api.us.munito.ai/inference/v1
Anthropichttps://api.munito.ai/inferencehttps://api.eu.munito.ai/inferencehttps://api.us.munito.ai/inference

Does Munito AI support the OpenAI Responses API?

Yes. POST /responses works with tool calls, structured outputs and background responses, and Codex connects through it. See Create a response and Codex.

Do the open models support tool calls and structured outputs?

Yes. Each public chat model supports tool calls, and each chat model accepts the JSON schema and JSON object formats. See Tool calling and Structured outputs.

Can I use Claude Code, Codex, OpenCode or Hermes Agent with open models?

Yes. Claude Code connects to the Anthropic-compatible endpoint, and Codex to the Responses API. OpenCode and Hermes Agent use Munito AI as a custom OpenAI-compatible provider. See Claude Code, Codex, OpenCode and Hermes. LangChain and LlamaIndex have guides too.

Is there an OCR API that returns Markdown?

Yes. POST /ocr reads a PDF or an image and returns the Markdown of each page, in the EU or the US. See Document AI, PDF to Markdown and Invoice extraction.

Can the OCR API read handwriting and the tables of scanned PDFs?

Yes. The OCR model lightonai/lightonocr-2-1b reads printed text and handwriting, and it writes each table as an HTML table in the Markdown of its page. See Document AI.

Data privacy

Does Munito AI keep my prompts and outputs?

No, not by default. Zero data retention is the default policy: after delivery, Munito AI removes the temporary request content. Munito AI keeps content only when a request asks for it, with store: true or background: true, and then for 30 days. See Data privacy.

Does Munito AI train models on my data?

No. Munito AI does not train models on your inputs or outputs, and it does not sell your data. The Terms of Service and the Privacy Policy state it. See Data privacy.

Is there a GDPR Data Processing Agreement (DPA)?

Yes. The DPA forms part of the Terms of Service, so it applies with no signature. The trust center lists the sub-processors of each region. See GDPR documents.

What does Munito AI record about each request?

Munito AI records usage data to bill and operate the service: the model ID, the time, the token or page counts, the request status and the API key. This record does not contain your prompts or outputs. See What Munito AI records.

Prices and billing

What does open-model inference cost per million tokens in the EU?

Each model has a posted price in USD for each million input, cached input and output tokens. Munito AI bills a request to the EU host, or with an @eu model ID, at the EU price of the model. Models and pricing lists each price by region and service tier.

How does Munito AI bill OCR?

Munito AI bills each page that the model reads, at a posted price for each 1,000 pages. See OCR models and Price per page.

Is there a free tier?

Yes. A new account with a verified phone number can use the free tier, subject to available capacity. See Pay for usage.

Does prompt caching cost extra?

No. Munito AI caches repeated prompt prefixes automatically. A cached input token costs the cached-input price, and a cache write costs no extra fee. See Prompt caching.

Are there committed-spend discounts?

Yes. A committed-spend contract gives volume rates in its order form, with a monthly invoice in USD that is due 30 days after its date. See Committed spend.

How do I pay?

Buy prepaid credits by card on the Billing page of the console. An automatic top-up can buy credits when the balance falls to your threshold. For a monthly invoice, sign a committed-spend contract. See Pay for usage.

Capacity and limits

Can I get a dedicated GPU endpoint for an open model in Europe?

Yes, on request and by contract. A dedicated endpoint gives your organization reserved capacity for one model, in the EU, the US or on the global host. You call it with the same API and the same key. See Dedicated endpoints.

What are the rate limits?

Your limits adapt to your usage. A 429 means that your traffic is above your limit, and a 503 means that the model has no free capacity at that moment. Each response carries your current limits in the x-ratelimit-* headers. For higher limits, contact us through Support in the console. See Rate limits.

What happens when a model is busy?

The service tier sets the order: the model serves priority requests first and flex requests last. Overflow is off by default. When you turn it on, the same model at a provider in your region, or another model, can answer a chat request. See Service tiers.

What are the limits of an OCR request?

A document is a PDF or an image of at most 50 MiB, and one request reads at most 1000 pages. See PDF to Markdown.

Security and the company

Does Munito AI hold security certifications?

Not today. Munito AI holds no security certification and no audit report. Certifications and audits are planned, and so are SSO and SCIM. The trust center lists the controls in place today. See Security.

Who operates Munito AI?

Munito AI France, a French SAS in Paris, operates Munito AI. It is the seller for EU and self-serve customers. Y Combinator backs Munito AI. See Company facts, the legal notice and munito.ai.