# FAQ: open-model inference API for Europe
URL: https://docs.munito.ai/faq

Munito AI is an open-model inference provider for Europe, private by default. Each answer below is short, and its link goes to the page with the details.

## Regions and data residency [#regions-and-data-residency]

### Where does Munito AI process my requests? [#where-does-munito-ai-process-my-requests]

The EU host processes each request in the EU, and the US host processes each request in the US. The global host can process a request in any region. Each response names its region in the `munito-region` header: `EUROPE`, `US` or `GLOBAL`. See [Regions](https://docs.munito.ai/regions).

### Is there an EU-only endpoint for LLM inference? [#is-there-an-eu-only-endpoint-for-llm-inference]

Yes. Use `https://api.eu.munito.ai/inference/v1` with an OpenAI SDK, and `https://api.eu.munito.ai/inference` with the Anthropic SDK. On the global host, add `@eu` to the model ID, for example `qwen/qwen3.8-27b@eu`. See [GDPR and EU data residency](https://docs.munito.ai/gdpr-data-residency).

### How do I keep LLM prompts and outputs inside the EU? [#how-do-i-keep-llm-prompts-and-outputs-inside-the-eu]

Send your requests to the EU host. Munito AI keeps no prompts or outputs by default, and the data that you ask it to store stays in the data region of your workspace. EU is the default data region at signup. Residency covers processing and storage. It does not cover the path of your traffic across the internet, or the account, verification and billing services. See [What residency covers](https://docs.munito.ai/gdpr-data-residency#what-residency-covers).

### Can I call DeepSeek, Qwen or GLM models through an API in the EU? [#can-i-call-deepseek-qwen-or-glm-models-through-an-api-in-the-eu]

Yes. Munito AI serves [DeepSeek-V4-Flash](https://docs.munito.ai/models/deepseek-ai-deepseek-v4-flash), [Qwen3.8-27B](https://docs.munito.ai/models/qwen-qwen3-8-27b) and [GLM-5.3-Flash](https://docs.munito.ai/models/zai-org-glm-5-3-flash) in the EU. Send the request to the EU host, and it runs in the EU. Each model page lists the regions that serve its model.

## Models and APIs [#models-and-apis]

### Which open models does Munito AI serve? [#which-open-models-does-munito-ai-serve]

Munito AI serves chat models such as Qwen, DeepSeek, GLM and Kolibri, an OCR model that reads documents into Markdown, a [speech to text](https://docs.munito.ai/speech-to-text) model, and decision models in preview. The [model catalog](https://docs.munito.ai/models) lists each model with its model ID, context and regions.

### Is the Munito AI API OpenAI-compatible? [#is-the-munito-ai-api-openai-compatible]

Yes. Munito AI serves the OpenAI Chat Completions, Responses and speech to text APIs, and the Anthropic Messages API. Keep your OpenAI or Anthropic SDK, and change the base URL, the API key and the model name. See [Migrate from OpenAI or Anthropic](https://docs.munito.ai/migrate-from-openai) and [API compatibility](https://docs.munito.ai/api-compatibility).

| SDK       | Global                               | EU                                      | US                                      |
| --------- | ------------------------------------ | --------------------------------------- | --------------------------------------- |
| OpenAI    | `https://api.munito.ai/inference/v1` | `https://api.eu.munito.ai/inference/v1` | `https://api.us.munito.ai/inference/v1` |
| Anthropic | `https://api.munito.ai/inference`    | `https://api.eu.munito.ai/inference`    | `https://api.us.munito.ai/inference`    |

### Does Munito AI support the OpenAI Responses API? [#does-munito-ai-support-the-openai-responses-api]

Yes. `POST /responses` works with tool calls, structured outputs and background responses, and Codex connects through it. See [Create a response](https://docs.munito.ai/api/createResponse) and [Codex](https://docs.munito.ai/codex).

### Do the open models support tool calls and structured outputs? [#do-the-open-models-support-tool-calls-and-structured-outputs]

Yes. Each public chat model supports tool calls, and each chat model accepts the JSON schema and JSON object formats. See [Tool calling](https://docs.munito.ai/tool-calling) and [Structured outputs](https://docs.munito.ai/structured-outputs).

### Can I use Claude Code, Codex, OpenCode or Hermes Agent with open models? [#can-i-use-claude-code-codex-opencode-or-hermes-agent-with-open-models]

Yes. Claude Code connects to the Anthropic-compatible endpoint, and Codex to the Responses API. OpenCode and Hermes Agent use Munito AI as a custom OpenAI-compatible provider. See [Claude Code](https://docs.munito.ai/claude-code), [Codex](https://docs.munito.ai/codex), [OpenCode](https://docs.munito.ai/opencode) and [Hermes](https://docs.munito.ai/hermes). [LangChain](https://docs.munito.ai/langchain) and [LlamaIndex](https://docs.munito.ai/llamaindex) have guides too.

### Is there an OCR API that returns Markdown? [#is-there-an-ocr-api-that-returns-markdown]

Yes. `POST /ocr` reads a PDF or an image and returns the Markdown of each page, in the EU or the US. See [Document AI](https://docs.munito.ai/document-ai), [PDF to Markdown](https://docs.munito.ai/pdf-to-markdown) and [Invoice extraction](https://docs.munito.ai/invoice-extraction).

### Can the OCR API read handwriting and the tables of scanned PDFs? [#can-the-ocr-api-read-handwriting-and-the-tables-of-scanned-pdfs]

Yes. The OCR model `lightonai/lightonocr-2-1b` reads printed text and handwriting, and it writes each table as an HTML table in the Markdown of its page. See [Document AI](https://docs.munito.ai/document-ai#extract-tables-from-scanned-pdfs).

## Data privacy [#data-privacy]

### Does Munito AI keep my prompts and outputs? [#does-munito-ai-keep-my-prompts-and-outputs]

No, not by default. Zero data retention is the default policy: after delivery, Munito AI removes the temporary request content. Munito AI keeps content only when a request asks for it, with `store: true` or `background: true`, and then for 30 days. See [Data privacy](https://docs.munito.ai/data-privacy).

### Does Munito AI train models on my data? [#does-munito-ai-train-models-on-my-data]

No. Munito AI does not train models on your inputs or outputs, and it does not sell your data. The [Terms of Service](https://legal.munito.ai/terms) and the [Privacy Policy](https://legal.munito.ai/privacy) state it. See [Data privacy](https://docs.munito.ai/data-privacy).

### Is there a GDPR Data Processing Agreement (DPA)? [#is-there-a-gdpr-data-processing-agreement-dpa]

Yes. The DPA forms part of the Terms of Service, so it applies with no signature. The [trust center](https://trust.munito.ai/subprocessors) lists the sub-processors of each region. See [GDPR documents](https://docs.munito.ai/gdpr-data-residency#gdpr-documents).

### What does Munito AI record about each request? [#what-does-munito-ai-record-about-each-request]

Munito AI records usage data to bill and operate the service: the model ID, the time, the token or page counts, the request status and the API key. This record does not contain your prompts or outputs. See [What Munito AI records](https://docs.munito.ai/data-privacy#what-munito-ai-records-about-each-request).

## Prices and billing [#prices-and-billing]

### What does open-model inference cost per million tokens in the EU? [#what-does-open-model-inference-cost-per-million-tokens-in-the-eu]

Each model has a posted price in USD for each million input, cached input and output tokens. Munito AI bills a request to the EU host, or with an `@eu` model ID, at the EU price of the model. [Models and pricing](https://docs.munito.ai/models#prices) lists each price by region and service tier.

### How does Munito AI bill OCR? [#how-does-munito-ai-bill-ocr]

Munito AI bills each page that the model reads, at a posted price for each 1,000 pages. See [OCR models](https://docs.munito.ai/models#ocr-models) and [Price per page](https://docs.munito.ai/document-ai#price-per-page).

### Is there a free tier? [#is-there-a-free-tier]

Yes. A new account with a verified phone number can use the free tier, subject to available capacity. See [Pay for usage](https://docs.munito.ai/models#pay-for-usage).

### Does prompt caching cost extra? [#does-prompt-caching-cost-extra]

No. Munito AI caches repeated prompt prefixes automatically. A cached input token costs the cached-input price, and a cache write costs no extra fee. See [Prompt caching](https://docs.munito.ai/prompt-caching).

### Are there committed-spend discounts? [#are-there-committed-spend-discounts]

Yes. A committed-spend contract gives volume rates in its order form, with a monthly invoice in USD that is due 30 days after its date. See [Committed spend](https://docs.munito.ai/committed-spend).

### How do I pay? [#how-do-i-pay]

Buy prepaid credits by card on the Billing page of the [console](https://console.munito.ai). An automatic top-up can buy credits when the balance falls to your threshold. For a monthly invoice, sign a committed-spend contract. See [Pay for usage](https://docs.munito.ai/models#pay-for-usage).

## Capacity and limits [#capacity-and-limits]

### Can I get a dedicated GPU endpoint for an open model in Europe? [#can-i-get-a-dedicated-gpu-endpoint-for-an-open-model-in-europe]

Yes, on request and by contract. A dedicated endpoint gives your organization reserved capacity for one model, in the EU, the US or on the global host. You call it with the same API and the same key. See [Dedicated endpoints](https://docs.munito.ai/dedicated-endpoints).

### What are the rate limits? [#what-are-the-rate-limits]

Your limits adapt to your usage. A `429` means that your traffic is above your limit, and a `503` means that the model has no free capacity at that moment. Each response carries your current limits in the `x-ratelimit-*` headers. For higher limits, contact us through Support in the [console](https://console.munito.ai). See [Rate limits](https://docs.munito.ai/rate-limits).

### What happens when a model is busy? [#what-happens-when-a-model-is-busy]

The service tier sets the order: the model serves `priority` requests first and `flex` requests last. [Overflow](https://docs.munito.ai/overflow) is off by default. When you turn it on, the same model at a provider in your region, or another model, can answer a chat request. See [Service tiers](https://docs.munito.ai/service-tiers).

### What are the limits of an OCR request? [#what-are-the-limits-of-an-ocr-request]

A document is a PDF or an image of at most 50 MiB, and one request reads at most 1000 pages. See [PDF to Markdown](https://docs.munito.ai/pdf-to-markdown).

## Security and the company [#security-and-the-company]

### Does Munito AI hold security certifications? [#does-munito-ai-hold-security-certifications]

Not today. Munito AI holds no security certification and no audit report. Certifications and audits are planned, and so are SSO and SCIM. The [trust center](https://trust.munito.ai) lists the controls in place today. See [Security](https://docs.munito.ai/security).

### Who operates Munito AI? [#who-operates-munito-ai]

Munito AI France, a French SAS in Paris, operates Munito AI. It is the seller for EU and self-serve customers. Y Combinator backs Munito AI. See [Company facts](https://docs.munito.ai/company), the [legal notice](https://legal.munito.ai/notice) and [munito.ai](https://munito.ai).