These docs track the main branch and may describe unreleased features. The stable documentation lives at docs.docker.com.

OVHcloud

Use OVHcloud AI Endpoints models with Docker Agent.

Overview

OVHcloud AI Endpoints serves open-weight models through an OpenAI-compatible API, hosted in the EU. Docker Agent includes built-in support for OVHcloud as an alias provider.

Setup

  1. Create an access token from the OVHcloud AI Endpoints portal.

  2. Set the environment variable:

    export OVH_AI_ENDPOINTS_ACCESS_TOKEN=your-access-token

Usage

Inline Syntax

agents:
  root:
    model: ovhcloud/Qwen3.5-397B-A17B
    description: Assistant using OVHcloud
    instruction: You are a helpful assistant.

Named Model

models:
  ovhcloud_model:
    provider: ovhcloud
    model: Qwen3.5-397B-A17B
    temperature: 0.7
    max_tokens: 8192

agents:
  root:
    model: ovhcloud_model
    description: Assistant using OVHcloud
    instruction: You are a helpful assistant.

Available Models

OVHcloud hosts a rotating catalogue of open-weight models. Check the AI Endpoints catalogue for current model IDs, context limits, and free-tier availability.

Model Description
Qwen3.5-397B-A17B Large Qwen3.5 MoE — strong general, coding, and reasoning
Qwen3-32B Mid-size Qwen3 — fast, tool-calling, reasoning
Qwen3.6-27B Compact Qwen3.6 — fast and efficient
Qwen3.5-9B Small Qwen3.5 — lightweight, free-tier friendly
Qwen3-Coder-30B-A3B-Instruct Qwen3 Coder MoE — optimised for code generation
Meta-Llama-3_3-70B-Instruct Llama 3.3 70B — reliable general-purpose chat
Mistral-Small-3.2-24B-Instruct-2506 Compact, fast, tool-calling

Model IDs are case-sensitive and must be passed exactly as the catalogue lists them.

How It Works

OVHcloud is implemented as a built-in alias in Docker Agent:

Docker Agent automatically coalesces consecutive system messages into one for OVHcloud, because some OVHcloud models return an empty stream when a request carries more than one system message.

Free tier

OVHcloud offers rate-limited free access to several models. Under heavy rate-limiting the endpoint may return an empty response; Docker Agent surfaces this as a warning rather than failing. For sustained use, an access token with a paid plan avoids the free-tier request-rate cap.

Example: Code Assistant

agents:
  coder:
    model: ovhcloud/Qwen3.5-397B-A17B
    description: Code assistant using Qwen3.5
    instruction: |
      You are an expert programmer.
      Write clean, well-documented code and follow language best practices.
    toolsets:
      - type: filesystem
      - type: shell
      - type: think
← Previous OpenRouter