These docs track the main branch and may describe unreleased features. The stable documentation lives at docs.docker.com.

Nebius

Use Nebius AI models with Docker Agent.

Overview

Nebius provides AI models through an OpenAI-compatible API. Docker Agent includes built-in support for Nebius as an alias provider.

Setup

Get an API key from Nebius AI
Set the environment variable:
```
export NEBIUS_API_KEY=your-api-key
```

Usage

Inline Syntax

The simplest way to use Nebius:

agents:
  root:
    model: nebius/deepseek-ai/DeepSeek-V3
    description: Assistant using Nebius
    instruction: You are a helpful assistant.

Named Model

For more control over parameters:

models:
  nebius_model:
    provider: nebius
    model: deepseek-ai/DeepSeek-V3
    temperature: 0.7
    max_tokens: 8192

agents:
  root:
    model: nebius_model
    description: Assistant using Nebius
    instruction: You are a helpful assistant.

Available Models

Nebius hosts various open models. Check the Nebius documentation for the current model catalog.

Model	Description
`deepseek-ai/DeepSeek-V3`	DeepSeek V3 model
`Qwen/Qwen2.5-72B-Instruct`	Qwen 2.5 72B instruction-tuned
`meta-llama/Llama-3.3-70B-Instruct`	Llama 3.3 70B instruction-tuned

How It Works

Nebius is implemented as a built-in alias in Docker Agent:

API Type: OpenAI-compatible (openai_chatcompletions)
Base URL: https://api.studio.nebius.com/v1
Token Variable: NEBIUS_API_KEY

Example: Code Assistant

agents:
  coder:
    model: nebius/deepseek-ai/DeepSeek-V3
    description: Code assistant using DeepSeek
    instruction: |
      You are an expert programmer using DeepSeek V3.
      Write clean, well-documented code.
      Follow best practices for the language being used.
    toolsets:
      - type: filesystem
      - type: shell
      - type: think

← Previous Moonshot AI Next → NVIDIA