These docs track the main branch and may describe unreleased features. The stable documentation lives at docs.docker.com.

Baseten

Use Baseten AI models with Docker Agent.

Overview

Baseten provides AI models through an OpenAI-compatible API. Docker Agent includes built-in support for Baseten as an alias provider.

Setup

Get an API key from Baseten
Set the environment variable:
```
export BASETEN_API_KEY=your-api-key
```

Usage

Inline Syntax

The simplest way to use Baseten:

agents:
  root:
    model: baseten/deepseek-ai/DeepSeek-V4-Pro-0813
    description: Assistant using Baseten
    instruction: You are a helpful assistant.

Named Model

For more control over parameters:

models:
  baseten_model:
    provider: baseten
    model: deepseek-ai/DeepSeek-V4-Pro-0813
    temperature: 0.7
    max_tokens: 8192

agents:
  root:
    model: baseten_model
    description: Assistant using Baseten
    instruction: You are a helpful assistant.

Available Models

Baseten hosts various open models through its Model APIs. Check the Baseten documentation for the current model catalog.

Model	Description
`deepseek-ai/DeepSeek-V4-Pro-0813`	DeepSeek V4 Pro 0813 model
`moonshotai/Kimi-K3`	Moonshot Kimi K3 model
`openai/gpt-oss-120b`	GPT-OSS 120B model
`zai-org/GLM-5.3`	GLM-5.3 model

How It Works

Baseten is implemented as a built-in alias in Docker Agent:

API Type: OpenAI-compatible (openai_chatcompletions)
Base URL: https://inference.baseten.co/v1
Token Variable: BASETEN_API_KEY

Example: Code Assistant

agents:
  coder:
    model: baseten/deepseek-ai/DeepSeek-V4-Pro-0813
    description: Code assistant using DeepSeek
    instruction: |
      You are an expert programmer using DeepSeek V4 Pro 0813.
      Write clean, well-documented code.
      Follow best practices for the language being used.
    toolsets:
      - type: filesystem
      - type: shell
      - type: think

← Previous AWS Bedrock Next → Cerebras