These docs track the main branch and may describe unreleased features. The stable documentation lives at docs.docker.com.

Baseten

Use Baseten AI models with docker-agent.

Overview

Baseten provides AI models through an OpenAI-compatible API. docker-agent includes built-in support for Baseten as an alias provider.

Setup

Get an API key from Baseten
Set the environment variable:
```
export BASETEN_API_KEY=your-api-key
```

Usage

Inline Syntax

The simplest way to use Baseten:

agents:
  root:
    model: baseten/deepseek-ai/DeepSeek-V3.1
    description: Assistant using Baseten
    instruction: You are a helpful assistant.

Named Model

For more control over parameters:

models:
  baseten_model:
    provider: baseten
    model: deepseek-ai/DeepSeek-V3.1
    temperature: 0.7
    max_tokens: 8192

agents:
  root:
    model: baseten_model
    description: Assistant using Baseten
    instruction: You are a helpful assistant.

Available Models

Baseten hosts various open models through its Model APIs. Check the Baseten documentation for the current model catalog.

Model	Description
`deepseek-ai/DeepSeek-V3.1`	DeepSeek V3.1 model
`moonshotai/Kimi-K2.5`	Moonshot Kimi K2.5 model
`openai/gpt-oss-120b`	GPT-OSS 120B model
`zai-org/GLM-5`	GLM-5 model

How It Works

Baseten is implemented as a built-in alias in docker-agent:

API Type: OpenAI-compatible (openai_chatcompletions)
Base URL: https://inference.baseten.co/v1
Token Variable: BASETEN_API_KEY

Example: Code Assistant

agents:
  coder:
    model: baseten/deepseek-ai/DeepSeek-V3.1
    description: Code assistant using DeepSeek
    instruction: |
      You are an expert programmer using DeepSeek V3.1.
      Write clean, well-documented code.
      Follow best practices for the language being used.
    toolsets:
      - type: filesystem
      - type: shell
      - type: think

← Previous AWS Bedrock Next → Cerebras