These docs track the main branch and may describe unreleased features. The stable documentation lives at docs.docker.com.

Together AI

Use Together AI models with Docker Agent.

Overview

Together AI is one of the largest hosts of open models, serving Llama, Qwen, DeepSeek, Kimi, GLM and others through an OpenAI-compatible API. Docker Agent includes built-in support for Together AI as an alias provider.

Setup

Create an API key from the Together AI settings.
Set the environment variable:
```
export TOGETHER_API_KEY=your-api-key
```

Usage

Inline Syntax

The simplest way to use Together AI:

agents:
  root:
    model: together/meta-llama/Llama-3.3-70B-Instruct-Turbo
    description: Assistant using Together AI
    instruction: You are a helpful assistant.

Named Model

For more control over parameters:

models:
  together_model:
    provider: together
    model: meta-llama/Llama-3.3-70B-Instruct-Turbo
    temperature: 0.7
    max_tokens: 8192

agents:
  root:
    model: together_model
    description: Assistant using Together AI
    instruction: You are a helpful assistant.

Available Models

Together AI serves a broad, changing catalog of open-weight models. Check the Together AI model library for current model IDs, context limits, and pricing.

Model	Description
`meta-llama/Llama-3.3-70B-Instruct-Turbo`	Llama 3.3 70B, general-purpose chat and tool calling
`Qwen/Qwen3-235B-A22B-Instruct-2507-tput`	Qwen3 235B mixture-of-experts instruct model
`deepseek-ai/DeepSeek-V3`	DeepSeek-V3, strong coding and reasoning

Model IDs are case-sensitive and must be passed exactly as the catalogue lists them.

How It Works

Together AI is implemented as a built-in alias in Docker Agent:

API Type: OpenAI-compatible (openai_chatcompletions)
Base URL: https://api.together.xyz/v1
Token Variable: TOGETHER_API_KEY

Because Together AI fronts open-weight models whose chat templates may reject more than one leading system message, Docker Agent coalesces its per-source system messages into a single one for this provider.

Example: Code Assistant

agents:
  coder:
    model: together/Qwen/Qwen3-235B-A22B-Instruct-2507-tput
    description: Code assistant using Qwen3 on Together AI
    instruction: |
      You are an expert programmer.
      Write clean, well-documented code and follow language best practices.
    toolsets:
      - type: filesystem
      - type: shell
      - type: think

← Previous OVHcloud Next → Vercel AI Gateway