Model setup

Agent can be used with models that support tool use through Continue.

For the best Agent experience we recommend Claude 3.7 Sonnet from Anthropic. Add Claude 3.7 Sonnet to your assistant from the hub here. You can get an API key from the Anthropic console.

Currently the following providers are supported:

• Anthropic - we recommend Claude Sonnet 3.7
• Ollama - we recommend Qwen 2.5 Coder 7b. Also see all Ollama models that support tools here.
• OpenAI - we recommend GPT-4o
• Gemini - we recommend Gemini 2.0 Flash
• Mistral - we recommend Codestral

The best chat models generally support tool usage. See recommended chat models for more.

If the model is not known to support tools, Agent will be disabled. To designate tool support, a model must be configured with the tool_use capability or specifically marked as supporting tools in Continue's source code.