Skip to content

agents: missing good LLM provider clarity #28686

@elithrar

Description

@elithrar

Existing documentation URL(s)

https://developers.cloudflare.com/agents/

What changes are you suggesting?

The Agents SDK does not make it clear that it is AI provider & model agnostic. This confuses users and makes the agents SDK seem more bespoke than it is.

We need to fix this.

  • find the right place in the docs - potentially under API or as a new reference page - for a new “using AI models” section
  • make very clear the options are broad - BYO LLM provider library, use CloudFlare AI Gateway via the AI SDK (incl Workers AI), and/or any provider via the AI SDK
  • show contextual usage examples for each of them.

Ensure all examples use a recent (late 2025/early 2026) model.

cc @whoiskatrin

Additional information

Refer to https://github.com/cloudflare/agents/tree/main/docs and the agents repo itself for examples to use as guidance or code snippets that show real usage examples.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions