Skip to content

Commit a6bfc46

Browse files
committed
[Platform] Document model size variant feature
Add documentation explaining how to use model size variants (e.g., qwen3:32b) and how they work with query parameters. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
1 parent e813e83 commit a6bfc46

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

src/platform/doc/index.rst

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -67,6 +67,24 @@ supports a specific feature, like ``Capability::INPUT_AUDIO`` or ``Capability::O
6767
**Options** are additional parameters that can be passed to the model, like ``temperature`` or ``max_tokens``, and are
6868
usually defined by the specific models and their documentation.
6969

70+
**Model Size Variants**
71+
72+
For providers like Ollama, you can specify model size variants using a colon notation (e.g., ``qwen3:32b``, ``llama3:7b``).
73+
If the exact model name with size variant is not found in the catalog, the system will automatically fall back to the base
74+
model name (``qwen3``, ``llama3``) and use its capabilities while preserving the full model name for the provider.
75+
76+
You can also combine size variants with query parameters::
77+
78+
use Symfony\AI\Platform\Bridge\Ollama\ModelCatalog;
79+
80+
$catalog = new ModelCatalog();
81+
82+
// Get model with size variant
83+
$model = $catalog->getModel('qwen3:32b');
84+
85+
// Get model with size variant and query parameters
86+
$model = $catalog->getModel('qwen3:32b?temperature=0.5&top_p=0.9');
87+
7088
**Supported Models & Platforms**
7189

7290
* **Language Models**

0 commit comments

Comments
 (0)