Skip to content

Commit 39b4cad

Browse files
authored
Clarify max_tokens docs
Ref #4
1 parent 3479ea3 commit 39b4cad

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -30,8 +30,8 @@ The [mlx-community](https://huggingface.co/mlx-community) organization is a usef
3030

3131
MLX models can use the following model options:
3232

33-
- `-o max_tokens 20`: Maximum number of tokens to generate in the completion.
34-
- `-o unlimited 1`: Generate an unlimited number of tokens in the completion.
33+
- `-o max_tokens INTEGER`: Maximum number of tokens to generate in the completion (defaults to 1024)
34+
- `-o unlimited 1`: Generate an unlimited number of tokens in the completion
3535
- `-o temperature FLOAT`: Sampling temperature (defaults to 0.8)
3636
- `-o top_p FLOAT`: Sampling top-p (defaults to 0.9)
3737
- `-o min_p FLOAT`: Sampling min-p (defaults to 0.1)

0 commit comments

Comments
 (0)