Skip to content

Serve a model already downloaded. #8

@henrique-simoes

Description

@henrique-simoes

If a user already downloaded a model in LM Studio (example) or another LLM server, the user should be able to use dflash-serve and just point the directory with the downloaded model instead of downloading it again.

Example:

dflash-serve --model /User/user/.lmstudio/models/mlx-community/Qwen3.6-35B-A3B-4bit --port 8000

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions