Skip to content

Change default model repo to Hugging Face #2398

@olliewalsh

Description

@olliewalsh

When not explicitly provided, the default model repository should change from Ollama to Hugging Face.

Ollama has diverged from upstream llama.cpp. As a result of this, an increasing number of newer ollama models are not compatible with lama.cpp (e.g gpt-oss).

While we can workaround this be using shortnames to override specific models, this is not sustainable.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions