Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature request: Ollama LLM HTTP authentication #1155

Open
xorinzor opened this issue Feb 7, 2025 · 2 comments
Open

feature request: Ollama LLM HTTP authentication #1155

xorinzor opened this issue Feb 7, 2025 · 2 comments
Labels
enhancement New feature or request

Comments

@xorinzor
Copy link

xorinzor commented Feb 7, 2025

It would be great if there's a way to provide some form of authentication to the Ollama LLM method.
Options could be an Authentication header, Token, or even (though not ideal) basic-auth.

This would allow someone to self-host an LLM and expose it to the internet securely, while keeping goose working no matter where they are using it.

@salman1993 salman1993 added the enhancement New feature or request label Feb 8, 2025
@salman1993
Copy link
Collaborator

salman1993 commented Feb 8, 2025

This makes sense. I think we'll hold off on this one till Ollama provides an auth route officially. Still see this open issue: ollama/ollama#849

We will provide Open AI compatible endpoint so that could be reused to have Ollama with auth token
#885

@xorinzor
Copy link
Author

xorinzor commented Feb 8, 2025

Given that their issue is closed I'm not expecting them to do so anytime soon.

Having an option to provide our own headers along with the http requests that goose makes would allow us to implement our own authentication system in front of ollama.

This could be something simple like OLLAMA_HTTP_HEADERS which is an object where each key is the header name, and value the header value.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants