Skip to content

Conversation

@apstrom
Copy link

@apstrom apstrom commented Jan 15, 2025

A new script is created that adds a LocalAI model call function, which function is then used by preferences.ts to call the LocalAI API, if LocalAI is selected as the LLM provider.

NOT TESTED - Needs review to ensure that it does not break extant code.

Companion to updated preferences.ts that implements LocalAI alongside ChatGPT.
Final updated preferences.ts.
@0xmzk
Copy link

0xmzk commented Feb 8, 2025

I would like to +1 this idea, and suggest a slight design change. As opposed to integrating a "LocalAI" functionality, I would recommend to generalise the LLM provider configuration to any that matches the Open AI API specification, as such you can use a BASE URL and API KEY for either OpenAI, Anthropic or some locally running instance et cetera. The list of models available from your LLM provider can be fetches from the GET /v1/models endpoint., and subsequently displayed in the configuration. Many other plugins and tools for other software often include a 'test connection' button in the configuration to enable the user to check their API KEY works, in such a way, we could also fetch the list of models on success.

@6801318d8d
Copy link

I would like to test this.

I went into the addon subfolder and zip compressed its content into a .xpi file.

I tried to install such file in Zotero, but it says that the file cannot be installed.

How can I test this PR?

@menelic
Copy link

menelic commented Apr 15, 2025

@0xmzk thanks for this PR, please provide instructions on how it can be tested. @lifan0127 please review and adopt this key feature that would greatly enhance ARIA's unserbase

@0xmzk
Copy link

0xmzk commented Apr 15, 2025

@0xmzk thanks for this PR, please provide instructions on how it can be tested. @lifan0127 please review and adopt this key feature that would greatly enhance ARIA's unserbase

I did not make this PR. As of right now the main branch is not in sync with releases nor stable, as such approaches like TDD are difficult. Once main is stable, I will be able to make this specification. See #157 for discussion on stability of main and future contributions.

@dentistfrankchen
Copy link

I hope this can be made possible soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants