Integration with Windows Desktop LMStudio

[timtak]

PapersGPT will interface with Mac's desktop LLM.

How about a windows desktop LLM provided by LMStudio
https://lmstudio.ai/

Afforia, Scite, SciSpace,Jenni cost about 10 USD a month currently. In order to be able to charge for PapersGPT it would help to be able to connect it to a free LLM. I have not worked out how to install a LLM into LMStudio but I bet I could do it in a day. If then that would connect to PapersGPT I could be completely open AI independent, and would certainly pay for that privileged.

I am sorry if this is already possible.

Thank you for free PapersGPT in the meantime.

Tim

[papersgpt]

For Mac users, the local LLMs are already built in PapersGPT. Llama 3.2, Phi 4, Gemma 2 and Mistral can be selected. Just one click, the selected open source models will be automatically downloaded and installed, no boring to install LMStudio.
As running LLM needs lots of computing resources, generally it needs extra GPUs on Windows, othersize the experience would not be good, while apple chips are very good at running LLMs, no extra GPUs, so it is the first priority to do it well on Mac for us.
Maybe we will support local LLMs on Windows later.

[timtak]

Thank you.

It is really easy to load a local LMS on windows using LMStudio using a couple of clicks. but my old home PC is too old to run it.

I have a modern Windows PC with a modern GPU at work, so I hope your attention turns in that direction soonish. I guess there are more windows users.

[papersgpt]

Thanks for your feedbak!
Now you can install LMStudio on Windows for yourself, and then configure the local API in PapersGPT, it can work well too.

[timtak]

Thank you very much.

I will probably give it a try if I can get LMStudio running on one of my faster computers. My 15 year old home computer is way to old apparently.