Support connection to open source locally hosted LLMs

[Alias4D]

Reasons : For privacy and no internet connection some time ,

Idea : use local llm like codellama-gguf or TheBloke/Pandalyst-7B-V1.1-GGUF deployed and served locally using transformer or any tool to deploy and host llm locally instead of OpenAI ???

options : :
1 - connect to llm using OpenAI-compatible APIs like openapi client.
2 - connect using hugging face transformer lib or langchain.