LLM Pack

A pack for using the LLm models hosted by Cerebras, Groq, and SambNova

this image is outdated by about 3 months, top 3 are faster now

dependencies

'groq'

Installation

API KEYS HERE(Cerebras may be still in devs only, email or reach out to their many media pages.(might hook you up with a key)):
https://cloud.sambanova.ai/apis
https://cloud.cerebras.ai/platform/org_khtphhjfktpfxvvfnwmxy8tp/apikeys
https://console.groq.com/keys
Place KEYS inside the Config files
nodes\cerebras...
nodes\groq...
nodes\Nova...
ComfyUI-Manager (Rec)
Can Download from Comfy Manager
IF using Windows Port version
ComfyUI Folder
cmd
pip install groq
Inside Custom_nodes Folder
git clone https://github.com/Apache0ne/apachellmpack.git
IF using Matrix
Inside venv\Scripts
activate
pip install groq
Inside Custom_nodes Folder
git clone https://github.com/Apache0ne/apachellmpack.git

known issues

Cerebras presets dont work
streaming mode doesnt work in comfy(might one day)

might add

Cerebras thinking and planning support

credit to

MNeMoNiCuZ
for the base groq node