rewrite

[nystar1]

cc: @SkyfallWasTaken

[SkyfallWasTaken]

Nice work!

One issue though is that a lot of the Scalar examples don't seem to be properly configured:

[nystar1]

i added the same example from README.txt for /chat/completions, that should do it. i didn't specify any schema for the endpoint because this project is now a true proxy (the only thing we filter is the models field, and we set our own headers for Groq Authorization). should be ready to merge now!

[SkyfallWasTaken]

LGTM!

[elijah629]

uhh do not merge this!!!!!

[elijah629]

use my API defs in #24 if you want to, currently you can do some shifty budget stuff and make each request really fucking expensive! please filter out those params as I did in the /openai folder in #24

[nystar1]

uhh do not merge this!!!!!

context: we also need to filter the service tier filter for less perf load

[nystar1]

uhh yeah so details:

• performance mode isn't documented and probably isn't even available rn(?)
• we can continue not using a strict groq schema. groq provides a way to set model wide limits (if they aren't set in the hackclub groq account already, they should!). operating on a good faith basis has worked well so far
• in the future: we can probably ratelimit unauthenticated requests and introduce an api key system (unlimited ratelimits as long as you link your slack account & are id verified). we can also monitor better this way, we can add automatic flagging for stuff like cursor system prompts etc.

cc: @elijah629. we're good to go again!

[elijah629]

Alright! Is this good to merge and who can merge it?

[nystar1]

fyi: this is technically merged now, but not in this repository.

[Mostlime12195]

there is a major issue that needs to be addressed with this PR, @nystar1, details at #30.