The API of the repo allows benchmarking accuracy of many optimization backends including:
I suggest creating examples for all four backends and demonstrating capabilities. We can also do a comparison and publish in readme.
You can use optimized versions of llama-7B from here: https://huggingface.co/TheBloke
The API of the repo allows benchmarking accuracy of many optimization backends including:
I suggest creating examples for all four backends and demonstrating capabilities. We can also do a comparison and publish in readme.
You can use optimized versions of llama-7B from here: https://huggingface.co/TheBloke