Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rerankers and llama-cpp-python version issue #113

Open
ThomasDelsart opened this issue Mar 21, 2025 · 0 comments
Open

Rerankers and llama-cpp-python version issue #113

ThomasDelsart opened this issue Mar 21, 2025 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@ThomasDelsart
Copy link
Contributor

Rerankers package issue

I am using the Cohere API inside Raglite.
During the process and with correct configuration of the reranker, the rerankers package throws an error.
We are using as part of raglite the version 0.8.0 for the rerankers package (see uv.lock). This issue from the rerankers package is the one that happened for me: AnswerDotAI/rerankers#59. It was issued 1 month ago and it is worked on currently.

The immediate solution is to downgrade rerankers from 0.8.0 to 0.6.1 (tested successfully with Cohere) such that API-based rerankers work smoothly inside Raglite. This should be done inside pyproject.toml.

Note: I ran the following commands to list all versions of the package: $ pip index versions rerankers
Available versions: 0.8.0, 0.7.1, 0.7.0, 0.6.1, 0.6.0, 0.5.3, 0.5.2.post1, 0.5.2, 0.5.1, 0.5.0, 0.4.0, 0.3.1, 0.3.0, 0.2.0, 0.1.2.post1, 0.1.2, 0.1.1, 0.1.0.post1, 0.1.0, 0.0.2.post1, 0.0.2, 0.0.1.post2, 0.0.1.post1, 0.0.1

0.8.0, 0.7.1, 0.7.0 all have the issues mentioned above, so 0.6.1 is the first we can use.

Llama-cpp-python package issue

When installing everything automatically via uv, it tries to install llama-cpp-python versin 0.3.8. It raises issues on my project. Installing version 0.3.2 worked for me. This should be done inside pyproject.toml.

@ThomasDelsart ThomasDelsart added the bug Something isn't working label Mar 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants