-
Notifications
You must be signed in to change notification settings - Fork 4.2k
Added clarification for contributors who want to run tests #2736
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Added clarification for contributors who want to run tests #2736
Conversation
Disclaimer: This review was made by a crew of AI Agents. Code Review Comment for PR #2736OverviewThis pull request introduces a valuable addition to the Positive Aspects
Suggestions for Improvement
Related Pull RequestsHistorically, enhancements made around the documentation of environment settings have greatly reduced onboarding friction for new contributors. Referencing past contributions can provide insights into effective communication strategies in documentation. Impact Assessment
ConclusionOverall, the changes in this pull request are beneficial and significantly improve the clarity of the documentation. While the current addition is a step in the right direction, I recommend considering the suggested improvements in a follow-up PR to provide an even clearer and more structured guide for contributors. The changes can be merged as is, but incorporating these suggestions will further enhance documentation quality and user experience. |
README.md
Outdated
@@ -553,6 +553,8 @@ pre-commit install | |||
uv run pytest . | |||
``` | |||
|
|||
In addition to **OPENAI_API_KEY** and **SERPER_API_KEY**, you may also want to set **CI=1** in your `.env` file to skip tests that require a local Ollama setup. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I really appreciate it when someone takes the time to suggest a documentation improvement 🙌
- why do you need to set SERPER_API_KEY? I’ve never had to add it before, so I’m curious what scenario you’re leading.
- Regarding CI=1, I'm planning to fix those Ollama tests in the coming days, so I think we can safely drop that part for now. Also, we're still unfortunately skipping some tests when CI is enabled (in which in not the ideal)
I hope to address that soon, but I'd prefer not to encourage using it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just to clarify a few points here: I agree that to make all tasks pass, you need to set CI=1
. However, I don’t think we officially recommend doing that
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You are right, SERPER_API_KEY is not needed. I have updated to only mention OPENAI_API_KEY.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for your collaboration
I tried following the instructions under the "Contribution" section, but ran into quite a few problems when trying to run the tests. It wasn't immediately obvious what the problem was since the test simply got stuck. Later, I realized that I needed to set OPENAI_API_KEY, SERPER_API_KEY, and CI in order to pass all the tests. I think adding this line would make it easier for future new contributors.