Skip to content
Discussion options

You must be logged in to vote

The "Next Question Suggestion" button does not itself invoke the large language model when you click it. Instead, the backend generates suggested questions using the configured system model (LLM) right after an answer is produced. These suggestions are then displayed as buttons in the UI. Clicking a suggestion simply sends that pre-generated question as a new message; it does not trigger a new LLM generation for suggestions at that moment. The actual LLM invocation for generating suggestions happens upstream, not on button click. You can see more details in the code and maintainer comments here and here.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose |

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@cuihangrui
Comment options

Answer selected by cuihangrui
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Help
Labels
None yet
1 participant