Skip to content

Conversation

@aishwaryap
Copy link
Collaborator

This PR demonstrates a sample multi-turn probe. Since the primary value add of multi-turn probes is iteratively adapting the next turn based on the last response, this PR includes a base probe class to simplify this.

Verification

List the steps needed to make sure this thing works

  • Supporting configuration such as generator configuration file
{
    "huggingface": {
        "torch_type": "float32"
    }
}
  • Run the tests and ensure they pass python -m pytest tests/
  • Verify the thing does what it should
  • Verify the thing does not do what it should not
  • Document the thing and how it works (Example)

@aishwaryap aishwaryap marked this pull request as draft August 19, 2025 00:52
@leondz leondz added the probes Content & activity of LLM probes label Sep 16, 2025
@aishwaryap
Copy link
Collaborator Author

Closing this PR since we have decided to make a number of design changes to align with intended implementation style for multi turn probes. Will create a new PR with updated design.

@aishwaryap aishwaryap closed this Oct 2, 2025
@github-actions github-actions bot locked and limited conversation to collaborators Oct 2, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

probes Content & activity of LLM probes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants