Skip to content

Conversation

@yitianlian
Copy link
Contributor

Motivation

This pull request addresses the issue of errors occurring when an abort request is returned without a logp value.

Modifications

  1. Added a logp key to the abort request output.
  2. Implemented a check for the presence of the logp key before returning the output.

Accuracy Tests

No additional checks are required as this fix does not affect the model outputs.

Benchmarking and Profiling

No impact on inference speed, so benchmarking and profiling are not needed.

Checklist

@gemini-code-assist
Copy link
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant