Add token counts, timestamps, and model to rollouts #1583
+265
−10
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
All contributors have signed the CLA ✍️ ✅ |
bl-ue
force-pushed
the
enhance-recorded-chat-history-071525
branch
from
30edd03 to
9bf17f4
Compare
|
I have read the CLA Document and I hereby sign the CLA |
…ecorded-chat-history-071525
|
Ready for review. |
…rollout files This ensures that the metadata is updated as well as the contents, so that file watchers can get immediate updates.
|
Hi @bolinfest! This PR adds token, timestamp, and model information to rollout files. This enables our new tool, Splitrail, to track token usage, cost, and throughput for Codex users. It also makes it easier for other tools to do the same. Do you mind taking a look? Thank you! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds per-message token count info and timestamps and per-chat selected model info to the rollout JSONL files. Note that this change is only in the Rust version; I didn't add this information to the TypeScript version's JSON rollout files, but I can if desired.
I'm now going to finish implementing Codex support in Splitrail.
Related: #1572