How to get the token usage in AskAsync #919
-
|
We are using AskAsync and its performing well. Is it possible with the current SDK to get the usage of tokens both the embedding and the chat ones involved in this. It would be really helpful for tracking the overall spend |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
|
There is a PR for this: #872. It requires some more work, I hope to finish it during the next week. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you this would be an awesome feature |
Beta Was this translation helpful? Give feedback.
-
|
@akozhikkot Feature released, see KM version 0.96+ |
Beta Was this translation helpful? Give feedback.
There is a PR for this: #872. It requires some more work, I hope to finish it during the next week.