Use tiktoken to calculate num tokens #1
Description
It looks like the token count is estimated at 20 tokens per line. Better to use tiktoken for more accurate estimate
{{ message }}
It looks like the token count is estimated at 20 tokens per line. Better to use tiktoken for more accurate estimate