-
Notifications
You must be signed in to change notification settings - Fork 19
Open
Description
reference
https://openrouter.ai/announcements/reasoning-tokens-for-thinking-models
The example works well, how ever when using Chinses as question input the output is always '\n\n'
reasoning_response.json()['choices'][0]['message']['reasoning']
# output: '\n\n'
the example question "Which is bigger: 9.11 or 9.9?" in Chinese is "9.11和9.9哪个大?"
Meta data from activity page
Chinese
note : "native_tokens_reasoning": 2,
{
"data": {
"id": "gen-1738379560-QA7bKGLbRoJQjDDkkStL",
"upstream_id": "chatcmpl-528bec048e3a41ccab1fa07c50386670",
"total_cost": 0.00174255,
"cache_discount": null,
"provider_name": "DeepInfra",
"created_at": "2025-02-01T03:14:24.047081+00:00",
"model": "deepseek/deepseek-r1",
"app_id": null,
"streamed": true,
"cancelled": false,
"latency": 678,
"moderation_latency": null,
"generation_time": 102338,
"tokens_prompt": 68,
"tokens_completion": 926,
"native_tokens_prompt": 45,
"native_tokens_completion": 712,
"native_tokens_reasoning": 2,
"num_media_prompt": null,
"num_media_completion": null,
"num_search_results": null,
"origin": "",
"is_byok": false,
"finish_reason": "stop",
"native_finish_reason": "stop",
"usage": 0.00174255
}
English
All good
{
"data": {
"id": "gen-1738379159-SLN89jeib4fbptNYJyMp",
"upstream_id": "chatcmpl-3aa2a0cd7e7844429401d48915965e65",
"total_cost": 0.0012828,
"cache_discount": null,
"provider_name": "DeepInfra",
"created_at": "2025-02-01T03:07:14.278309+00:00",
"model": "deepseek/deepseek-r1",
"app_id": null,
"streamed": true,
"cancelled": false,
"latency": 696,
"moderation_latency": null,
"generation_time": 73577,
"tokens_prompt": 44,
"tokens_completion": 514,
"native_tokens_prompt": 40,
"native_tokens_completion": 522,
"native_tokens_reasoning": 517,
"num_media_prompt": null,
"num_media_completion": null,
"num_search_results": null,
"origin": "",
"is_byok": false,
"finish_reason": "stop",
"native_finish_reason": "stop",
"usage": 0.0012828
}
}
The bug is reproducible for any Chinese question not limited to the specific one. "人生的意义是什么?"
Metadata
Metadata
Assignees
Labels
No labels