-
Notifications
You must be signed in to change notification settings - Fork 4
Open
Labels
taskNew instruction taskNew instruction task
Description
🚀 The Task
Given a code snippet, the model should be able to trace through the computation to compute the final result or return value. This task ensures the model can semantically execute code.
Example
If I call the following snippet with the value, `x`, what will it return?
<code snippet>
Return:
Additional Notes
NOTE: This may be very difficult to do without CoT.
- Creator: Axel Marmet
- Google Sheets Reference: CarperAI: Instruct-GPT Tasks
Metadata
Metadata
Assignees
Labels
taskNew instruction taskNew instruction task