Skip to content

Commit 12c8f51

Browse files
committed
Chapter 9, added missing variables
The "original_input_ids" and "masked_input_ids" were missing and used to construct a DataFrame
1 parent c0c6965 commit 12c8f51

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

09_few-to-no-labels.ipynb

+5-2
Original file line numberDiff line numberDiff line change
@@ -2702,9 +2702,12 @@
27022702
"inputs = tokenizer(\"Transformers are awesome!\", return_tensors=\"np\")\n",
27032703
"outputs = data_collator([{\"input_ids\": inputs[\"input_ids\"][0]}])\n",
27042704
"\n",
2705+
"original_input_ids = inputs[\"input_ids\"][0]\n",
2706+
"masked_input_ids = outputs[\"input_ids\"][0]\n",
2707+
"\n",
27052708
"pd.DataFrame({\n",
2706-
" \"Original tokens\": tokenizer.convert_ids_to_tokens(inputs[\"input_ids\"][0]),\n",
2707-
" \"Masked tokens\": tokenizer.convert_ids_to_tokens(outputs[\"input_ids\"][0]),\n",
2709+
" \"Original tokens\": tokenizer.convert_ids_to_tokens(original_input_ids),\n",
2710+
" \"Masked tokens\": tokenizer.convert_ids_to_tokens(masked_input_ids),\n",
27082711
" \"Original input_ids\": original_input_ids,\n",
27092712
" \"Masked input_ids\": masked_input_ids,\n",
27102713
" \"Labels\": outputs[\"labels\"][0]}).T"

0 commit comments

Comments
 (0)