Inference using beam search

[akskuchi]

Hello,

Thank you for your work!

I am trying to run inference using Beam Search on the VIST test set, using a model checkpoint. However, the infer_task1_beam function does not work throwing several runtime exceptions related to the run_token() function.

Could you please confirm if you have also used a different utility (besides the one in your code) for performing beam search based sampling?