Is num_choices and block size same as gamma for the Speculative decoding? #30
Description
Hi,
Is the hyper parameter num_choices same as gamma from the original Speculative decoding paper?
In your paper, you refer it as block size but the code tells num_choices