Save size in scalar scratch for bo and bq#1201

rupengliu-meta wants to merge 5 commits intovllm-project:mainvllm-project/tpu-inference:mainfrom

rupengliu-meta:rupliu/k2rupengliu-meta/tpu-inference:rupliu/k2Copy head branch name to clipboard