How to support re-compute kv-cache after certain decoded token

[jiazhan-msft]

I have a feature in my model which switches model setup after certain decoded token, e.g., when decoded to the n-th token, the model requires re-compute previous kv-cache, what's the possible path to enable this support? Thanks!