Inference FLOPs #2
Description
Would like to add an arg to determine FLOPs to infer on t tokens for calc_transformer_flops.py
Should be as simple as just turning off the bwd pass
{{ message }}
Would like to add an arg to determine FLOPs to infer on t tokens for calc_transformer_flops.py
Should be as simple as just turning off the bwd pass