all of them are easy fix, i haven't gotten to it yet (and im not even sure if they are a problem)
- Make sure ROME calculation is not divided by near-0 (this might be problem in optimizer)
- our optimization.py assumes that tokenizer has right padding (if tokenizer has left padding something bad might or might not happen)
all of them are easy fix, i haven't gotten to it yet (and im not even sure if they are a problem)