Feature circuits#1

Open

noanabeshima wants to merge 27 commits intomainfrom

feature-circuits

Commits on Jul 5, 2024

Commits on Jul 7, 2024

Commits on Jul 8, 2024

fixes around error grads and added option to disable flashattn to the forward pass of TinyModel (because it causes issues with jacrev)
noanabeshima
committed
disable flashattn code
noanabeshima
committed

Commits on Jul 9, 2024

Commits on Jul 12, 2024

changes
noanabeshima
committed

Commits on Jul 16, 2024

Commits on Jul 26, 2024