Skip to content

add gemma-2b#387

Merged
mike-ferguson merged 2 commits intomainfrom
add-gemma2b
Mar 9, 2026
Merged

add gemma-2b#387
mike-ferguson merged 2 commits intomainfrom
add-gemma2b

Conversation

@mike-ferguson
Copy link
Member

Add Gemma 2B model plugin + shared HuggingFace auth fixture

Changes

  • New model plugin (brainscore_language/models/gemma/): Registers Google's Gemma 2B via HuggingfaceSubject, mapping the language system to the final transformer layer (model.layers.17, hidden size 2048).
  • Tests (gemma/test.py): Verifies model loading, identifier, neural representations and next-word prediction.
  • Shared auth fixture (brainscore_language/models/conftest.py): Session-scoped pytest fixture that fetches a HuggingFace read token from AWS Secrets Manager (hugging_face_read_token) and logs in automatically. Applies to all model tests. No-ops if HF_TOKEN is already set.

Notes

  • Gemma is a gated model — requires HuggingFace license acceptance and a valid read token.
  • Layer mapping (model.layers.17) is a default choice; can be updated after benchmark-driven layer selection.

@mike-ferguson mike-ferguson added the submission_prepared Attached to a PR is metadata and layer mapping is successful. label Mar 9, 2026
@KartikP KartikP added the OOM label Mar 9, 2026
@mike-ferguson mike-ferguson merged commit 809cfbf into main Mar 9, 2026
17 of 18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

OOM submission_prepared Attached to a PR is metadata and layer mapping is successful.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants