Skip to content

add phi-2 model plugin#388

Merged
mike-ferguson merged 2 commits intomainfrom
add-phi-2
Mar 11, 2026
Merged

add phi-2 model plugin#388
mike-ferguson merged 2 commits intomainfrom
add-phi-2

Conversation

@mike-ferguson
Copy link
Member

Summary

  • Adds a new Brain-Score language model plugin for Microsoft's Phi-2 (microsoft/phi-2), a 2.7B parameter causal language model with 32 transformer layers and hidden size 2560.
  • Follows the same structure as the existing Gemma plugin, registering the model via HuggingfaceSubject with the last transformer layer (model.layers.31) mapped to the language system.
  • Includes tests for model loading, identifier check, neural representation shape, and next-word prediction.

Test plan

  • pytest brainscore_language/models/phi2/test.py -m memory_intense passes all four tests
  • Model loads successfully with a valid HuggingFace token
  • Neural recording returns representations with 2560 neuroid dimensions

@mike-ferguson mike-ferguson added the submission_prepared Attached to a PR is metadata and layer mapping is successful. label Mar 10, 2026
@mike-ferguson
Copy link
Member Author

Tests fail due to OOM. Pass locally, so scoring will continue

@mike-ferguson mike-ferguson merged commit f97a047 into main Mar 11, 2026
10 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

submission_prepared Attached to a PR is metadata and layer mapping is successful.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant