gemma3

Gemma 3

A minimal Gemma 3 270M IT decoder-only implementation in JAX.

Get started

1. Clone the repository

git clone https://github.com/lutzroeder/models

2. Install dependencies

pip install jax jaxlib numpy sentencepiece huggingface_hub

3. Authenticate as Gemma 3 is a gated model

huggingface-cli login

4. Run the model

python models/gemma3/gemma3.py "What is the capital of France?"

The capital of France is Paris.