Skip to content

Commit

Permalink
Wrong default.
Browse files Browse the repository at this point in the history
  • Loading branch information
Narsil committed Jul 4, 2024
1 parent 4aa0642 commit 25c9611
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -162,7 +162,7 @@ def _load_gqa(config, prefix: str, weights):


class FlashGemmaAttention(torch.nn.Module):
def __init__(self, prefix: str, config, weights, causal: bool = True):
def __init__(self, prefix: str, config, weights, causal: bool):
super().__init__()
self.num_heads = config.num_attention_heads
self.head_size = config.head_dim
Expand Down

0 comments on commit 25c9611

Please sign in to comment.