Skip to content

Commit

Permalink
dead code
Browse files Browse the repository at this point in the history
  • Loading branch information
fxmarty committed Jun 7, 2024
1 parent b884d2b commit fb5487d
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions server/text_generation_server/models/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -50,8 +50,6 @@

FLASH_ATT_ERROR_MESSAGE = "{} requires Flash Attention enabled models."

SLIDING_WINDOW_MESSAGE = "The backend {} does not support sliding window attention. TGI webserver was started max_input_tokens={} larger than sliding_window={}. To use this model with the {} backend, please launch TGI with the argument `--max-batch-prefill-tokens` smaller than {}."

FLASH_ATTENTION = True

try:
Expand Down

0 comments on commit fb5487d

Please sign in to comment.