Skip to content

Commit 5eb0de4

Browse files
committed
wrestling with pydantic
Summary Signed-off-by: HDCharles <[email protected]>
1 parent 4e96a73 commit 5eb0de4

File tree

1 file changed

+2
-2
lines changed
  • src/llmcompressor/modifiers/smoothquant

1 file changed

+2
-2
lines changed

src/llmcompressor/modifiers/smoothquant/base.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
from dataclasses import dataclass
2-
from typing import Callable, Dict, List, Optional, Sequence, Tuple
2+
from typing import Callable, Dict, List, Optional, Sequence, Tuple, Union
33

44
import torch
55
from compressed_tensors.utils import align_module_device, match_modules_set
@@ -96,7 +96,7 @@ class SmoothQuantModifier(Modifier):
9696
"""
9797

9898
smoothing_strength: float = 0.5
99-
mappings: Optional[List[Sequence[List[str] | str]]] = None
99+
mappings: Optional[List[Union[Tuple, List]]] = None
100100
ignore: Optional[List[str]] = None
101101
num_calibration_steps: Optional[int] = None
102102
calibration_function: Optional[Callable] = None

0 commit comments

Comments
 (0)