Skip to content

Commit 24e1dc9

Browse files
committed
add docstring
Signed-off-by: Kyle Sayers <[email protected]>
1 parent 80ceffa commit 24e1dc9

File tree

1 file changed

+4
-4
lines changed
  • src/llmcompressor/modifiers/transform/quip

1 file changed

+4
-4
lines changed

src/llmcompressor/modifiers/transform/quip/base.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -32,18 +32,18 @@ class QuIPModifier(Modifier):
3232
3333
Lifecycle:
3434
- on_initialize
35-
- infer SpinQuantMappings & NormMappings
36-
- as needed, create transform schemes for R1, R2, R3, & R4
35+
- as needed, create transform schemes for V (input) and U (output)
3736
- on_start
38-
- normalize embeddings
39-
- fuse norm layers into subsequent Linear layers
4037
- apply TransformConfig
4138
- fuse transforms into weights for mergeable transforms
4239
- add hooks for online transforms
4340
- on sequential epoch end
4441
- on_end
4542
- on_finalize
4643
44+
:param rotations: which rotation schemes to apply to the model. Including `"v"` will
45+
rotate the input side of weights, and including `"u"` will rotate the output
46+
side of weights (note that v does not require u and vice-versa)
4747
:param transform_type: The type of transform to apply to the model.
4848
`"hadamard"` has the least performance cost but only supports sizes which are
4949
powers of power of two.

0 commit comments

Comments
 (0)