-
Notifications
You must be signed in to change notification settings - Fork 570
[PyTorch] Documentation for op fuser API #2447
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Tim Moon <[email protected]>
Signed-off-by: Tim Moon <[email protected]>
Greptile OverviewGreptile SummaryThis PR adds comprehensive documentation for the operation fuser API in Transformer Engine, including a new usage guide and autogenerated API docs.
Confidence Score: 5/5
Important Files ChangedFile Analysis
Sequence DiagramsequenceDiagram
participant User
participant Sequential
participant OperationFuser
participant FusibleOp as FusibleOperation
participant BasicOp as BasicOperation
User->>Sequential: Create with FusibleOperations
User->>Sequential: forward(x)
Sequential->>OperationFuser: Group adjacent ops (first call)
OperationFuser->>FusibleOp: Attempt fusion
FusibleOp->>BasicOp: Access params/state
BasicOp-->>FusibleOp: Return fused result
FusibleOp-->>OperationFuser: Return output
OperationFuser-->>Sequential: Return fused output
Sequential-->>User: Return y
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
19 files reviewed, 1 comment
Signed-off-by: Tim Moon <[email protected]>
Review suggestion from @greptile-apps Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Tim Moon <[email protected]>
|
/te-ci core pytorch |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
19 files reviewed, 4 comments
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Tim Moon <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
19 files reviewed, no comments
Description
This PR adds a basic usage guide for the op fuser and includes it in the autogenerated API docs.
It is ready as-is, but if reviews take a while I may expand it with a guide on creating custom fused ops.
Type of change
Changes
Checklist: