Skip to content

Commit 360afee

Browse files
committed
fix: apply black formatting to hybrid callables
Signed-off-by: Yan Xu <yxu1@nvidia.com>
1 parent d5c6507 commit 360afee

1 file changed

Lines changed: 1 addition & 3 deletions

File tree

‎megatron/core/models/hybrid/fine_grained_callables.py‎

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -233,9 +233,7 @@ def _run_moe_combine(layer, node: ScheduleNode, output: Tensor):
233233
output = off_interface.group_commit(
234234
output, name="mlp_norm", forced_released_tensors=[residual]
235235
)
236-
output = make_viewless_tensor(
237-
inp=output, requires_grad=output.requires_grad, keep_graph=True
238-
)
236+
output = make_viewless_tensor(inp=output, requires_grad=output.requires_grad, keep_graph=True)
239237

240238
node.layer_state.residual.record_stream(torch.cuda.current_stream())
241239
if shared_expert_output is not None:

0 commit comments

Comments
 (0)