Skip to content

Issues: NVIDIA/TransformerEngine

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

176 Open 239 Closed
176 Open 239 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

PyPI release is outdated
#1572 opened Mar 13, 2025 by Pedrexus
1
how to use it for tensor?
#1571 opened Mar 13, 2025 by wangli68
1
Activation recomputation should remember quantization recipes
#1568 opened Mar 12, 2025 by kwyss-nvidia
1
Is it necessary to perform layer replacement on te.xx? If not, is it effective to use te.fp8.autocast directly
#1556 opened Mar 11, 2025 by wangli68
2
Install earlier version 1.13
#1553 opened Mar 9, 2025 by velocirraptor23
@ksivaman
3
Context parallelism with MLA
#1552 opened Mar 8, 2025 by SuperCB
@cyanguwa @xrennvidia
4
When I import the package ’transformer_engine.pytorch‘, the error message is as follows
#1541 opened Mar 6, 2025 by wangli68
@ksivaman
1
How can we use te.Linear with weight parallel?
#1532 opened Mar 4, 2025 by zigzagcai
1
Causal mask ignored in DotProductAttention good first issue Good for newcomers
#1524 opened Feb 28, 2025 by anthony-Neo
@KshitijLakhani @phu0ngng
1
How can we integrate the DeepGEMM Fp8 GEMM implementation in TE's block-wise scaling？
#1509 opened Feb 26, 2025 by BolongLin
2
Failed to build transformer-engine
#1506 opened Feb 25, 2025 by sfwu2003
6
Question about the performace of GroupedLinear
#1499 opened Feb 20, 2025 by XLzed
5
Float8Quantizer::create_tensor calculates scale_inv instead of creating an empty buffer performance
#1491 opened Feb 18, 2025 by yaox12
3
qwen1.5-0.5B failed to save model with huggingface transformers bug Something isn't working
#1482 opened Feb 13, 2025 by xinpengzz
2
When flash-attn >2.6.1, use context parallel will cause error
#1467 opened Feb 9, 2025 by south-ocean
@cyanguwa
1
How to set NVTE_FWD/BWD_LAYERNORM_SM_MARGIN?
#1459 opened Feb 5, 2025 by cailun01
1
If no Windows support is planned for 5090 as it wasn't for 4090, pass along to corporate to mention this in advertisement
#1436 opened Jan 29, 2025 by NeedsMoar
4
HF Accelerate FP8 use more gpu memory then FP16 in training LLM
#1429 opened Jan 28, 2025 by Liufeiran123
1
transformer_engine.pytorch.distributed.checkpoint function only works with TE modules, instead of all Callables
#1423 opened Jan 27, 2025 by MaciejBalaNV
Deadline or schedule new update supporting blackwell and fp4?
#1421 opened Jan 24, 2025 by johnnynunez
1
Problem when install transformers_engine with nvcc11.8 and nvcc12.0
#1420 opened Jan 23, 2025 by chwenjun225
3
Questions about accuracy alignment between BF16 and FP8 question Further information is requested
#1419 opened Jan 22, 2025 by zigzagcai
2
Performance Discrepancy in FP8 vs. BF16 Training with NanoGPT
#1416 opened Jan 21, 2025 by wzzll123
2
Plans for block-wise FP8 quantization during training?
#1411 opened Jan 15, 2025 by beccohov
4
Questions on DotProductAttention API Usage in Flash Attention thd Mode
#1409 opened Jan 14, 2025 by pipSu
@cyanguwa
1
ProTip! Find all open issues with in progress development work with linked:pr.