Skip to content

Conversation

@stemann
Copy link
Contributor

@stemann stemann commented Mar 12, 2022

Awaiting #4347 and #4602

@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch 2 times, most recently from d9eebee to b2f11bf Compare March 14, 2022 15:25
@stemann
Copy link
Contributor Author

stemann commented Mar 14, 2022

This (and #4604 and #4605) fails due to CUDNN_jll v8.2.1 not having a mapping for CUDA 11.5. @maleadt Should CUDNN v8.2.1 actually have such a mapping?

TensorRT v8.2.1 - v8.2.3 is tested with CUDNN v8.2.1 - and is said to support CUDA 11.5: https://docs.nvidia.com/deeplearning/tensorrt/release-notes/tensorrt-8.html#rel-8-2-1

CUDNN v8.3.2 (and CUDA 11.6) is used for testing TensorRT starting from v8.4.0.

@maleadt
Copy link
Member

maleadt commented Mar 14, 2022

CUDNN 8.2.1 only supports up to CUDA 11.3, I think. Or at least that was the supported release back when that version of CUDNN was released.

@stemann
Copy link
Contributor Author

stemann commented Mar 14, 2022

CUDNN 8.2.1 only supports up to CUDA 11.3, I think. Or at least that was the supported release back when that version of CUDNN was released.

Right: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-824/support-matrix/index.html
v8.2.1 - CUDA 11.3: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-821/support-matrix/index.html
v8.2.2 added CUDA 11.4: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-822/support-matrix/index.html
v8.2.3: No archived support matrix.

So really our CUDNN v8.2.1 should not have built an 11.4, but only 11.3 and then TensorRT v8.2+ must use a newer CUDNN for build when building for CUDA 11.4+ platforms.

@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch 2 times, most recently from d43bb3c to a76bb31 Compare March 18, 2022 01:57
@stemann stemann marked this pull request as ready for review March 18, 2022 01:57
@stemann stemann marked this pull request as draft March 18, 2022 08:27
@ViralBShah ViralBShah closed this Apr 19, 2022
@ViralBShah
Copy link
Member

Superseded by #4604 I suppose.

@stemann
Copy link
Contributor Author

stemann commented Apr 19, 2022

@ViralBShah I know that this and #4604 seemed like stale PR's, but this PR in particular is the only version to support CUDA 10.2 on aarch64-linux-gnu, so can we please reopen this?

I will just check that #4386 can work with this packaging of TensorRT and then get this, #4604 and #4605 merged.

@giordano giordano reopened this Apr 19, 2022
@ViralBShah ViralBShah closed this Jan 13, 2025
@stemann stemann reopened this Apr 26, 2025
@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch from a76bb31 to d99c932 Compare April 26, 2025 06:35
@stemann stemann added the cuda 🕹️ Builders related to Nvidia CUDA label Apr 30, 2025
@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch from d99c932 to d8cb215 Compare May 1, 2025 23:22
@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch from d8cb215 to a101cbd Compare May 1, 2025 23:27
@ViralBShah ViralBShah closed this Aug 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cuda 🕹️ Builders related to Nvidia CUDA

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants