Open
Description
After quantizing the model i am loading model to cuda then this error has come oftenly.
[/home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/ops.py:66](http://13.48.147.30:8001/lab/workspaces/auto-H/tree/LogoMaker/App/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/ops.py#line=65): UserWarning: An exception was raised while calling the optimized kernel for quanto::unpack: /home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/zmq/backend/cython/../../../../.././libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by [/home/ubuntu/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/build/quanto_cuda.so](http://13.48.147.30:8001/lab/workspaces/auto-H/tree/LogoMaker/App/miniconda3/envs/dev-2/lib/python3.12/site-packages/optimum/quanto/library/extensions/cuda/build/quanto_cuda.so)) Falling back to default implementation.
warnings.warn(message + " Falling back to default implementation.")
Metadata
Metadata
Assignees
Labels
No labels