Skip to content

Commit 3e80f9c

Browse files
authored
Merge pull request #1137 from qualcomm/docs/npu-driver-troubleshooting
docs(dx): add NPU driver symlink and hybrid CPU-fallback troubleshooting
2 parents f8dfa0a + 9d2207d commit 3e80f9c

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

docs/en/resources/troubleshooting.mdx

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -116,6 +116,20 @@ import Feedback from "/snippets/page-feedback.mdx";
116116
<Accordion title="Container loads model but inference fails with `Failed to create device: 14001`">
117117
The container can't reach the NPU. Make sure your `docker run` includes `--privileged` and the `/usr/lib` mount, and that the host's Qualcomm driver packages (`qcom-adreno1`, `qcom-fastrpc1`) are installed — see the missing-libraries entry above.
118118
</Accordion>
119+
120+
<Accordion title="`--compute npu` fails with `SDKError(Invalid input parameters or handle)` / `Device 'HTP0' not found`">
121+
The llama.cpp Hexagon backend `dlopen`s the **unversioned** `libcdsprpc.so`, but `qcom-fastrpc1` only ships `libcdsprpc.so.1`. On bare metal `install.sh` creates the symlink; if you deployed the release tarball directly (no `install.sh`), create it yourself:
122+
123+
```bash bash
124+
sudo ln -sf /usr/lib/aarch64-linux-gnu/libcdsprpc.so.1 /usr/lib/aarch64-linux-gnu/libcdsprpc.so
125+
sudo ln -sf /usr/lib/aarch64-linux-gnu/libadsprpc.so.1 /usr/lib/aarch64-linux-gnu/libadsprpc.so
126+
sudo ldconfig
127+
```
128+
</Accordion>
129+
130+
<Accordion title="`--compute hybrid` runs but at CPU speed (silent NPU fallback)">
131+
If the Hexagon driver can't load (see the entry above), `hybrid` still produces correct output — it just runs entirely on CPU, so the failure is silent. Confirm the NPU is actually engaged by running with `GGML_HEX_VERBOSE=1`; you should see `Hexagon Arch version vNN` and a `libggml-htp-vNN.so` session. No such lines means it fell back to CPU.
132+
</Accordion>
119133
</AccordionGroup>
120134

121135
## **Android**

0 commit comments

Comments
 (0)