We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 6d9751f commit 7389089Copy full SHA for 7389089
docs/FAQ.md
@@ -23,17 +23,16 @@ docker build -f docker/Dockerfile.vllm -t llm-api:vllm .
23
**`vLLM` 环境需要将 `torch` 版本升级到 `2.0.0` 以上,再安装 `vllm`**
24
25
```shell
26
-pip install -r requirements.txt
27
-pip install torch -U
28
-pip install vllm>=0.1.4
29
-# pip install git+https://github.com/vllm-project/vllm.git
30
-pip uninstall transformer-engine
+pip install torch==2.1.0
+pip install vllm>=0.2.2
+pip install -r requirements.txt
+pip uninstall transformer-engine -y
31
```
32
33
如不需要安装 `vLLM`,则只需要
34
35
36
-pip install torch==1.13
+pip install torch>=1.13
37
pip install -r requirements.txt
38
39
images/llm.png
-92.1 KB
0 commit comments