Update README.md
Browse files
README.md
CHANGED
|
@@ -129,12 +129,10 @@ We recommend using this model with [vLLM](https://github.com/vllm-project/vllm).
|
|
| 129 |
|
| 130 |
#### Installation
|
| 131 |
|
| 132 |
-
Make sure to install
|
| 133 |
|
| 134 |
```
|
| 135 |
-
|
| 136 |
-
--torch-backend=auto \
|
| 137 |
-
--extra-index-url https://wheels.vllm.ai/nightly
|
| 138 |
```
|
| 139 |
|
| 140 |
Doing so should automatically install [`mistral_common >= 1.8.6`](https://github.com/mistralai/mistral-common/releases/tag/v1.8.6).
|
|
@@ -144,7 +142,7 @@ To check:
|
|
| 144 |
python -c "import mistral_common; print(mistral_common.__version__)"
|
| 145 |
```
|
| 146 |
|
| 147 |
-
You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/
|
| 148 |
|
| 149 |
#### Serve
|
| 150 |
|
|
|
|
| 129 |
|
| 130 |
#### Installation
|
| 131 |
|
| 132 |
+
Make sure to install **vllm >= 1.12.0**:
|
| 133 |
|
| 134 |
```
|
| 135 |
+
pip install vllm --upgrade
|
|
|
|
|
|
|
| 136 |
```
|
| 137 |
|
| 138 |
Doing so should automatically install [`mistral_common >= 1.8.6`](https://github.com/mistralai/mistral-common/releases/tag/v1.8.6).
|
|
|
|
| 142 |
python -c "import mistral_common; print(mistral_common.__version__)"
|
| 143 |
```
|
| 144 |
|
| 145 |
+
You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/latest/images/sha256-f2309d913a07da49ea20b2a694703f4cfcb5ad8e7437ec0f26145479ac01e002).
|
| 146 |
|
| 147 |
#### Serve
|
| 148 |
|