ARM quants notice
Browse files
README.md
CHANGED
|
@@ -19,6 +19,11 @@ Violet_Twilight-v0.2
|
|
| 19 |
|
| 20 |
Use the **ChatML** prompt format. <br>
|
| 21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
> [!TIP]
|
| 23 |
> **Presets:** <br>
|
| 24 |
> You can use ChatML presets within SillyTavern and adjust from there. <br>
|
|
|
|
| 19 |
|
| 20 |
Use the **ChatML** prompt format. <br>
|
| 21 |
|
| 22 |
+
> [!IMPORTANT]
|
| 23 |
+
> **[Added]** <br>
|
| 24 |
+
> ARM quants: <br>
|
| 25 |
+
> `"Q4_0_4_4", "Q4_0_4_8", "Q4_0_8_8"`
|
| 26 |
+
|
| 27 |
> [!TIP]
|
| 28 |
> **Presets:** <br>
|
| 29 |
> You can use ChatML presets within SillyTavern and adjust from there. <br>
|