Update README.md
Browse files
README.md
CHANGED
|
@@ -374,8 +374,8 @@ Can I ask a question?<|im_end|>
|
|
| 374 |
<p>As goes the Austral tradition - I trained on another great finetune by Sao, Vulpecula - I trained it as a 16bit R128 lora for 2 epochs, This left a very underfit but promising model, For Winton i KTO'd the model to help with coherency using a mix of instruct/Writing datasets.</p>
|
| 375 |
<div class="metrics-section">
|
| 376 |
<details>
|
| 377 |
-
<summary>Config
|
| 378 |
-
<pre><code>https://wandb.ai/new-eden/austral/artifacts/axolotl-config/config-
|
| 379 |
</details>
|
| 380 |
</div>
|
| 381 |
</div>
|
|
|
|
| 374 |
<p>As goes the Austral tradition - I trained on another great finetune by Sao, Vulpecula - I trained it as a 16bit R128 lora for 2 epochs, This left a very underfit but promising model, For Winton i KTO'd the model to help with coherency using a mix of instruct/Writing datasets.</p>
|
| 375 |
<div class="metrics-section">
|
| 376 |
<details>
|
| 377 |
+
<summary>Config</summary>
|
| 378 |
+
<pre><code>https://wandb.ai/new-eden/austral/artifacts/axolotl-config/config-3dlacmq5/v0/files/axolotl_config_j6uj7id6.yml</code></pre>
|
| 379 |
</details>
|
| 380 |
</div>
|
| 381 |
</div>
|