deep-ignorance-cb-sft-ret2-rm10-orth5
Unlearned model using orthogonal circuit breakers (SFT, full-rank).
Base model: EleutherAI/deep-ignorance-unfiltered
Training hyperparameters
| Parameter | Value |
|---|---|
| Algorithm | Orth Circuit Breakers |
| Mode | SFT (full-rank) |
| retain_coef | 2 |
| remove_coef | 10 |
| orth_coef | 5 |
| Learning rate | 1e-4 |
Evaluation results
| Benchmark | Accuracy |
|---|---|
| WMDP Bio Robust | 0.2903 |
| MMLU | 0.4440 |
- Downloads last month
- 38
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for EleutherAI/deep-ignorance-cb-sft-ret2-rm10-orth5
Unable to build the model tree, the base model loops to the model itself. Learn more.