---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---

## Metrics

| PPL |  arc_easy  |arc_challenge|    piqa    | winogrande | hellaswag  |mmlu|QA Avg|
|----:|------------|-------------|------------|------------|------------|----|-----:|
|22.39|36.11 ± 0.99|21.84 ± 1.21 |60.72 ± 1.14|51.38 ± 1.40|32.73 ± 0.47|-   | 40.56|


Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)

- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1