cgus commited on
Commit
4dfe152
·
verified ·
1 Parent(s): ccbb5e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: mit
3
- library_name: transformers
4
  datasets:
5
  - AI-MO/NuminaMath-CoT
6
  - KbsdJames/Omni-MATH
@@ -9,10 +9,24 @@ datasets:
9
  language:
10
  - en
11
  base_model:
12
- - deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
13
  pipeline_tag: text-generation
14
  ---
 
 
 
 
15
 
 
 
 
 
 
 
 
 
 
 
16
  <div align="center">
17
  <span style="font-family: default; font-size: 1.5em;">DeepScaleR-1.5B-Preview</span>
18
  <div>
 
1
  ---
2
  license: mit
3
+ library_name: exllamav2
4
  datasets:
5
  - AI-MO/NuminaMath-CoT
6
  - KbsdJames/Omni-MATH
 
9
  language:
10
  - en
11
  base_model:
12
+ - agentica-org/DeepScaleR-1.5B-Preview
13
  pipeline_tag: text-generation
14
  ---
15
+ # DeepScaleR-1.5B-Preview-exl2
16
+ Original model: [DeepScaleR-1.5B-Preview](https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview) by [Agentica](https://huggingface.co/agentica-org)
17
+ Based on: [DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) by [DeepSeek](https://huggingface.co/deepseek-ai)
18
+ Foundation model: [Qwen2.5-1.5B](https://huggingface.co/Qwen/Qwen2.5-1.5B) by [Qwen](https://huggingface.co/Qwen)
19
 
20
+ ## Quants
21
+ [4bpw h6 (main)](https://huggingface.co/cgus/DeepScaleR-1.5B-Preview-exl2/tree/main)
22
+ [4.5bpw h6](https://huggingface.co/cgus/DeepScaleR-1.5B-Preview-exl2/tree/4.5bpw-h6)
23
+ [5bpw h6](https://huggingface.co/cgus/DeepScaleR-1.5B-Preview-exl2/tree/5bpw-h6)
24
+ [6bpw h6](https://huggingface.co/cgus/DeepScaleR-1.5B-Preview-exl2/tree/6bpw-h6)
25
+ [8bpw h8](https://huggingface.co/cgus/DeepScaleR-1.5B-Preview-exl2/tree/8bpw-h8)
26
+ ## Quantization notes
27
+ Made with Exllamav2 0.2.8 with default dataset.
28
+ These quants can be used with TabbyAPI or Text-Generation-WebUI and require RTX GPU (Windows) or RTX/ROCm (Linux).
29
+ # Original model card
30
  <div align="center">
31
  <span style="font-family: default; font-size: 1.5em;">DeepScaleR-1.5B-Preview</span>
32
  <div>