Hugging Face's logo

GreenBitAI
/
Qwen3-VL-4B-Instruct-layer-mix-bpw-4.0

Safetensors
qwen3_vl
Model card Files
xet
Community
NicoNico commited on
Commit
713f0b0
·
verified ·
1 Parent(s): b15a824

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. quant_strategy.json +3 -3
quant_strategy.json CHANGED
@@ -601,7 +601,7 @@
601
  },
602
  "q_proj": {
603
  "group_size": {
604
- "2": 64
605
  },
606
  "bits": [
607
  4
@@ -614,7 +614,7 @@
614
  },
615
  "k_proj": {
616
  "group_size": {
617
- "2": 64
618
  },
619
  "bits": [
620
  4
@@ -696,7 +696,7 @@
696
  },
697
  "q_proj": {
698
  "group_size": {
699
- "2": 64
700
  },
701
  "bits": [
702
  4
 
601
  },
602
  "q_proj": {
603
  "group_size": {
604
+ "4": 128
605
  },
606
  "bits": [
607
  4
 
614
  },
615
  "k_proj": {
616
  "group_size": {
617
+ "4": 128
618
  },
619
  "bits": [
620
  4
 
696
  },
697
  "q_proj": {
698
  "group_size": {
699
+ "4": 128
700
  },
701
  "bits": [
702
  4