Update README.md
Browse files
README.md
CHANGED
|
@@ -20,14 +20,14 @@ base_model: Qwen/Qwen-VL-Chat-Int4
|
|
| 20 |
- **Developed by:** Agora Research
|
| 21 |
- **Model type:** Vision Language Model
|
| 22 |
- **Language(s) (NLP):** English/Chinese
|
| 23 |
-
- **Finetuned from model
|
| 24 |
|
| 25 |
### Model Sources [optional]
|
| 26 |
|
| 27 |
<!-- Provide the basic links for the model. -->
|
| 28 |
|
| 29 |
- **Repository:** https://github.com/QwenLM/Qwen-VL
|
| 30 |
-
- **Paper
|
| 31 |
|
| 32 |
## Uses
|
| 33 |
```
|
|
@@ -47,7 +47,7 @@ model = AutoPeftModelForCausalLM.from_pretrained(
|
|
| 47 |
trust_remote_code=True
|
| 48 |
).eval()
|
| 49 |
```
|
| 50 |
-
# Specify hyperparameters for generation (if transformers < 4.32.0)
|
| 51 |
```
|
| 52 |
#model.generation_config = GenerationConfig.from_pretrained("Qwen/Qwen-VL-Chat", trust_remote_code=True)
|
| 53 |
|
|
@@ -117,7 +117,7 @@ Just send an image and put [FUNCTION CALL] in the text. Can also be used for nor
|
|
| 117 |
|
| 118 |
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
| 119 |
|
| 120 |
-
|
| 121 |
|
| 122 |
## How to Get Started with the Model
|
| 123 |
```
|
|
@@ -136,13 +136,6 @@ https://huggingface.co/datasets/AgoraX/OpenImage-FNCall-50k
|
|
| 136 |
|
| 137 |
qlora for 1 epoch, 1000 steps
|
| 138 |
|
| 139 |
-
### Results
|
| 140 |
-
|
| 141 |
-
[More Information Needed]
|
| 142 |
-
|
| 143 |
-
#### Summary
|
| 144 |
-
|
| 145 |
-
|
| 146 |
### Framework versions
|
| 147 |
|
| 148 |
- PEFT 0.7.1
|
|
|
|
| 20 |
- **Developed by:** Agora Research
|
| 21 |
- **Model type:** Vision Language Model
|
| 22 |
- **Language(s) (NLP):** English/Chinese
|
| 23 |
+
- **Finetuned from model:** Qwen-VL
|
| 24 |
|
| 25 |
### Model Sources [optional]
|
| 26 |
|
| 27 |
<!-- Provide the basic links for the model. -->
|
| 28 |
|
| 29 |
- **Repository:** https://github.com/QwenLM/Qwen-VL
|
| 30 |
+
- **Paper:** https://arxiv.org/pdf/2308.12966.pdf
|
| 31 |
|
| 32 |
## Uses
|
| 33 |
```
|
|
|
|
| 47 |
trust_remote_code=True
|
| 48 |
).eval()
|
| 49 |
```
|
| 50 |
+
# Specify hyperparameters for generation (generation_config if transformers < 4.32.0)
|
| 51 |
```
|
| 52 |
#model.generation_config = GenerationConfig.from_pretrained("Qwen/Qwen-VL-Chat", trust_remote_code=True)
|
| 53 |
|
|
|
|
| 117 |
|
| 118 |
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
| 119 |
|
| 120 |
+
(recommended) transformers >= 4.32.0
|
| 121 |
|
| 122 |
## How to Get Started with the Model
|
| 123 |
```
|
|
|
|
| 136 |
|
| 137 |
qlora for 1 epoch, 1000 steps
|
| 138 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 139 |
### Framework versions
|
| 140 |
|
| 141 |
- PEFT 0.7.1
|