suzushi commited on
Commit
d7b6c42
·
verified ·
1 Parent(s): 4afae48

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license_name: stabilityai-ai-community
5
+ license_link: LICENSE.md
6
+ library_name: diffusers
7
+ pipeline_tag: text-to-image
8
+ tags:
9
+ - text-to-image
10
+ base_model:
11
+ - suzushi/miso-diffusion-m-1.0
12
+ - stabilityai/stable-diffusion-3.5-medium
13
+ ---
14
+ <div style="display: flex; justify-content: center; gap: 20px; margin-bottom: 20px;">
15
+ <img src="demo1.png" width="400" />
16
+ <img src="demo2.png" width="400" />
17
+ </div>
18
+
19
+
20
+ ## Change in model behavior
21
+ Trained with brand new dataset this time, it might take some time or more epoch before
22
+ the model can properly adapt, please be aware that some older prompts might degrade
23
+ or create some artifact.
24
+
25
+ ## Version History
26
+ | Version | Base Training | Aesthetic Training | Total Epochs |
27
+ |---------|--------------|-------------------|--------------|
28
+ | alpha | 250K images | 0 images | 1 |
29
+ | beta | 160K images | 0 images | 3 |
30
+ | 1.0 | 600k images | 0 images | 2 + (3 from beta) |
31
+ | 1.1 | 710k images | 0 images | 5 |
32
+ | 2.0 | 1.08M images | 0 images | 5 |
33
+ | 2.1 | 1.32M images | 0 images | 5 |
34
+
35
+ ## Training Methodology
36
+
37
+ Training is done on gh200 with 96gb vram, now that prior training shows
38
+ decent results, I am slightly increasing learning rate.
39
+
40
+ Training setting: Adafactor with a batchsize of 40, lr_scheduler: cosine
41
+ SD3.5 Specific setting:
42
+ enable_scaled_pos_embed = true
43
+
44
+ pos_emb_random_crop_rate = 0.2
45
+
46
+ weighting_scheme = "flow"
47
+ learning_rate = 8e-6
48
+
49
+ learning_rate_te1 = 5e-6
50
+
51
+ learning_rate_te2 = 5e-6
52
+
53
+ Train Clip: true, Train t5xxl: false
54
+
55
+ ## Support Me
56
+ At the moment training an epoch cost around 130 dollars. If you like my project please consider supporting me: https://ko-fi.com/suzushi2024
57
+
58
+ Lastly, huge thanks to meg who has been supporting this project, without him this project would not have been possible !