kelseye commited on
Commit
550ca54
·
verified ·
1 Parent(s): 4ae7362

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,22 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/car/image_0_0.jpg filter=lfs diff=lfs merge=lfs -text
37
+ assets/car/image_0_1.jpg filter=lfs diff=lfs merge=lfs -text
38
+ assets/car/image_0_2.jpg filter=lfs diff=lfs merge=lfs -text
39
+ assets/car/image_0_3.jpg filter=lfs diff=lfs merge=lfs -text
40
+ assets/car/image_1_1.jpg filter=lfs diff=lfs merge=lfs -text
41
+ assets/car/image_1_2.jpg filter=lfs diff=lfs merge=lfs -text
42
+ assets/car/image_1_3.jpg filter=lfs diff=lfs merge=lfs -text
43
+ assets/car/image_2_2.jpg filter=lfs diff=lfs merge=lfs -text
44
+ assets/car/image_2_3.jpg filter=lfs diff=lfs merge=lfs -text
45
+ assets/car/image_3_3.jpg filter=lfs diff=lfs merge=lfs -text
46
+ assets/cat/image_0_1.jpg filter=lfs diff=lfs merge=lfs -text
47
+ assets/cat/image_0_2.jpg filter=lfs diff=lfs merge=lfs -text
48
+ assets/cat/image_0_3.jpg filter=lfs diff=lfs merge=lfs -text
49
+ assets/cat/image_1_1.jpg filter=lfs diff=lfs merge=lfs -text
50
+ assets/cat/image_1_2.jpg filter=lfs diff=lfs merge=lfs -text
51
+ assets/cat/image_1_3.jpg filter=lfs diff=lfs merge=lfs -text
52
+ assets/cat/image_2_2.jpg filter=lfs diff=lfs merge=lfs -text
53
+ assets/cat/image_2_3.jpg filter=lfs diff=lfs merge=lfs -text
54
+ assets/cat/image_3_3.jpg filter=lfs diff=lfs merge=lfs -text
.msc ADDED
Binary file (1.8 kB). View file
 
.mv ADDED
@@ -0,0 +1 @@
 
 
1
+ Revision:master,CreatedAt:1754391615
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # LoRA 融合器(FLUX.1-dev)
2
+
3
+ 本模型用于调和多 LoRA 模型同时加载时的互斥关系,防止出现画面崩坏。
4
+
5
+ 细节请参考我们的论文:[AutoLoRA: Automatic LoRA Retrieval and Fine-Grained Gated Fusion for Text-to-Image Generation](https://arxiv.org/abs/2508.02107)
6
+
7
+ **我们仍在优化这一模型,此版本模型在部分 LoRA 上的效果仍不稳定,敬请期待我们后续的更新。**
8
+
9
+ ## 效果展示
10
+
11
+ 提示词:`a cat`
12
+
13
+ ||[LoRA 1](https://modelscope.cn/models/cancel13/cxsk)|[LoRA 2](https://modelscope.cn/models/wy413928499/xuancai2)|[LoRA 3](https://modelscope.cn/models/DiffSynth-Studio/ArtAug-lora-FLUX.1dev-v1)|[LoRA 4](https://modelscope.cn/models/hongyanbujian/JPL)|
14
+ |-|-|-|-|-|
15
+ |[LoRA 1](https://modelscope.cn/models/cancel13/cxsk)|![](./assets/cat/image_0_0.jpg)|![](./assets/cat/image_0_1.jpg)|![](./assets/cat/image_0_2.jpg)|![](./assets/cat/image_0_3.jpg)|
16
+ |[LoRA 2](https://modelscope.cn/models/wy413928499/xuancai2)|![](./assets/cat/image_0_1.jpg)|![](./assets/cat/image_1_1.jpg)|![](./assets/cat/image_1_2.jpg)|![](./assets/cat/image_1_3.jpg)|
17
+ |[LoRA 3](https://modelscope.cn/models/DiffSynth-Studio/ArtAug-lora-FLUX.1dev-v1)|![](./assets/cat/image_0_2.jpg)|![](./assets/cat/image_1_2.jpg)|![](./assets/cat/image_2_2.jpg)|![](./assets/cat/image_2_3.jpg)|
18
+ |[LoRA 4](https://modelscope.cn/models/hongyanbujian/JPL)|![](./assets/cat/image_0_3.jpg)|![](./assets/cat/image_1_3.jpg)|![](./assets/cat/image_2_3.jpg)|![](./assets/cat/image_3_3.jpg)|
19
+
20
+ 提示词:`a car`
21
+
22
+ ||[LoRA 1](https://modelscope.cn/models/cancel13/cxsk)|[LoRA 2](https://modelscope.cn/models/wy413928499/xuancai2)|[LoRA 3](https://modelscope.cn/models/DiffSynth-Studio/ArtAug-lora-FLUX.1dev-v1)|[LoRA 4](https://modelscope.cn/models/hongyanbujian/JPL)|
23
+ |-|-|-|-|-|
24
+ |[LoRA 1](https://modelscope.cn/models/cancel13/cxsk)|![](./assets/car/image_0_0.jpg)|![](./assets/car/image_0_1.jpg)|![](./assets/car/image_0_2.jpg)|![](./assets/car/image_0_3.jpg)|
25
+ |[LoRA 2](https://modelscope.cn/models/wy413928499/xuancai2)|![](./assets/car/image_0_1.jpg)|![](./assets/car/image_1_1.jpg)|![](./assets/car/image_1_2.jpg)|![](./assets/car/image_1_3.jpg)|
26
+ |[LoRA 3](https://modelscope.cn/models/DiffSynth-Studio/ArtAug-lora-FLUX.1dev-v1)|![](./assets/car/image_0_2.jpg)|![](./assets/car/image_1_2.jpg)|![](./assets/car/image_2_2.jpg)|![](./assets/car/image_2_3.jpg)|
27
+ |[LoRA 4](https://modelscope.cn/models/hongyanbujian/JPL)|![](./assets/car/image_0_3.jpg)|![](./assets/car/image_1_3.jpg)|![](./assets/car/image_2_3.jpg)|![](./assets/car/image_3_3.jpg)|
28
+
29
+ ## 推理代码
30
+
31
+ ```shell
32
+ git clone https://github.com/modelscope/DiffSynth-Studio.git
33
+ cd DiffSynth-Studio
34
+ pip install -e .
35
+ ```
36
+
37
+ ```python
38
+ import torch
39
+ from diffsynth.pipelines.flux_image_new import FluxImagePipeline, ModelConfig
40
+
41
+
42
+ pipe = FluxImagePipeline.from_pretrained(
43
+ torch_dtype=torch.bfloat16,
44
+ device="cuda",
45
+ model_configs=[
46
+ ModelConfig(model_id="black-forest-labs/FLUX.1-dev", origin_file_pattern="flux1-dev.safetensors"),
47
+ ModelConfig(model_id="black-forest-labs/FLUX.1-dev", origin_file_pattern="text_encoder/model.safetensors"),
48
+ ModelConfig(model_id="black-forest-labs/FLUX.1-dev", origin_file_pattern="text_encoder_2/"),
49
+ ModelConfig(model_id="black-forest-labs/FLUX.1-dev", origin_file_pattern="ae.safetensors"),
50
+ ModelConfig(model_id="DiffSynth-Studio/LoRAFusion-preview-FLUX.1-dev", origin_file_pattern="model.safetensors"),
51
+ ],
52
+ )
53
+ pipe.enable_lora_magic()
54
+
55
+ pipe.load_lora(
56
+ pipe.dit,
57
+ ModelConfig(model_id="cancel13/cxsk", origin_file_pattern="30.safetensors"),
58
+ hotload=True,
59
+ )
60
+ pipe.load_lora(
61
+ pipe.dit,
62
+ ModelConfig(model_id="DiffSynth-Studio/ArtAug-lora-FLUX.1dev-v1", origin_file_pattern="merged_lora.safetensors"),
63
+ hotload=True,
64
+ )
65
+ image = pipe(prompt="a cat", seed=0)
66
+ image.save("image_fused.jpg")
67
+ ```
assets/car/image_0_0.jpg ADDED

Git LFS Details

  • SHA256: d8053b316281438c641891ab84d6b1103b474d5695a9c8121d269d97f19f8639
  • Pointer size: 131 Bytes
  • Size of remote file: 119 kB
assets/car/image_0_1.jpg ADDED

Git LFS Details

  • SHA256: 08b9fa23b661e537f86f9f9d2884c1c857aa4dcff263ab82852f37be8dc17bf0
  • Pointer size: 131 Bytes
  • Size of remote file: 141 kB
assets/car/image_0_2.jpg ADDED

Git LFS Details

  • SHA256: ff1b46a4a9f19e4eaf16ef37f3c7f5e5dc6cb9e9c533de9c118bce20bf8528b1
  • Pointer size: 131 Bytes
  • Size of remote file: 154 kB
assets/car/image_0_3.jpg ADDED

Git LFS Details

  • SHA256: 888a8599ba6d1d90a32e25da3c82510435ff8799355a67cde9d9c8b04c8960f1
  • Pointer size: 131 Bytes
  • Size of remote file: 158 kB
assets/car/image_1_1.jpg ADDED

Git LFS Details

  • SHA256: 7c054798269d63bd17ac0687260064cd29cdd2c62f62df6cd3a486afaa0f6a80
  • Pointer size: 131 Bytes
  • Size of remote file: 129 kB
assets/car/image_1_2.jpg ADDED

Git LFS Details

  • SHA256: 3b3a949140006efda889f03598e3638a8f3b35761bf62db9e23eabdf64b39591
  • Pointer size: 131 Bytes
  • Size of remote file: 170 kB
assets/car/image_1_3.jpg ADDED

Git LFS Details

  • SHA256: 3a4e0daef7105164d0023ad2444d23fee1cbf314eaf789834e08dc2852f2c80e
  • Pointer size: 131 Bytes
  • Size of remote file: 156 kB
assets/car/image_2_2.jpg ADDED

Git LFS Details

  • SHA256: c28969ee2541e0cf78f79176c92a2c88aba87fcbb668820156fd936d18685cc7
  • Pointer size: 131 Bytes
  • Size of remote file: 183 kB
assets/car/image_2_3.jpg ADDED

Git LFS Details

  • SHA256: da7980f93fe003b39835bbf08db6ecc2ee006fdcb2682b8d57199d9b1e0c8b09
  • Pointer size: 131 Bytes
  • Size of remote file: 165 kB
assets/car/image_3_3.jpg ADDED

Git LFS Details

  • SHA256: 87673a038252454589601ade0c9dba7b96e70b571deb7b1c7d5dc963650334c5
  • Pointer size: 131 Bytes
  • Size of remote file: 155 kB
assets/cat/image_0_0.jpg ADDED
assets/cat/image_0_1.jpg ADDED

Git LFS Details

  • SHA256: 074374f1a1455aaef29f8660102a1e31fba007c14ce383a49ce7a1fcfb2b3ec2
  • Pointer size: 131 Bytes
  • Size of remote file: 159 kB
assets/cat/image_0_2.jpg ADDED

Git LFS Details

  • SHA256: 049113feca4d9ec60364ad54140c9268d1837016f1fdd22de8bc1cc4c7811ef4
  • Pointer size: 131 Bytes
  • Size of remote file: 133 kB
assets/cat/image_0_3.jpg ADDED

Git LFS Details

  • SHA256: 8980e53718543daa89a752473d23fdee4df23d376cc706f77a26a1d8a2d295f9
  • Pointer size: 131 Bytes
  • Size of remote file: 131 kB
assets/cat/image_1_1.jpg ADDED

Git LFS Details

  • SHA256: 10b64a3964fcc2344bf503ead54b585660d28f400dcc7c694f8135c26fefc390
  • Pointer size: 131 Bytes
  • Size of remote file: 143 kB
assets/cat/image_1_2.jpg ADDED

Git LFS Details

  • SHA256: b5218076b6e930571adf3ddb65446689e6a87f4b7a1f523448c534dc1a51052f
  • Pointer size: 131 Bytes
  • Size of remote file: 143 kB
assets/cat/image_1_3.jpg ADDED

Git LFS Details

  • SHA256: a5ba71a3b1a55628f2c14ea7bd60188a2b1ef0868eabc7c8f07375cfed0adbb8
  • Pointer size: 131 Bytes
  • Size of remote file: 146 kB
assets/cat/image_2_2.jpg ADDED

Git LFS Details

  • SHA256: a53d3a085f80ba388761bfa49c25925e9d30fdae4e6cccd51df58e7c7bec1b8b
  • Pointer size: 131 Bytes
  • Size of remote file: 137 kB
assets/cat/image_2_3.jpg ADDED

Git LFS Details

  • SHA256: 340341b8ce5058c21449d94e4c44ac698c082a3001de88d303f46cf2372eb1b5
  • Pointer size: 131 Bytes
  • Size of remote file: 132 kB
assets/cat/image_3_3.jpg ADDED

Git LFS Details

  • SHA256: 9c4c8e300dddc618262daa2766d1f8ac0ce2f19f3f399b915e58ddc4b8ff071c
  • Pointer size: 131 Bytes
  • Size of remote file: 105 kB
configuration.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"framework":"Pytorch","task":"text-to-image-synthesis"}
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9266a522aa452bdde120dc76173f6cc474080a6c7c4d6354efc18131c0d16170
3
+ size 109596256