Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- Wan-AI/Wan2.1-T2V-14B
|
| 4 |
+
tags:
|
| 5 |
+
- text-to-video
|
| 6 |
+
- lora
|
| 7 |
+
widget:
|
| 8 |
+
- text: >-
|
| 9 |
+
"walgro style. A couple sits on a cozy balcony, overlooking a quiet, moonlit cityscape. The woman leans into the man's chest, her hand resting gently on his. She wears a flowing silk robe in a soft lavender hue, the fabric catching the light from the candles surrounding them. Her long, auburn hair cascades down her back, and her delicate fingers intertwine with his. The man, dressed in a loose button-up shirt, his sleeves rolled up, has his arm wrapped around her waist. He gently brushes his lips against her forehead, his eyes closed in contentment. The soft hum of the city below contrasts with the peaceful intimacy they share, and they both smile quietly as the night deepens."
|
| 10 |
+
output:
|
| 11 |
+
url: assets/singles_00001.mp4
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# wan 2.2 (14b T2V)
|
| 15 |
+
|
| 16 |
+
<Gallery />
|
| 17 |
+
|
| 18 |
+
## Description:
|
| 19 |
+
**Trainig details:**
|
| 20 |
+
Trained only on videos.
|
| 21 |
+
|
| 22 |
+
### HIGH noise LoRA
|
| 23 |
+
- dataset: 30 videos 480x270 25,33,65,81 frame videos
|
| 24 |
+
- steps: 2130
|
| 25 |
+
- LR: 5e-5
|
| 26 |
+
- optimizer: AdamW Optimi
|
| 27 |
+
- rank: 32
|
| 28 |
+
- batch size: 1
|
| 29 |
+
- gradient accumulation steps: 1
|
| 30 |
+
- min_t = 0.875
|
| 31 |
+
- max_t = 1
|
| 32 |
+
|
| 33 |
+
### LOW noise LoRA
|
| 34 |
+
- dataset: 42 videos 640x360 25,33,65 frame videos
|
| 35 |
+
- steps: 2730
|
| 36 |
+
- LR: 5e-5
|
| 37 |
+
- optimizer: AdamW Optimi
|
| 38 |
+
- rank: 32
|
| 39 |
+
- batch size: 1
|
| 40 |
+
- gradient accumulation steps: 1
|
| 41 |
+
- min_t = 0
|
| 42 |
+
- max_t = 0.875
|
| 43 |
+
|
| 44 |
+
For training I used the diffusion-pipe repo.
|
| 45 |
+
|
| 46 |
+
## Inference
|
| 47 |
+
For inference I used ComfyUI.
|
| 48 |
+
|
| 49 |
+
The strength of the LoRA can differ from prompt to prompt. As best practice, I suggest always checking the high model inference and adjusting the high noise LoRA strength or the steps accordingly. Mostly it is optimal when the character features are just beggining to appear in the high model inference, but aren't prominent yet.
|
| 50 |
+
|
| 51 |
+
**Trigger words**: Nfj1nx, blue hair
|
| 52 |
+
|
| 53 |
+
**Strength**: 0.6-1.2
|
| 54 |
+
|
| 55 |
+
|
| 56 |
+
|
| 57 |
+
Important Notes:
|
| 58 |
+
This LoRA is created as part of a fan project for research purposes only and is not intended for commercial use. It is based on the movies, which are protected by copyright. Users utilize the model at their own risk. Users are obligated to comply with copyright laws and applicable regulations. The model has been developed for non-commercial purposes, and it is not my intention to infringe on any copyright. I assume no responsibility for any damages or legal consequences arising from the use of the model.
|