naomiKenKorem commited on
Commit
600906f
·
verified ·
1 Parent(s): 9fa0ae1

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/sample_0.gif filter=lfs diff=lfs merge=lfs -text
37
+ samples/sample_1.gif filter=lfs diff=lfs merge=lfs -text
38
+ samples/sample_2.gif filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-video
4
+ - image-to-video
5
+ pinned: true
6
+ language:
7
+ - en
8
+ license: other
9
+ pipeline_tag: text-to-video
10
+ library_name: diffusers
11
+ ---
12
+
13
+ # LTXV_13B_LoRA_smpl
14
+
15
+ This is a fine-tuned version of [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors) trained on custom data.
16
+
17
+ ## Model Details
18
+
19
+ - **Base Model:** [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)
20
+ - **Training Type:** LoRA fine-tuning
21
+ - **Training Steps:** 4000
22
+ - **Learning Rate:** 0.0002
23
+ - **Batch Size:** 1
24
+
25
+ ## Sample Outputs
26
+
27
+ | | | | |
28
+ |:---:|:---:|:---:|:---:|
29
+ | ![example1](./samples/sample_0.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>people dancing</details> | ![example2](./samples/sample_1.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a woman talking</details> | ![example3](./samples/sample_2.gif)<br><details style="max-width: 300px; margin: auto;"><summary>Prompt</summary>a man skiing</details> |
30
+
31
+ ## Usage
32
+
33
+ This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
34
+
35
+ ### 🔌 Using Trained LoRAs in ComfyUI
36
+ In order to use the trained lora in comfy:
37
+ 1. Copy your comfyui trained LoRA weights (`comfyui..safetensors` file) to the `models/loras` folder in your ComfyUI installation.
38
+ 2. In your ComfyUI workflow:
39
+ - Add the "LTXV LoRA Selector" node to choose your LoRA file
40
+ - Connect it to the "LTXV LoRA Loader" node to apply the LoRA to your generation
41
+
42
+ You can find reference Text-to-Video (T2V) and Image-to-Video (I2V) workflows in the [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo).
43
+
44
+ ### Example Prompts
45
+
46
+ Example prompts used during validation:
47
+
48
+ - `people dancing`
49
+ - `a woman talking`
50
+ - `a man skiing`
51
+
52
+
53
+
54
+ This model inherits the license of the base model ([`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)).
55
+
56
+ ## Acknowledgments
57
+
58
+ - Base model by [Lightricks](https://huggingface.co/Lightricks)
59
+ - Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)
comfyui_lora_weights_step_04000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f818e9dbd3bd36b0a2d200f7672d3d79b9486891ee5999c3012cd1287570a2b
3
+ size 805412760
lora_weights_step_04000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:477a268c2ff12cbd1654a069817a1af911d701c24def468d2828646599308e92
3
+ size 805409712
samples/sample_0.gif ADDED

Git LFS Details

  • SHA256: bb63a2153ad2bb7e85a95c8e669b7f86a8b7d5663fdc3df173915ac2498784ab
  • Pointer size: 133 Bytes
  • Size of remote file: 16.3 MB
samples/sample_1.gif ADDED

Git LFS Details

  • SHA256: 26b12ce6bdf6852b3d5a9be368835a2244668b55c708dbf7006238003b62768a
  • Pointer size: 133 Bytes
  • Size of remote file: 16.3 MB
samples/sample_2.gif ADDED

Git LFS Details

  • SHA256: 3082b6e614cb35b99597061ea076184d0748048fd209426b3e16539996ffa6e6
  • Pointer size: 132 Bytes
  • Size of remote file: 8.54 MB