Duplicate from Lightricks/LTX-Video-ICLoRA-canny-13b-0.9.7

Co-authored-by: Matan <matanby@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+samples/sample_0.gif filter=lfs diff=lfs merge=lfs -text

LTX-Video-Open-Weights-License-0.X.txt

@@ -0,0 +1,2 @@
+LTX Video ("LTXV") 
+

README.md

@@ -0,0 +1,65 @@
+---
+tags:
+- ltx-video
+- image-to-video
+- text-to-video
+pinned: true
+language:
+- en
+license: other
+pipeline_tag: text-to-video
+library_name: diffusers
+datasets:
+- Lightricks/Canny-Control-Dataset
+base_model:
+- Lightricks/LTX-Video-0.9.7-dev
+---
+
+# LTX Video ICLoRA Canny 13B 0.9.7
+
+This is a canny control model on top of [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors) trained on custom data.
+
+## What is In-Context LoRA (IC LoRA)?
+
+IC LoRA is a method that enables adding video context into the video generation process. This approach allows for video-to-video control on top of the text-to-video model, providing more precise control over the generated content by conditioning the model on reference video frames during inference.
+
+comfy compatible model: [ltxv-097-ic-lora-canny-control-comfyui.safetensors](https://huggingface.co/Lightricks/LTX-Video-ICLoRA-canny-13b-0.9.7/blob/main/ltxv-097-ic-lora-canny-control-comfyui.safetensors)
+
+
+diffusers compatible model:[ltxv-097-ic-lora-canny-control-diffusers.safetensors](https://huggingface.co/Lightricks/LTX-Video-ICLoRA-canny-13b-0.9.7/blob/main/ltxv-097-ic-lora-canny-control-diffusers.safetensors)
+
+## License
+
+For licensing information, please refer to the [LTXV Open Weights License](LTX-Video-Open-Weights-License-0.X.txt).
+## Model Details
+
+- **Base Model:** [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)
+- **Training Type:** IC LoRA training
+- **Learning Rate:** 0.0002
+
+## Sample Outputs
+
+
+| |
+|:---:|
+| ![example1](./samples/sample_0.gif) |
+
+## Usage
+
+This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
+
+### 🔌 Using Trained LoRAs in ComfyUI
+In order to use the trained lora in comfy:
+1. Copy the comfyui trained LoRA weights to the `models/loras` folder in your ComfyUI installation.
+2. Use ic_lora/ic-lora.json from [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo)
+
+
+
+
+## Dataset
+https://huggingface.co/datasets/Lightricks/Canny-Control-Dataset/
+
+## Acknowledgments
+
+- Base model by [Lightricks](https://huggingface.co/Lightricks)
+- Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)

ltxv-097-ic-lora-canny-control-comfyui.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:27b1ab9b529dad0e6c5e2d2a68dbd50062353c89c37c2a0777389e5ff4f17451
+size 81918064

ltxv-097-ic-lora-canny-control-diffusers.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:955e870a063a1eb2a5c4858ad06257faf5e823bd6b6b7eaa8e91444f770498a6
+size 81914224