| --- |
| license: other |
| license_name: flux-non-commercial-license-v2.1 |
| license_link: https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B/blob/main/LICENSE.md |
| base_model: black-forest-labs/FLUX.2-klein-base-9B |
| language: |
| - en |
| - ja |
| pipeline_tag: image-text-to-image |
| tags: |
| - lora |
| - flux |
| - panorama |
| - outpainting |
| - equirectangular |
| - comfyui |
| --- |
| |
| <video controls src="https://i.gyazo.com/748e50cd59976f45acabd7cf39d45bc6.mp4" title="Demo video"></video> |
|
|
| # FLUX.2 Klein 9B 360 ERP Outpaint LoRA |
|
|
| [](https://github.com/nomadoor/ComfyUI-Panorama-Stickers) |
| [](https://huggingface.co/nomadoor/flux-2-klein-4B-360-erp-outpaint-lora) |
| [](./README_ja.md) |
|
|
| This is a LoRA for FLUX.2 Klein 9B that generates 360-degree panoramas. |
|
|
| It uses an approach where reference images are placed on an empty ERP canvas, and the surrounding area is filled by outpainting. This makes it possible to generate panorama images from a flexible layout. |
|
|
| ## Examples |
|
|
| ### Example 1 |
|
|
| | Input | Output | |
| | --- | --- | |
| |  |  | |
|
|
| ### Example 2 |
|
|
| | Input | Output | |
| | --- | --- | |
| |  |  | |
|
|
| ## Usage |
|
|
| 1. Prepare a `2:1` ERP control image with projected reference images placed on a green canvas. |
| 2. Put the trigger words below at the beginning of your prompt. |
| 3. Add any extra prompt text you want after it. |
|
|
| Notes: |
|
|
| - The reference image is expected to be projected into ERP from a **pinhole view** based on its intended panorama placement. |
| - A UI for this workflow is available as a Gradio app / ComfyUI custom node. |
| - [nomadoor/ComfyUI-Panorama-Stickers](https://github.com/nomadoor/ComfyUI-Panorama-Stickers) |
|
|
| ## Trigger Word |
|
|
| ```text |
| Fill the green spaces according to the image. Outpaint as a seamless 360 equirectangular panorama (2:1). Keep the horizon level. Match left and right edges. |
| ``` |
|
|
| ## Recommended Resolution |
|
|
| - Generation: `2048x1024` (2K ERP) |
| - For panorama use, 2K may still look coarse in some cases, so use upscaling if needed |
|
|
| ## Notes |
|
|
| - 🚨Distilled models do not produce good results in most cases. I am still looking for a solution, but for now you should use it with the base model. |
| - Most of the training data is realistic scenery, so non-photoreal domains may be less stable. |
| - Perfect seam matching is still difficult, and some outputs may benefit from post-processing such as inpainting. |
|
|
| ## Training Setup |
|
|
| - [TRAINING_NOTES.md](./TRAINING_NOTES.md) |
|
|
| ## Sample Dataset |
|
|
| - [samples/](https://huggingface.co/nomadoor/flux-2-klein-9B-360-erp-outpaint-lora/tree/main/samples) |
|
|
| ## Workflow |
|
|
| - [flux-2-klein-9B-360-erp-outpaint.json](./workflow/flux-2-klein-9B-360-erp-outpaint.json) |
| - `Upsace_Seam-inpainting (WIP)` |
|
|
| ## License |
|
|
| Please follow the license and usage terms of the base model [`black-forest-labs/FLUX.2-klein-base-9B`](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B). |
| See `LICENSE` included in this folder for additional notes. |
|
|
| ## Support |
|
|
| I ended up spending a bit too much on GPU rentals 🫠 |
| If you would like to support the project, I would really, really appreciate it if you use [☕Ko-fi](https://ko-fi.com/nomadoor) or [❤GitHub Sponsors](https://github.com/sponsors/nomadoor/). |
|
|
