nomadoor's picture
Upload 3 files
3bae5fb verified
|
raw
history blame
2.76 kB

FLUX.2 Klein 9B 360 ERP Outpaint LoRA

ComfyUI Node 4B Model README JA

This is a LoRA for FLUX.2 Klein 9B that generates 360-degree panoramas.

It uses an approach where reference images are placed on an empty ERP canvas, and the surrounding area is filled by outpainting. This makes it possible to generate panorama images from a flexible layout.

Examples

Input Output
example input example output

Usage

  1. Prepare a 2:1 ERP control image with projected reference images placed on a green canvas.
  2. Enter the trigger prompt below at the beginning of your prompt.
  3. Add any extra scene description after the trigger prompt.

Notes:

  • The reference image is expected to be projected into ERP from a pinhole view based on its intended panorama placement.
  • A UI for this workflow is available as a Gradio app / ComfyUI custom node.
  • nomadoor/ComfyUI-Panorama-Stickers

Trigger Prompt

Fill the green spaces according to the image. Outpaint as a seamless 360 equirectangular panorama (2:1). Keep the horizon level. Match left and right edges.

Recommended Resolution

  • Generation: 2048x1024 (2K ERP)
  • For panorama use, 2K may still look coarse in some cases, so use upscaling if needed

Notes

  • 🚨Distilled models do not produce good results in most cases. I am still looking for a solution, but for now you should use it with the base model.
  • Most of the training data is realistic scenery, so non-photoreal domains may be less stable.
  • Perfect seam matching is still difficult, and some outputs may benefit from post-processing such as inpainting.

Training Setup

Workflow

  • simple.json
  • advanced.json (WIP)

License

Please follow the license and usage terms of the base model black-forest-labs/FLUX.2-klein-base-9B. See LICENSE included in this folder for additional notes.

Support

I ended up spending a bit too much on GPU rentals 🫠 If you would like to support the project, I would really, really appreciate it if you use ☕Ko-fi or ❤GitHub Sponsors.