OverLay++: Dense-Overlap Layout-to-Image Generation Dataset
Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava, Haiyang Xu, Bingnan Li, Xiang Zhang, Ethan J. Armand, Chuan Li, Jianwen Xie, Zhuowen Tu: OverLay++: Dense-Overlap Layout-to-Image Generation Dataset.
Endorsed by
⧉ Cite
APA
BibTeX
📄 Transcript
Dense overlap breaks layout-to-image generation.
Ask an image generator for a crowded scene,
with objects touching and overlapping, and it falls
apart. You can draw boxes and say what
belongs in each one, but once those boxes
pile on top of each other, the picture
breaks down.
An automated pipeline filters photos, then asks a
vision model for boxes that must overlap at
least one neighbour, and writes a detailed description
for every object.
The outcome is images averaging 6.6 objects each,
and methods trained on it show consistent improvement
and faster convergence.
Read the paper for details.
Abstract
Layout-to-Image generation has made substantial progress in spatial and object-level control. However, existing methods still struggle with complex scenes containing many overlapping and interacting objects. We argue that training data is a particular bottleneck: existing datasets lack examples with dense, complex object interactions. To address this gap, we introduce , a large-scale Layout-to-Image dataset with structurally complex scenes. contains approximately 500K images with an average of 6.6 objects per image, exceeding existing datasets by in annotation density. Beyond annotation density, provides rich semantic detail with object captions over six times longer than in current datasets. Our dataset generation pipeline is simple and produces dense, overlapping object annotations with rich per-object captions. Across multiple benchmarks, state-of-the-art Layout-to-Image methods trained on the dataset show consistent improvement and faster convergence, demonstrating the importance of dense, overlap-aware, and caption-rich supervision for controllable image generation.
✓ Claims & sources (7)
Each claim in this video, with the span of the paper it comes from.
Key point Image models can place objects from boxes, but struggle with many overlapping and interacting objects.
However, existing methods still struggle with complex scenes containing many overlapping and interacting objects.
Key point Training data is a particular bottleneck: existing datasets lack dense, complex object interactions.
We argue that training data is a particular bottleneck: existing datasets lack examples with dense, complex object interactions.
Key point Older collections average only 1.78-3.93 objects per image, limiting supervision for dense scenes.
Existing datasets such as LayoutSAM, EliGen, and GRIT average only 1.78-3.93 objects per image, limiting supervision for dense multi-object generation.
Key point An automated pipeline keeps only boxes that overlap at least one other box.
The prompt explicitly requires each box to overlap at least one other box and to be at least 5% of image resolution in width and height.
Key point Each object gets a written description over six times longer than in current datasets.
Beyond annotation density, OverLay++ provides rich semantic detail with object captions over six times longer than in current datasets.
Key point The result is roughly 500K images averaging 6.6 objects per image.
OverLay++ contains approximately 500K images with an average of 6.6 objects per image, exceeding existing datasets in annotation density.
Key point Methods trained on the 6.6-object dataset show consistent improvement and faster convergence across benchmarks.
Across multiple benchmarks, state-of-the-art Layout-to-Image methods trained on the dataset show consistent improvement and faster convergence, demonstrating the importance of dense, overlap-aware, and caption-rich supervision for controllable image generation.