ScholarReels The scholarly index and repository for research videos.

Back to ScholarReels

Research Short ★ Q1/Q2 · A*/A venue Other

OverLay++: Dense-Overlap Layout-to-Image Generation Dataset

Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava, Haiyang Xu, Bingnan Li, Xiang Zhang, Ethan J. Armand, Chuan Li, Jianwen Xie, Zhuowen Tu: OverLay++: Dense-Overlap Layout-to-Image Generation Dataset.

⧉ Cite

APA

BibTeX

📄 Transcript

Dense overlap breaks layout-to-image generation.

Ask an image generator for a crowded scene,

with objects touching and overlapping, and it falls

apart. You can draw boxes and say what

belongs in each one, but once those boxes

pile on top of each other, the picture

breaks down.

An automated pipeline filters photos, then asks a

vision model for boxes that must overlap at

least one neighbour, and writes a detailed description

for every object.

The outcome is images averaging 6.6 objects each,

and methods trained on it show consistent improvement

and faster convergence.

Read the paper for details.

Abstract

Layout-to-Image generation has made substantial progress in spatial and object-level control. However, existing methods still struggle with complex scenes containing many overlapping and interacting objects. We argue that training data is a particular bottleneck: existing datasets lack examples with dense, complex object interactions. To address this gap, we introduce , a large-scale Layout-to-Image dataset with structurally complex scenes. contains approximately 500K images with an average of 6.6 objects per image, exceeding existing datasets by in annotation density. Beyond annotation density, provides rich semantic detail with object captions over six times longer than in current datasets. Our dataset generation pipeline is simple and produces dense, overlapping object annotations with rich per-object captions. Across multiple benchmarks, state-of-the-art Layout-to-Image methods trained on the dataset show consistent improvement and faster convergence, demonstrating the importance of dense, overlap-aware, and caption-rich supervision for controllable image generation.

✓ Claims & sources (7)

Each claim in this video, with the span of the paper it comes from.

Key point Image models can place objects from boxes, but struggle with many overlapping and interacting objects.

However, existing methods still struggle with complex scenes containing many overlapping and interacting objects.

Key point Training data is a particular bottleneck: existing datasets lack dense, complex object interactions.

We argue that training data is a particular bottleneck: existing datasets lack examples with dense, complex object interactions.

Key point Older collections average only 1.78-3.93 objects per image, limiting supervision for dense scenes.

Existing datasets such as LayoutSAM, EliGen, and GRIT average only 1.78-3.93 objects per image, limiting supervision for dense multi-object generation.

Key point An automated pipeline keeps only boxes that overlap at least one other box.

The prompt explicitly requires each box to overlap at least one other box and to be at least 5% of image resolution in width and height.

Key point Each object gets a written description over six times longer than in current datasets.

Beyond annotation density, OverLay++ provides rich semantic detail with object captions over six times longer than in current datasets.

Key point The result is roughly 500K images averaging 6.6 objects per image.

OverLay++ contains approximately 500K images with an average of 6.6 objects per image, exceeding existing datasets in annotation density.

Key point Methods trained on the 6.6-object dataset show consistent improvement and faster convergence across benchmarks.

Across multiple benchmarks, state-of-the-art Layout-to-Image methods trained on the dataset show consistent improvement and faster convergence, demonstrating the importance of dense, overlap-aware, and caption-rich supervision for controllable image generation.
Share on X LinkedIn Facebook WhatsApp Email
Comments (0)

No comments yet.

Sign in to comment.