Generating 360° Video is What You Need For a 3D Scene

Zhaoyang Zhang1,2, Yannick Hold-Geoffroy1, Miloš Hašan1, Ziwen Chen3, Fujun Luan1 Julie Dorsey2, and Yiwei Hu1
Adobe Research1, Yale University2, Oregon State University3
SIGGRAPH Asia 2025 (Conference Track)
Paper PDF Supp PDF arXiv

Learning from model weights


We present WorldPrompter, a method that generates traversable environments from a text prompt alone (above). Our method first generates a spatially coherent 360° video capture (top) that travels through a static environment described by the prompt. Next, we elevate generated video capture into a 3D Gaussian Splat (middle), enabling free navigation within a 3D scene using a virtual perspective camera to generate novel views (bottom).

Abstract

Generating 3D scenes is still a challenging task due to the lack of readily available scene data. Most existing methods only produce partial scenes and provide limited navigational freedom. We introduce a practical and scalable solution that uses 360° video as an intermediate scene representation, capturing the full-scene context and ensuring consistent visual content throughout the generation. We propose WorldPrompter, a generative pipeline that synthesizes traversable 3D scenes from text prompts. WorldPrompter incorporates a conditional 360° panoramic video generator, capable of producing a 128-frame video that simulates a person walking through and capturing a virtual environment. The resulting video is then reconstructed as Gaussian splats by a fast feedforward 3D reconstructor, enabling a true walkable experience within the 3D scene. Experiments demonstrate that our panoramic video generation model, trained with a mix of image and video data, achieves convincing spatial and temporal consistency for static scenes. This is validated by an average COLMAP matching rate of 94.6%, allowing for high-quality panoramic Gaussian splat reconstruction and improved navigation throughout the scene. Qualitative and quantitative results also show it outperforms the state-of-the-art 360° video generators and 3D scene generation models.

Method

Learning from model weights (top) We train a text-to-video model on a mix of 360° videos and images depicting in-the-wild environments. As it is challenging to avoid the person and camera equipment being visible in the video capture, we mask these elements out of the frame using a pretrained image segmentation model [Adobe 2025], and obtain the prompts from the video frames using LLaVA [Liu et al. 2023b] for the videos, and BLIP-2 [Li et al. 2023a] for images. (bottom) At inference time, a user supplies a text prompt to our text-to-video model, which produces a “walk-through” video of the scene, which we reconstruct into a 3D Gaussian splat representation using Long-LRM [Ziwen et al. 2024].

Freeform 3D Navigation

A cozy cottage surrounded by wildflowers that glow in the moonlight, nestled deep in an enchanted forest.

Open Interactive Viewer here. PLY model here.

A library where each book whispers its own story, and vines gently curl around the spines of ancient tomes.

Open Interactive Viewer here. PLY model here.

A village built inside a giant tree, where the walls are made of living wood and the floors are carpeted with moss.

Open Interactive Viewer here. PLY model here.

A valley where the grass grows in soft, rolling hills, and the sky is always painted in shades of pink and orange.

Open Interactive Viewer here. PLY model here.

A deep space mining station set on a moon surface.

Open Interactive Viewer here. PLY model here.

A desert fortress at sunset with drifting sand clouds.

Open Interactive Viewer here. PLY model here.

A calm Zen rock garden in an ancient monastery courtyard.

Open Interactive Viewer here. PLY model here.

A cramped submarine cafeteria with portholes showing ocean depths.

Open Interactive Viewer here. PLY model here.

A grand cathedral interior with stained-glass windows catching evening light.

Open Interactive Viewer here. PLY model here.

A glacier-capped polar landscape with drifting icebergs.

Open Interactive Viewer here. PLY model here.

Additional Results

A valley where the grass grows in soft, rolling hills, and the sky is always painted in shades of pink and orange.

Open Interactive Viewer here. PLY model here.

A cozy hobbit-style cottage nestled into a grassy hill.

Open Interactive Viewer here. PLY model here.

A glacier-capped polar landscape with drifting icebergs.

Open Interactive Viewer here. PLY model here.

A calm Zen rock garden in an ancient monastery courtyard.

Open Interactive Viewer here. PLY model here.

A cozy cottage surrounded by wildflowers that glow in the moonlight, nestled deep in an enchanted forest.

Open Interactive Viewer here. PLY model here.

A cozy room where the fireplace is fueled by glowing stones and the furniture is made of intricately carved tree trunks.

Open Interactive Viewer here. PLY model here.

A library where each book whispers its own story, and vines gently curl around the spines of ancient tomes.

Open Interactive Viewer here. PLY model here.

A vast desert where the dunes stretch endlessly, bathed in the golden glow of twilight.

Open Interactive Viewer here. PLY model here.

A canyon of smooth red rock where ancient glyphs are carved into its walls, untouched by time.

Open Interactive Viewer here. PLY model here.

A village built inside a giant tree, where the walls are made of living wood and the floors are carpeted with moss.

Open Interactive Viewer here. PLY model here.

A grand ballroom with gilded chandeliers, polished marble floors, and velvet-draped windows.

Open Interactive Viewer here. PLY model here.

A modern apartment with an industrial-chic design, concrete walls, and steel-framed windows.

A candlelit medieval cathedral crypt with carved statues.

A Celtic stone circle on rolling green hills at dawn.

Open Interactive Viewer here. PLY model here.

A cozy living room with floor-to-ceiling windows facing a snowy forest.

Open Interactive Viewer here. PLY model here.

A cramped submarine cafeteria with portholes showing ocean depths.

Open Interactive Viewer here. PLY model here.

A lonely lighthouse standing on a cliff, its beam cutting through the eternal mist of a forgotten sea.

Open Interactive Viewer here. PLY model here.

A sunlit corridor of an ancient castle, where vines creep through shattered stained-glass windows.

Open Interactive Viewer here. PLY model here.

A deep space mining station set on a moon surface.

Open Interactive Viewer here. PLY model here.

A desert fortress at sunset with drifting sand clouds.

Open Interactive Viewer here. PLY model here.

A deserted arctic research station with swirling snow drifts.

Open Interactive Viewer here. PLY model here.

A grand opera house with plush red seats, a golden ceiling, and an opulent velvet curtain drawn back.

Open Interactive Viewer here. PLY model here.

A grand cathedral interior with stained-glass windows catching evening light.

Open Interactive Viewer here. PLY model here.

A snow-covered mountain range where sheer cliffs of ice meet an unbroken horizon.

Open Interactive Viewer here. PLY model here.

A celestial temple where the stars themselves are embedded in the marble columns.

Open Interactive Viewer here. PLY model here.

A Baroque palace interior with golden moldings, high-domed ceilings, and elaborately painted murals.

Open Interactive Viewer here. PLY model here.

A Byzantine church with mosaic-tiled walls, golden domes, and an altar bathed in soft amber light.

Open Interactive Viewer here. PLY model here.

Comparisons

A calm Zen rock garden in an ancient monastery courtyard.

LucidDreamer

DreamScene360

LayerPano3D

Ours

A Celtic stone circle on rolling green hills at dawn.

LucidDreamer

DreamScene360

LayerPano3D

Ours

A cozy hobbit-style cottage nestled into a grassy hill.

LucidDreamer

DreamScene360

LayerPano3D

Ours

A glacier-capped polar landscape with drifting icebergs.

LucidDreamer

DreamScene360

LayerPano3D

Ours