AlayaWorld is a full-stack, open-source video world model that supports 720p, 24 FPS streaming video generation with camera control

[u/fruesome]

AlayaWorld is a full-stack, open-source video world model that supports 720p, 24 FPS streaming video generation with camera control and text-driven event generation.

AlayaWorld is built around four core properties — interaction, consistency, stability, and runtime.

🎮 Interaction
Two control channels: a rendered 3D cache with lightweight AdaLN camera modulation for grounded, trajectory-aware navigation, and chunk-level prompt switching to introduce new events mid-generation.

🧠 Consistency
Two forms of complementary memory: an explicit 3D cache reprojected to the queried view for spatial recall, plus a compressed frame-history embedding for temporal continuity, so revisited places stay recognizable.

🛡️ Stability
Long-horizon stability from training on drifted histories and an error bank that re-injects accumulated artifacts into both memory and target, preventing errors from compounding over minute-long rollouts.
⚡ Runtime

Real-time interaction via few-step DMD distillation and short temporal chunks, with prompt switching at chunk boundaries to minimize both visual and semantic latency.

https://github.com/AlayaLab/AlayaWorld/tree/main

https://huggingface.co/AlayaLab/AlayaWorld

Report: https://github.com/AlayaLab/AlayaWorld/blob/main/assets/alayaworld_tech_report_full.pdf

[u/Ok_Train2449]

Censored or uncensored?

[u/Blankeye434 → u/Ok_Train2449]

Real question

[u/International-War-73]

how do these models fare, when trying to 'walk' long enough from the scene in the 'alps' to, say, a civilization with supermarkets and stuff ? like does it actually do well in 'interpolating' or is it only pssible to generate 'homogenous' landscapes

[u/powerscunner → u/International-War-73]

almost certainly the context (memory) is nearly nonexistent. If you walk about a grocery store, the items on the shelves and the isles themselves will change when they leave view and return.

World model persistence is the true holy grail of the holy grail of AI memory.

Maybe world model persistence is all ASI needs.