CinemaWorld is a generative augmented reality system that augments a viewer's physical surroundings with mixed-reality 3D content extracted from and synchronized with movie scenes. It uses multimodal large language models to analyze films, generative AI to produce dynamic 3D augmentations, and Meta Quest 3 to embed those augmentations into the viewer's environment.
Keiichi Ihara, DaeHo Lee, Manato Abe, Hye-Young Jo, and Ryo Suzuki. 2026. CinemaWorld: Generative Augmented Reality with LLMs and 3D Scene Generation for Movie Augmentation. Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology. ACM.
coming soon