RealitySummary is a mixed-reality reading assistant that combines always-on camera access, OCR-based text extraction, and large language models to provide spatial summaries and question answering for printed and digital documents.
Aditya Gunturu, Shivesh Singh Jadon, Nandi Zhang, Morteza Faraji, Jarin Thundathil, Wesley Willett, and Ryo Suzuki. 2025. RealitySummary: Exploring On-Demand Mixed Reality Text Summarization and Question Answering using Large Language Models. Proceedings of the 2025 ACM Symposium on Spatial User Interaction. ACM, New York, NY, USA.
DOI: https://doi.org/10.1145/3694907.3765933
coming soon