RealitySummary: Exploring On-Demand Mixed Reality Text Summarization and Question Answering using Large Language Models
RealitySummary integrates OCR, markerless tracking, and GPT-based models to provide on-demand document augmentation. Iteratively developed over three studies—usability, in-the-wild, and diary—it demonstrates significant potential for real-world reading enhancement through MR-AI integration.