Skip to main navigation Skip to search Skip to main content

NarrAid: Supporting Storytelling of People with Aphasia via Generative Visual Scene Displays

  • Xiangfei Hu*
  • , Xiuqi Zheng
  • , Qi Liu
  • , Zejian Li*
  • , Ying Zhang
  • , Lu Wang*
  • , Xipei Ren*
  • *Corresponding author for this work
  • Zhejiang University
  • University of Macau
  • Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

People with aphasia (PWA) often communicate through fragmented words, which can limit storytelling and contribute to social isolation. Existing Augmentative and Alternative Communication (AAC) tools primarily support basic wants and needs, offering limited support for storytelling. We present NarrAid, a generative Visual Scene Display (VSD) system that supports human-AI co-creative storytelling by generating VSD-compliant, high-context scene images without relying on users' personal photos, reducing manual content preparation for caregivers. Through a preliminary user study (N = 6), we found that NarrAid helped establish common ground, increased PWA's confidence, and reduced misunderstandings and the need for clarification.

Original languageEnglish
Title of host publicationCHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems
EditorsNuria Oliver, David A. Shamma, Heloisa Candello, Pablo Cesar, Pedro Lopes, Valentino Artizzu, Fiona Draxler, Gustavo Lopez, Anke V. Reinschluessel, Xin Tong, Phoebe O. Toups Dugas
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400722813
DOIs
Publication statusPublished - 13 Apr 2026
Externally publishedYes
EventExtended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 - Barcelona, Spain
Duration: 13 Apr 202617 Apr 2026

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

ConferenceExtended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026
Country/TerritorySpain
CityBarcelona
Period13/04/2617/04/26

Keywords

  • aphasia
  • assistive technology
  • Augmentative and Alternative Communication
  • large language models
  • storytelling

Fingerprint

Dive into the research topics of 'NarrAid: Supporting Storytelling of People with Aphasia via Generative Visual Scene Displays'. Together they form a unique fingerprint.

Cite this