InReAcTable: LLM-powered Interactive Visual Data Story Construction from Tabular Data

  • Gerile Aodeng
  • , Guozheng Li*
  • , Yunshan Feng
  • , Qiyang Chen
  • , Yu Zhang
  • , Chi Harold Liu
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Insights in tabular data capture valuable patterns that help analysts understand critical information. Organizing related insights into visual data stories is crucial for in-depth analysis. However, constructing such stories is challenging because of the complexity of the inherent relations between extracted insights. Users face difficulty sifting through a vast number of discrete insights to integrate specific ones into a unified narrative that meets their analytical goals. Existing methods either heavily rely on user expertise, making the process inefficient, or employ automated approaches that cannot fully capture their evolving goals. In this paper, we introduce InReAcTable, a framework that enhances visual data story construction by establishing both structural and semantic connections between data insights. Each user interaction triggers the Acting module, which utilizes an insight graph for structural filtering to narrow the search space, followed by the Reasoning module using the retrieval-augmented generation method based on large language models for semantic filtering, ultimately providing insight recommendations aligned with the user's analytical intent. Based on the InReAcTable framework, we develop an interactive prototype system that guides users to construct visual data stories aligned with their analytical requirements. We conducted a case study and a user experiment to demonstrate the utility and effectiveness of the InReAcTable framework and the prototype system for interactively building visual data stories.

Original languageEnglish
Title of host publicationUIST 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology
EditorsAndrea Bianchi, Elena L. Glassman, Wendy E. Mackay, Shengdong Zhao, Ian Oakley, Jeeeun Kim
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400720376
DOIs
Publication statusPublished - 27 Sept 2025
Event38th Annual ACM Symposium on User Interface Software and Technology, UIST 2025 - Busan, Korea, Republic of
Duration: 28 Sept 20251 Oct 2025

Publication series

NameUIST 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference38th Annual ACM Symposium on User Interface Software and Technology, UIST 2025
Country/TerritoryKorea, Republic of
CityBusan
Period28/09/251/10/25

Keywords

  • exploratory data analysis
  • large language models.
  • Tabular data
  • visual data story

Fingerprint

Dive into the research topics of 'InReAcTable: LLM-powered Interactive Visual Data Story Construction from Tabular Data'. Together they form a unique fingerprint.

Cite this