Pay "attention" to Chart Images for What You Read on Text

Chenyu Yang, Ruixue Fan, Nan Tang, Meihui Zhang, Xiaoman Zhao*, Ju Fan, Xiaoyong Du

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Data visualization is changing how we understand data, by showing why's, how's, and what's behind important patterns/trends in almost every corner of the world, such as in academic papers, news articles, financial reports, etc. However, along with the increasing complexity and richness of data visualizations, given a text description (e.g., "fewer teens say they attended school completely online (8%)"), it becomes harder for users to pinpoint where to pay attention to on a chart (e.g., a grouped bar chart). In this demonstration paper, we present a system HiChart for text-chart image highlighting: when a user selects a span of text, HiChart automatically analyzes the chart image (e.g., a jpeg or a png file) and highlights the parts that are relevant to the span. From a technical perspective, HiChart devises the following techniques. Reverse-engineering visualizations: given a chart image, HiChart uses computer vision techniques to generate a visualization specification using Vega-Lite language, as well as the underlying dataset; Visualization calibration by data tuning: HiChart calibrates the re-generated chart by tuning the recovered dataset through value perturbation; and Chart highlighting for a span: HiChart maps the span to corresponding data cells and uses the built-in highlighting functions of Vega-Lite to highlight the chart.

源语言英语
主期刊名SIGMOD 2023 - Companion of the 2023 ACM/SIGMOD International Conference on Management of Data
出版商Association for Computing Machinery
111-114
页数4
ISBN(电子版)9781450395076
DOI
出版状态已出版 - 4 6月 2023
活动2023 ACM/SIGMOD International Conference on Management of Data, SIGMOD 2023 - Seattle, 美国
期限: 18 6月 202323 6月 2023

出版系列

姓名Proceedings of the ACM SIGMOD International Conference on Management of Data
ISSN(印刷版)0730-8078

会议

会议2023 ACM/SIGMOD International Conference on Management of Data, SIGMOD 2023
国家/地区美国
Seattle
时期18/06/2323/06/23

指纹

探究 'Pay "attention" to Chart Images for What You Read on Text' 的科研主题。它们共同构成独一无二的指纹。

引用此