A storm-based real-time micro-blogging burst event detection system

Yiding Wang*, Ruifeng Xu, Bin Liu, Lin Gui, Bin Tang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Micro-blogging is becoming an important information source of breaking news event. Since micro-blogs are real-time unbounded stream with complex relationships, traditional burst event detection techniques do not work well. This paper presents the RBEDS which is a real-time burst event detection system following Storm distributed streaming processing framework. K-Means clustering approach and burst feature detection approach are performed to identify candidate burst events, respectively. Their outputs are incorporated to generate final event detection results. Such operation is implemented as a Storm Topology. The proposed system is evaluated on a large Sina micro-blogging dataset. The achieved system performance shows that the RBEDS system may detect burst events with good timeliness, effectiveness and scalability.

Original languageEnglish
Title of host publicationMachine Learning and Cybernetics - 13th International Conference, Proceedings
EditorsXizhao Wang, Qiang He, Patrick P.K. Chan, Witold Pedrycz
PublisherSpringer Verlag
Pages186-195
Number of pages10
ISBN (Electronic)9783662456514
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event13th International Conference on Machine Learning and Cybernetics, ICMLC 2014 - Lanzhou, China
Duration: 13 Jul 201416 Jul 2014

Publication series

NameCommunications in Computer and Information Science
Volume481
ISSN (Print)1865-0929

Conference

Conference13th International Conference on Machine Learning and Cybernetics, ICMLC 2014
Country/TerritoryChina
CityLanzhou
Period13/07/1416/07/14

Keywords

  • Burst event detection
  • Distributed stream processing
  • Storm

Fingerprint

Dive into the research topics of 'A storm-based real-time micro-blogging burst event detection system'. Together they form a unique fingerprint.

Cite this