Skip to main navigation Skip to search Skip to main content

Discovering the k representative skyline over a sliding window

Research output: Contribution to journalArticlepeer-review

Abstract

A representative skyline contains k skyline points that can represent its corresponding full skyline. The existing measuring criteria of k representative skylines are specifically designed for static data, and they cannot effectively handle streaming data. In this paper, we focus on the problem of calculating the k representative skyline over data streams. First, we propose a new criterion to choose k skyline points as the k representative skyline for data stream environments, termed the k largest dominance skyline (k-LDS), which is representative to the entire data set and is highly stable over the streaming data. Second, we propose an efficient exact algorithm, called Prefix-based Algorithm (PBA), to solve the k-LDS problem in a 2-dimensional space. The time complexity of PBA is only O((M-k)× k) where M is the size of the full skyline set. Third, the k-LDS problem for a d-dimensional (d ≥ 3) space turns out to be very complex. Therefore, a greedy algorithm is designed to answer k-DS queries. To further accelerate the calculation, we propose a ϵ-greedy algorithm which can achieve an approximate factor of 1/(1+ϵ)(1-1/√e). Experimental results on both synthetic and real-world data show that our k-LDS significantly outperforms its competitors in data stream environments. Furthermore, we demonstrate that the proposed ϵ-greedy algorithm can solve k-LDS efficiently and with a competitive accuracy.

Original languageEnglish
Article number7439850
Pages (from-to)2041-2056
Number of pages16
JournalIEEE Transactions on Knowledge and Data Engineering
Volume28
Issue number8
DOIs
Publication statusPublished - 1 Aug 2016
Externally publishedYes

Keywords

  • Representative skyline
  • data stream
  • greedy algorithm
  • k-largest dominance skyline (k-LDS)
  • prefix

Fingerprint

Dive into the research topics of 'Discovering the k representative skyline over a sliding window'. Together they form a unique fingerprint.

Cite this