TY - GEN
T1 - Distributed frequent items detection on uncertain data
AU - Wang, Shuang
AU - Wang, Guoren
AU - Chen, Jitong
PY - 2010
Y1 - 2010
N2 - Frequent items detection is one of the valuable techniques in many applications, such as network monitor, network intrusion detection, worm virus detection, and so on. This technique has been well studied on deterministic databases. However, it is a new task on emerging uncertain database, especially in distributed environment. In this paper, a new definition of frequent items on uncertain data is defined. Based on the definition, a polynomial algorithm is proposed, which can efficiently answer the queries in central environment. Furthermore, this work designs the communication-efficient algorithms for retrieving the top-k items with the largest probability from distributed sites. The algorithms compute the upper bound of each round of the transmission, and filter the data as much as possible, which have no chance to influence the query result. Extensive experiments show that the algorithms can process the queries correctly and reduce communication cost efficiently with various data set.
AB - Frequent items detection is one of the valuable techniques in many applications, such as network monitor, network intrusion detection, worm virus detection, and so on. This technique has been well studied on deterministic databases. However, it is a new task on emerging uncertain database, especially in distributed environment. In this paper, a new definition of frequent items on uncertain data is defined. Based on the definition, a polynomial algorithm is proposed, which can efficiently answer the queries in central environment. Furthermore, this work designs the communication-efficient algorithms for retrieving the top-k items with the largest probability from distributed sites. The algorithms compute the upper bound of each round of the transmission, and filter the data as much as possible, which have no chance to influence the query result. Extensive experiments show that the algorithms can process the queries correctly and reduce communication cost efficiently with various data set.
KW - distributed query processing
KW - frequent item
KW - top-k query
KW - uncertain data
UR - https://www.scopus.com/pages/publications/78650188286
U2 - 10.1007/978-3-642-17316-5_48
DO - 10.1007/978-3-642-17316-5_48
M3 - Conference contribution
AN - SCOPUS:78650188286
SN - 3642173152
SN - 9783642173158
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 509
EP - 520
BT - Advanced Data Mining and Applications - 6th International Conference, ADMA 2010, Proceedings
T2 - 6th International Conference on Advanced Data Mining and Applications, ADMA 2010
Y2 - 19 November 2010 through 21 November 2010
ER -