TY - GEN
T1 - Reasoning about functionality of core matching functions for information retrieval
AU - Li, Jian Ping
AU - Yang, Yong Qin
AU - Song, Dawei
AU - Gu, Hong Bo
PY - 2004
Y1 - 2004
N2 - Traditional benchmarking methods for information retrieval (IR) are based on experimental performance evaluation[1-14]. Although the metrics precision and recall can measure the effectiveness of a system, it cannot assess the underlying model. Recently, a theory of "aboutness" has been used for functional benchmarking of IR. Latest research shows the functionality of an IR model is largely determined by its retrieval mechanism, i.e., the matching function. In particular, containment and overlapping (either with or without a threshold value) are the core IR matching functions. The objective of this paper is to model the containment and overlapping matching functions using an aboutness-based framework and analyze them from an abstract and theoretical viewpoint. Separate aboutness relations for containment, pure-overlapping (i.e., without threshold) and threshold-overlapping matching functions are defined, and the sets of properties supported by them are derived and analyzed respectively. These three relations can be used to determine and explain the functionality of an IR system and how the functionality affects the performance of the system. Moreover, they can provide the design guidelines for new IR systems.
AB - Traditional benchmarking methods for information retrieval (IR) are based on experimental performance evaluation[1-14]. Although the metrics precision and recall can measure the effectiveness of a system, it cannot assess the underlying model. Recently, a theory of "aboutness" has been used for functional benchmarking of IR. Latest research shows the functionality of an IR model is largely determined by its retrieval mechanism, i.e., the matching function. In particular, containment and overlapping (either with or without a threshold value) are the core IR matching functions. The objective of this paper is to model the containment and overlapping matching functions using an aboutness-based framework and analyze them from an abstract and theoretical viewpoint. Separate aboutness relations for containment, pure-overlapping (i.e., without threshold) and threshold-overlapping matching functions are defined, and the sets of properties supported by them are derived and analyzed respectively. These three relations can be used to determine and explain the functionality of an IR system and how the functionality affects the performance of the system. Moreover, they can provide the design guidelines for new IR systems.
UR - http://www.scopus.com/inward/record.url?scp=4344592020&partnerID=8YFLogxK
U2 - 10.1142/9789812702654_0008
DO - 10.1142/9789812702654_0008
M3 - Conference contribution
AN - SCOPUS:4344592020
SN - 981238961X
SN - 9789812389619
T3 - Proceedings of the International Computer Congress 2004 on Wavelet Analysis and its Applications, and Active Media Technology
SP - 57
EP - 68
BT - Proceedings of the International Computer Congress 2004 on Wavelet Analysis and its Applications, and Active Media Technology
PB - World Scientific Publishing Co. Pte Ltd
T2 - Proceedings of the International Computer Congress 2004 on Wavelet Analysis and its Applications, and Active Media Technology
Y2 - 28 May 2004 through 30 May 2004
ER -