Consensus-based evaluation framework for distributed information retrieval systems
- Authors
- Jung, Jason J.
- Issue Date
- Feb-2009
- Publisher
- SPRINGER LONDON LTD
- Keywords
- Information retrieval; Multi-agent systems; Evaluation
- Citation
- KNOWLEDGE AND INFORMATION SYSTEMS, v.18, no.2, pp 199 - 211
- Pages
- 13
- Journal Title
- KNOWLEDGE AND INFORMATION SYSTEMS
- Volume
- 18
- Number
- 2
- Start Page
- 199
- End Page
- 211
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/37775
- DOI
- 10.1007/s10115-008-0153-3
- ISSN
- 0219-1377
0219-3116
- Abstract
- Multi-agent systems have been attacking the challenges of information retrieval tasks on distributed environment. In this paper, we propose a consensus choice selection method based framework to evaluate the performance of cooperative information retrieval tasks of the multiple agents. Thereby, two well-known measurements, precision and recall, are extended to handle consensual closeness (i.e., local and global consensus) between the sets of retrieved results. We show that in a motivating example the proposed criteria are prone to solve the rigidity problem of classical precision and recall. More importantly, the retrieved results can be ranked with respect to the consensual score, and the ranking mechanism has been verified to be more reasonable.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Software > School of Computer Science and Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/37775)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.