Asia Pacific Journal of Information Systems (APJIS)

menu05_sub01_ov.gif

Share this page

Current Issue

Date	December 2015
Vol. No.	Vol. 25 No. 4
DOI	http://dx.doi.org/10.14329/apjis.2015.25.4.686
Page	686~711
Title	Known-Item Retrieval Performance of a PICO-based Medical Question Answering Engine
Author	Wan-Tze Vong, Patrick Hang Hui Then
Keyword	Known-Item Search, Mean Reciprocal Rank, Pico Elements, Question-Answering Engine, Strength Of Evidence
Abstract	The performance of a novel medical question-answering engine called CliniCluster and existing search engines, such as CQA-1.0, Google, and Google Scholar, was evaluated using known-item searching. Known-item searching is a document that has been critically appraised to be highly relevant to a therapy question. Results show that, using CliniCluster, known-items were retrieved on average at rank 2 (MRR@10 ≈ 0.50), and most of the known-items could be identified from the top-10 document lists. In response to ill-defined questions, the known-items were ranked lower by CliniCluster and CQA-1.0, whereas for Google and Google Scholar, significant difference in ranking was not found between well- and ill-defined questions. Less than 40% of the known-items could be identified from the top-10 documents retrieved by CQA-1.0, Google, and Google Scholar. An analysis of the top-ranked documents by strength of evidence revealed that CliniCluster outperformed other search engines by providing a higher number of recent publications with the highest study design. In conclusion, the overall results support the use of CliniCluster in answering therapy questions by ranking highly relevant documents in the top positions of the search results.

Home l Site Map l Abstracting/Indexing l FAQ l Publisher l Contact Us l Admin Login

© 2013 The Korean Society of Management Information Systems. All rights reserved.