| Test Collection Based Evaluation of Information Retrieval Systems Contributor(s): Sanderson, Mark (Author) |
|
 |
ISBN: 1601983603 ISBN-13: 9781601983602 Publisher: Now Publishers OUR PRICE: $90.25 Product Type: Paperback - Other Formats Published: June 2010 |
| Additional Information |
| BISAC Categories: - Computers | Management Information Systems - Computers | Information Theory - Computers | System Administration - Storage & Retrieval |
| Dewey: 025.04 |
| Series: Foundations and Trends(r) in Information Retrieval |
| Physical Information: 0.31" H x 6.14" W x 9.21" (0.47 lbs) 144 pages |
| Descriptions, Reviews, Etc. |
| Publisher Description: Use of test collections and evaluation measures to assess the effectiveness of information retrieval systems has its origins in work dating back to the early 1950s. Across the nearly 60 years since that work started, use of test collections is a de facto standard of evaluation. This monograph surveys the research conducted and explains the methods and measures devised for evaluation of retrieval systems, including a detailed look at the use of statistical significance testing in retrieval experimentation. This monograph reviews more recent examinations of the validity of the test collection approach and evaluation measures as well as outlining trends in current research exploiting query logs and live labs. At its core, the modern-day test collection is little different from the structures that the pioneering researchers in the 1950s and 1960s conceived of. This tutorial and review shows that despite its age, this long-standing evaluation method is still a highly valued tool for retrieval research. |