Measuring Search Effectiveness: Lessons from Interactive TREC

Abstract

This presentation at the ASIST 2005 Annual Meeting had the following objectives: 1) Discuss methodologies and measures of effectiveness that, in our experience, mainly in the TREC Interactive track, have proven successful in painting an accurate picture of the user interaction when seeking information. Classify the measures and discuss the contexts when they can be used. 2) Attempt to provide guidelines as to which measures are appropriate in certain conditions.