SODA

Initial specification of the evaluation tasks "Use cases to bridge validation and benchmarking" PROMISE Deliverable 2.1

Karlgren, Jussi and Eriksson, Gunnar and Friesek, Madlen and Gäde, Maria and Hansen, Preben and Järvelin, Anni and Lupu, Mihai and Müller, Henning and Petras, Vivian and Stiller, Juliane (2011) Initial specification of the evaluation tasks "Use cases to bridge validation and benchmarking" PROMISE Deliverable 2.1. PROMISE Network of Excellence. (Submitted)

[img]
Preview
PDF - Submitted Version
644Kb

Abstract

Evaluation of multimedia and multilingual information access systems needs to be performed from a usage oriented perspective. This document outlines use cases from the three use case domains of the PROMISE project and gives some initial pointers to how their respective characteristics can be extrapolated to determine and guide evaluation activities, both with respect to benchmarking and to validation of the usage hypotheses. The use cases will be developed further during the course of the evaluation activities and workshops projected to occur in coming CLEF conferences.

Item Type:Other
ID Code:4151
Deposited By:Jussi Karlgren
Deposited On:14 Apr 2011 10:28
Last Modified:14 Apr 2011 10:28

Repository Staff Only: item control page