Please use this identifier to cite or link to this item:
Title: In situ evaluation of recommender systems: Framework and instrumentation
Authors: Funk, Mathias 
Rozinat, Anne 
Karapanos, Evangelos 
Alves De Medeiros, Ana Karla 
Koca, Aylin 
Major Field of Science: Natural Sciences
Field Category: Computer and Information Sciences
Keywords: Experience sampling;Observation;Process mining;Recommender systems;Use experience
Issue Date: Aug-2010
Source: International Journal of Human Computer Studies, 2010, vol. 68, no. 8, pp. 525-547
Volume: 68
Issue: 8
Start page: 525
End page: 547
Journal: International Journal of Human Computer Studies 
Abstract: This paper deals with the evaluation of the recommendation functionality inside a connected consumer electronics product in prototype stage. This evaluation is supported by a framework to access and analyze data about product usage and user experience. The strengths of this framework lie in the collection of both objective data (i.e., "What is the user doing with the product?") and subjective data (i.e., "How is the user experiencing the product?"), which are linked together and analyzed in a combined way. The analysis of objective data provides insights into how the system is actually used in the field. Combined with the subjective data, personal opinions and evaluative judgments on the product quality can be then related to actual user behavior. In order to collect these data in a most natural context, remote data collection allows for extensive user testing within habitual environments. We have applied our framework to the case of an interactive TV recommender system application to illustrate that the user experience of recommender systems can be evaluated in real-life usage scenarios.
ISSN: 1095-9300
DOI: 10.1016/j.ijhcs.2010.01.002
Rights: © Elsevier
Type: Article
Affiliation : Eindhoven University of Technology 
Cyprus University of Technology 
Appears in Collections:Άρθρα/Articles

CORE Recommender
Show full item record

Citations 50

checked on Apr 22, 2021


Last Week
Last month
checked on Apr 22, 2021

Page view(s)

Last Week
Last month
checked on May 10, 2021

Google ScholarTM



Items in KTISIS are protected by copyright, with all rights reserved, unless otherwise indicated.