Please use this identifier to cite or link to this item:
Title: Evaluating annotators consistency with the aid of an innovative database schema
Authors: Georgiou, Olga 
Tsapatsoulis, Nicolas 
Theodosiou, Zenonas 
Keywords: Semantics;Databases
Category: Arts
Field: Humanities
Issue Date: 2011
Publisher: IEEE Xplore
Source: 6th international workshop on semantic media adaptation and personalization (SMAP), 1-2 December 2011, Vigo, Pontevedra
Abstract: Automatic semantic tagging of multimedia is still inefficient due to the difficulties in modelling abstract or complex terms using low level features. The degree of consensus and homogeneity in judgements among annotators is very important in semantic image and video retrieval. In this paper we present a novel method in evaluating the annotators consistency, which uses an innovative database schema and combines two different annotation approaches. A set of 100 images were annotated by 16 annotators using vocabulary keywords and free keywords. The results indicate that combination of annotation methods may lead to increased annotation consistency compared to a single method but this is not a general fact. As expected the use of free keywords and images require tagging that is not directly related to their content, lead to increase the annotators inconsistency
DOI: 10.1109/SMAP.2011.22
Rights: © IEEE
Type: Conference Papers
Appears in Collections:Δημοσιεύσεις σε συνέδρια/Conference papers

Files in This Item:
File Description SizeFormat
Tsapatsoulis_Evaluating annotators_Presentation.pdf4.48 MBAdobe PDFView/Open
Show full item record

Citations 20

checked on Dec 17, 2018

Page view(s)

Last Week
Last month
checked on Aug 19, 2019


checked on Aug 19, 2019

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.