Please use this identifier to cite or link to this item: http://ktisis.cut.ac.cy/handle/10488/7012
Title: Evaluating annotators consistency with the aid of an innovative database schema
Authors: Georgiou, Olga 
Tsapatsoulis, Nicolas 
Theodosiou, Zenonas 
Keywords: Semantics;Databases
Category: Arts
Field: Humanities
Issue Date: 2011
Publisher: IEEE Xplore
Source: 6th international workshop on semantic media adaptation and personalization (SMAP), 1-2 December 2011, Vigo, Pontevedra
Abstract: Automatic semantic tagging of multimedia is still inefficient due to the difficulties in modelling abstract or complex terms using low level features. The degree of consensus and homogeneity in judgements among annotators is very important in semantic image and video retrieval. In this paper we present a novel method in evaluating the annotators consistency, which uses an innovative database schema and combines two different annotation approaches. A set of 100 images were annotated by 16 annotators using vocabulary keywords and free keywords. The results indicate that combination of annotation methods may lead to increased annotation consistency compared to a single method but this is not a general fact. As expected the use of free keywords and images require tagging that is not directly related to their content, lead to increase the annotators inconsistency
URI: http://ktisis.cut.ac.cy/handle/10488/7012
DOI: 10.1109/SMAP.2011.22
Rights: © IEEE
Type: Conference Papers
Appears in Collections:Δημοσιεύσεις σε συνέδρια/Conference papers

Files in This Item:
File Description SizeFormat 
Tsapatsoulis_Evaluating annotators_Presentation.pdf4.48 MBAdobe PDFView/Open
Show full item record

SCOPUSTM   
Citations 50

2
checked on Nov 16, 2017

Page view(s)

27
Last Week
1
Last month
0
checked on Nov 20, 2017

Download(s) 10

16
checked on Nov 20, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.