Please use this identifier to cite or link to this item:
Title: In the wild image retrieval and clustering for 3D cultural heritage landmarks reconstruction
Authors: Makantasis, Konstantinos 
Doulamis, Anastasios D. 
Doulamis, Nikolaos D. 
Ioannides, Marinos 
Keywords: Content-based filtering;Image matching/clustering;Outliers removal;Cultural heritage objects;3D reconstruction
Category: Computer and Information Sciences;Electrical Engineering - Electronic Engineering - Information Engineering
Field: Natural Sciences;Engineering and Technology
Issue Date: Apr-2016
Publisher: Elsevier B.V.
Source: Multimedia Tools and Applications, 2016, vol. 75, no. 7, pp. 3593–3629
Journal: Multimedia Tools and Applications 
Abstract: One of the main characteristics of Internet era is the free and online availability of extremely large collections of images located on distributed and heterogeneous platforms over the web. The proliferation of millions of shared photographs spurred the emergence of new image retrieval techniques based not only on images' visual information, but on geo-location tags and camera exif data. These huge visual collections provide a unique opportunity for cultural heritage documentation and 3D reconstruction. The main difficulty, however, is that the internet image datasets are unstructured containing many outliers. For this reason, in this paper a new content-based image filtering is proposed to discard image outliers that either confuse or significantly delay the followed e-documentation tools, such as 3D reconstruction of a cultural heritage object. The presented approach exploits and fuses two unsupervised clustering techniques: DBSCAN and spectral clustering. DBSCAN algorithm is used to remove outliers from the initially retrieved dataset and spectral clustering discriminate the noise free image dataset into different categories each representing characteristic geometric views of cultural heritage objects. To discard the image outliers, we consider images as points onto a multi-dimensional manifold and the multi-dimensional scaling algorithm is adopted to relate the space of the image distances with the space of Gram matrices through which we are able to compute the image coordinates. Finally, structure from motion is utilized for 3D reconstruction of cultural heritage landmarks. Evaluation on a dataset of about 31,000 cultural heritage images being retrieved from internet collections with many outliers indicate the robustness and cost effectiveness of the proposed method towards a reliable and just-in-time 3D reconstruction than existing state-of-the-art techniques.
ISSN: 1573-7721
DOI: 10.1007/s11042-014-2191-z
Collaboration : Technical University of Crete
Cyprus University of Technology
Rights: © Springer Nature
Type: Article
Appears in Collections:Άρθρα/Articles

CORE Recommender
Show full item record

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.