Image retrieval via topic modelling of Instagram hashtags

Abstract

Automatic Image Annotation (AIA) is the process of assigning tags to digital images without the intervention of humans. Most of the modern automatic image annotation methods are based on the learning by example paradigm. In those methods building the training examples, that is, pairs of images and related tags, is the first critical step. We have shown in our previous studies that hashtags accompanying images in social media and especially the Instagram provide a reach source for creating training sets for AIA. However, we concluded that only 20% of the Instagram hashtags describe the actual content of the image they accompany, thus, a series of filtering steps need to apply in order to identify the appropriate hashtags. In this paper we apply graph based topic modelling on Instagram hashtags in order to predict the subject of the related images and we propose an innovativeimage retrieval scheme that can be used in the context of Instagram with minimal training requirements.