Evaluation of Automatic Tag Sense Disambiguation Using the MIRFLICKR Image Collection

O Kanishcheva, I Nikolova, G Angelova - … : Methodology, Systems, and …, 2018 - Springer
Artificial Intelligence: Methodology, Systems, and Applications: 18th …, 2018Springer
Automatic identification of intended tag meanings is a challenge in large image collections
where human authors assign tags inspired by emotional or professional motivations.
Algorithms for automatic tag disambiguation need “golden” collections of manually created
tags to establish baselines for accuracy assessment. Here we show how to use the
MIRFLICKR-25000 collection to evaluate the performance of our algorithm for tag sense
disambiguation which identifies meanings of image tags based on WordNet or Wikipedia …
Abstract
Automatic identification of intended tag meanings is a challenge in large image collections where human authors assign tags inspired by emotional or professional motivations. Algorithms for automatic tag disambiguation need “golden” collections of manually created tags to establish baselines for accuracy assessment. Here we show how to use the MIRFLICKR-25000 collection to evaluate the performance of our algorithm for tag sense disambiguation which identifies meanings of image tags based on WordNet or Wikipedia. We present three different types of observations on the disambiguated tags: (i) accuracy evaluation, (ii) evaluation of the semantic similarity of the individual tags with the image category and (iii) the semantic similarity of an image tagset to the image category, using different word embedding models for the latter two. We show how word embeddings create a specific baseline so the results can be compared. The accuracy we achieve is 78.6%.
Springer
顯示最佳搜尋結果。 查看所有結果