Utilizing Implicit User Feedback to Improve Interactive Video Retrieval

This paper describes an approach to exploit the implicit user feedback gathered during interactive video retrieval tasks. We propose a framework, where the video is first indexed according to temporal, textual, and visual features and then implicit user feedback analysis is realized using a graph-ba...

Full description

Saved in:
Bibliographic Details
Main Authors: Stefanos Vrochidis, Ioannis Kompatsiaris, Ioannis Patras
Format: Article
Language:English
Published: Wiley 2011-01-01
Series:Advances in Multimedia
Online Access:http://dx.doi.org/10.1155/2011/310762
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832560593776672768
author Stefanos Vrochidis
Ioannis Kompatsiaris
Ioannis Patras
author_facet Stefanos Vrochidis
Ioannis Kompatsiaris
Ioannis Patras
author_sort Stefanos Vrochidis
collection DOAJ
description This paper describes an approach to exploit the implicit user feedback gathered during interactive video retrieval tasks. We propose a framework, where the video is first indexed according to temporal, textual, and visual features and then implicit user feedback analysis is realized using a graph-based methodology. The generated graph encodes the semantic relations between video segments based on past user interaction and is subsequently used to generate recommendations. Moreover, we combine the visual features and implicit feedback information by training a support vector machine classifier with examples generated from the aforementioned graph in order to optimize the query by visual example search. The proposed framework is evaluated by conducting real-user experiments. The results demonstrate that significant improvement in terms of precision and recall is reported after the exploitation of implicit user feedback, while an improved ranking is presented in most of the evaluated queries by visual example.
format Article
id doaj-art-49994737e0ee4223b179012045da58b6
institution Kabale University
issn 1687-5680
1687-5699
language English
publishDate 2011-01-01
publisher Wiley
record_format Article
series Advances in Multimedia
spelling doaj-art-49994737e0ee4223b179012045da58b62025-02-03T01:27:12ZengWileyAdvances in Multimedia1687-56801687-56992011-01-01201110.1155/2011/310762310762Utilizing Implicit User Feedback to Improve Interactive Video RetrievalStefanos Vrochidis0Ioannis Kompatsiaris1Ioannis Patras2Centre for Research and Technology Hellas, Informatics and Telematics Institute, 6th Klm Charilaou-Thermi Road, 57001 Thessaloniki, GreeceCentre for Research and Technology Hellas, Informatics and Telematics Institute, 6th Klm Charilaou-Thermi Road, 57001 Thessaloniki, GreeceQueen Mary, University of London, Mile End Road, London E1 4NS, UKThis paper describes an approach to exploit the implicit user feedback gathered during interactive video retrieval tasks. We propose a framework, where the video is first indexed according to temporal, textual, and visual features and then implicit user feedback analysis is realized using a graph-based methodology. The generated graph encodes the semantic relations between video segments based on past user interaction and is subsequently used to generate recommendations. Moreover, we combine the visual features and implicit feedback information by training a support vector machine classifier with examples generated from the aforementioned graph in order to optimize the query by visual example search. The proposed framework is evaluated by conducting real-user experiments. The results demonstrate that significant improvement in terms of precision and recall is reported after the exploitation of implicit user feedback, while an improved ranking is presented in most of the evaluated queries by visual example.http://dx.doi.org/10.1155/2011/310762
spellingShingle Stefanos Vrochidis
Ioannis Kompatsiaris
Ioannis Patras
Utilizing Implicit User Feedback to Improve Interactive Video Retrieval
Advances in Multimedia
title Utilizing Implicit User Feedback to Improve Interactive Video Retrieval
title_full Utilizing Implicit User Feedback to Improve Interactive Video Retrieval
title_fullStr Utilizing Implicit User Feedback to Improve Interactive Video Retrieval
title_full_unstemmed Utilizing Implicit User Feedback to Improve Interactive Video Retrieval
title_short Utilizing Implicit User Feedback to Improve Interactive Video Retrieval
title_sort utilizing implicit user feedback to improve interactive video retrieval
url http://dx.doi.org/10.1155/2011/310762
work_keys_str_mv AT stefanosvrochidis utilizingimplicituserfeedbacktoimproveinteractivevideoretrieval
AT ioanniskompatsiaris utilizingimplicituserfeedbacktoimproveinteractivevideoretrieval
AT ioannispatras utilizingimplicituserfeedbacktoimproveinteractivevideoretrieval