Detailed Information

Cited 11 time in webofscience Cited 13 time in scopus
Metadata Downloads

Content vs. Context: Visual and Geographic Information Use in Video Landmark Retrieval

Authors
Yin, YifangSeo, BeomjooZimmermann, Roger
Issue Date
Jan-2015
Publisher
ASSOC COMPUTING MACHINERY
Keywords
Experimentation; Content-based analysis; geo-referenced videos; landmark retrieval
Citation
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, v.11, no.3
Journal Title
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS
Volume
11
Number
3
URI
https://scholarworks.bwise.kr/hongik/handle/2020.sw.hongik/13721
DOI
10.1145/2700287
ISSN
1551-6857
Abstract
Due to the ubiquity of sensor-equipped smartphones, it has become increasingly feasible for users to capture videos together with associated geographic metadata, for example the location and the orientation of the camera. Such contextual information creates new opportunities for the organization and retrieval of geo-referenced videos. In this study we explore the task of landmark retrieval through the analysis of two types of state-of-the-art techniques, namely media-content-based and geocontext-based retrievals. For the content-based method, we choose the Spatial Pyramid Matching (SPM) approach combined with two advanced coding methods: Sparse Coding (SC) and Locality-Constrained Linear Coding (LLC). For the geo-based method, we present the Geo Landmark Visibility Determination (GeoLVD) approach which computes the visibility of a landmark based on intersections of a camera's field-of-view (FOV) and the landmark's geometric information available from Geographic Information Systems (GIS) and services. We first compare the retrieval results of the two methods, and discuss the strengths and weaknesses of each approach in terms of precision, recall and execution time. Next we analyze the factors that affect the effectiveness for the content-based and the geo-based methods, respectively. Finally we propose a hybrid retrieval method based on the integration of the visual (content) and geographic (context) information, which is shown to achieve significant improvements in our experiments. We believe that the results and observations in this work will enlighten the design of future geo-referenced video retrieval systems, improve our understanding of selecting the most appropriate visual features for indexing and searching, and help in selecting between the most suitable methods for retrieval based on different conditions.
Files in This Item
There are no files associated with this item.
Appears in
Collections
School of Games > Game Software Major > 1. Journal Articles

qrcode

Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Researcher Seo, Beom Joo photo

Seo, Beom Joo
Game (Major in Game Software)
Read more

Altmetrics

Total Views & Downloads

BROWSE