MM11:AQSDemo

Felix X. Yu, Rongrong Ji, Tongtao Zhang, Shih-Fu Chang. A mobile location search system with Active Query Sensing. In Proceeding of ACM International Conference on Multimedia (ACM MM), demo paper, 2011.

Download [help]

Download paper: Adobe portable document (pdf)

Copyright notice:This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

How should the second query be taken once the first query fails in mobile location search based on visual recognition? In this demo, we describe a mobile search system with a unique Active Query Sensing (AQS) function to intelligently guide the mobile user to take a successful second query. This suggestion is built upon a scalable visual matching system covering over 0.3 million street view reference images in New York City, where each location is associated with multiple surrounding views and panorama. In online search, once the initial search result fails, the system will perform online analysis and suggest the mobile user to turn to the most discriminative viewing angle to take the second visual query, from which the search performance is expected to greatly improve. The AQS suggestion is based on both offline salient view discovery and online viewing angle prediction and intelligent turning decision. Our experiments show our AQS can improve the mobile location search with a performance gain as high as 100%, reducing the failure rate to only 12% after taking the second visual query

Contact

FelixX. Yu
Rongrong Ji
Shih-Fu Chang

BibTex Reference

@InProceedings{MM11:AQSDemo,
   Author = {Yu, Felix X. and Ji, Rongrong and Zhang, Tongtao and Chang, Shih-Fu},
   Title = {A mobile location search system with Active Query Sensing},
   BookTitle = {Proceeding of ACM International Conference on Multimedia (ACM MM), demo paper},
   Year = {2011}
}

EndNote Reference [help]

Get EndNote Reference (.ref)

For problems or questions regarding this web site contact The Web Master.