BCI_VPM:ACM2009

Jun Wang, Eric Pohlmeyer, Barbara Hanna, Yu-Gang Jiang, Paul Sajda, Shih-Fu Chang. Brain State Decoding for Rapid Image Retrieval. In Proceeding of the ACM international conference on Multimedia (ACM MM), October 2009.

Download [help]

Download paper: Adobe portable document (pdf)

Copyright notice:This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Human visual perception is able to recognize a wide range of targets under challenging conditions, but has limited throughput. Machine vision and automatic content analytics can process images at a high speed, but suffers from inadequate recognition accuracy for general target classes. In this paper, we propose a new paradigm to explore and combine the strengths of both systems. A single trial EEG-based brain machine interface (BCI) subsystem is used to detect objects of interest of arbitrary classes from an initial subset of images. The EEG detection outcomes are used as input to a graph-based pattern mining subsystem to identify, refine, and propagate the labels to retrieve relevant images from a much larger pool. The combined strategy is unique in its generality, robustness, and high throughput. It has great potential for advancing the state of the art in media retrieval applications. We have evaluated and demonstrated significant performance gains of the proposed system with multiple and diverse image classes over several data sets, including those from Internet (Caltech 101) and remote sensing images. In this paper, we will also present insights learned from the experiments and discuss future research directions

Contact

Jun Wang
Yu-Gang Jiang
Shih-Fu Chang

BibTex Reference

@InProceedings{BCI_VPM:ACM2009,
   Author = {Wang, Jun and Pohlmeyer, Eric and Hanna, Barbara and Jiang, Yu-Gang and Sajda, Paul and Chang, Shih-Fu},
   Title = {Brain State Decoding for Rapid Image Retrieval},
   BookTitle = {Proceeding of the ACM international conference on Multimedia (ACM MM)},
   Month = {October},
   Year = {2009}
}

EndNote Reference [help]

Get EndNote Reference (.ref)

For problems or questions regarding this web site contact The Web Master.