My research focus is on Multimodality Signal Understanding and its applications. With my colleagues in IBM Research, my students in the University of Washington and Columbia University, and other academic & industrial collaborators, our objectives are to advance scientific progress on making machines to process and learn from enormous amount of multimodality sensing data, similar to or beyond what human beings can do. We focus on its fundamental challenges as well as its applications on Distributed Signal Processing & Recongition, Information Assurance, Media Search & Retrieval, Life Science Applications, ec. Especially, lately we are also interested in its applications on automatic modeling and understanding of humanities and societal properties.

My research projects are divided into six main areas

PART I: REAL-WORLD MULTIMODALITY LEARNING MACHINE

• Autonomous Learning
• Smart Semantic Video Camera
• Imperfect and Continuous Learning
  
• Multimedia Semantic Concept Analysis

PART II: DISTRIBUTED SIGNAL PROCESSING AND RECOGNITION

• Large-Scale Video Semantic Concept Filtering and Sensor Network System

• Large-Scale Email Topic Filtering
• Social Network Construction for Radio Monitoring
  

PART III: SECURITY, PRIVACY AND INFORMATION ASSURANCE

• Multimedia Authentication

• Robust Digital Signature and Self-Authentication-and-Recovery Image Systems

• Robust Watermarks surviving Rotation, Scaling, Translation and Print-and-Scan Processes

• Theoretical Data Hiding Capacity Bounds for Images

PART IV: MULTIMEDIA INFORMATION MANAGEMENT

• Multimedia Semantic Adaptation and Summarization
• Multimedia Indexing and Retrieval

PART V: HUMAN INFORMATICS AND SOCIAL COMPUTING

• Expertise Mining
• Community Mining
• Personalized Recommendation
  

PART VI: LIFE SCIENCE APPLICATIONS

• Multimodality Sensors for Sleep Activitiy Monitoring
• Contextual Environment Monitoring
  

Last Updated: 01/24/2006