I have moved my home page to http://felixyu.org.
Click here if your browser doesn't automatically go there within a few seconds.

Designing Category-level Attributes for Discriminative Visual Recognition

This page is under construction. Please check back later for more information including code, data and future works...



Summary

Attribute-based representation has shown great promises for visual recognition due to its intuitive interpretation and cross-category generalization property. However, human efforts are usually involved in the attribute designing process, making the representation costly to obtain. In this paper, we propose a novel formulation to automatically design discriminative "category-level attributes", which can be efficiently encoded by a compact category-attribute matrix. The formulation allows us to achieve intuitive and critical design criteria (category-separability, learnability) in a principled way. The designed attributes can be used for tasks of cross-category knowledge transfer, achieving superior performance over well-known attribute dataset Animals with Attributes (AwA) and a large-scale ILSVRC2010 dataset (1.2M images). This approach also leads to state-of-the-art performance on the zero-shot learning task on AwA.



Attribute Encoding and Category Decoding

Sepecifically, We propose a framework of using attributes as mid-level cues for multi-class classification. And the error of such classification scheme is used to measure the discriminativeness of attributes. The framework consists of two steps: attribute encoding, and category decoding.



Publications

Felix X. Yu; Liangliang Cao; Rogerio S. Feris; John R. Smith; Shih-Fu Chang.
Designing category-level attributes for discriminative visual recognition
CVPR 2013 [PDF] [Supp]
Felix X. Yu; Liangliang Cao; Rogerio S. Feris; John R. Smith; Shih-Fu Chang.
Additional remarks on designing category-level attributes for discriminative visual recognition
Technical Report # CUCS 007-13 [PDF]