Multiclass recognition and part localization with humans in the loop
Research output: Contribution to journal › Conference article › Research › peer-review
We propose a visual recognition system that is designed for fine-grained visual categorization. The system is composed of a machine and a human user. The user, who is unable to carry out the recognition task by himself, is interactively asked to provide two heterogeneous forms of information: clicking on object parts and answering binary questions. The machine intelligently selects the most informative question to pose to the user in order to identify the object's class as quickly as possible. By leveraging computer vision and analyzing the user responses, the overall amount of human effort required, measured in seconds, is minimized. We demonstrate promising results on a challenging dataset of uncropped images, achieving a significant average reduction in human effort over previous methods.
Original language | English |
---|---|
Journal | Proceedings of the IEEE International Conference on Computer Vision |
Pages (from-to) | 2524-2531 |
Number of pages | 8 |
DOIs | |
Publication status | Published - 2011 |
Externally published | Yes |
Event | 2011 IEEE International Conference on Computer Vision, ICCV 2011 - Barcelona, Spain Duration: 6 Nov 2011 → 13 Nov 2011 |
Conference
Conference | 2011 IEEE International Conference on Computer Vision, ICCV 2011 |
---|---|
Country | Spain |
City | Barcelona |
Period | 06/11/2011 → 13/11/2011 |
Sponsor | TOYOTA, Google, Microsoft Research, Siemens, technicolor |
ID: 301830771