Academic
Publications
Enhanced visual scene understanding through human-robot dialog

Enhanced visual scene understanding through human-robot dialog,10.1109/IROS.2011.6048219,Matthew Johnson-Roberson,Jeannette Bohg,Gabriel Skantze,Joaki

Enhanced visual scene understanding through human-robot dialog   (Citations: 2)
BibTex | RIS | RefWorks Download
We propose a novel human-robot-interaction framework for robust visual scene understanding. Without any a-priori knowledge about the objects, the task of the robot is to correctly enumerate how many of them are in the scene and segment them from the background. Our approach builds on top of state-of-the-art computer vision methods, generating object hypotheses through segmentation. This process is combined with a natural dialog system, thus including a 'human in the loop' where, by exploiting the natural conversation of an advanced dialog system, the robot gains knowledge about ambiguous situations. We present an entropy-based system allowing the robot to detect the poorest object hypotheses and query the user for arbitration. Based on the information obtained from the human-robot dialog, the scene segmentation can be re-seeded and thereby improved. We present experimental results on real data that show an improved segmentation performance compared to segmentation without interaction.
Cumulative Annual
View Publication
The following links allow you to view full publications. These links are maintained by other sources not affiliated with Microsoft Academic Search.
Sort by: