This paper considers the problem of recognizing spontaneous human activities from a robot's perspective. We present a novel dataset, where data is collected by an autonomous mobile robot moving around in a building and recording the activities of people in the surroundings. Activities are not specified beforehand and humans are not prompted to perform them in any way. Instead, labels are determined on the basis of the recorded spontaneous activities. The classification of such activi- ties presents a number of challenges, as the robot's movement affects its perceptions. To address it, we propose a combined descriptor that, along with visual features, integrates information related to the robot's actions. We show experimentally that such information is important for classify- ing natural activities with high accuracy. Along with initial results for future benchmarking, we also provide an analysis of the usefulness and importance of the various features for the activity recognition task.

PDF, HTML

In Proceedings of the International Conference on Social Robotics (ICSR), October 2015.

@inproceedings{ICSR2015-gori, title={Robot-centric Activity Recognition "in the Wild"}, author={Gori, I., Sinapov, J., Khante, P., Stone, P., and Aggarwal, J.K.}, booktitle={Proceedings of the International Conference on Social Robotics (ICSR)}, month={October}, url="http://www.cs.utexas.edu/users/ai-lab?gori:icsr2015", year={2015} }