Magic Cards:

A Paper Tag Interface for Implicit Robot Control

2009.04 | CHI 2009


Typical Human Robot Interaction (HRI) assumes that the user explicitly interacts with robots. However, explicit control with robots can be unnecessary or even undesirable in certain cases, such as dealing with domestic services (or housework). In this paper, we propose an alternative strategy of interaction: the user implicitly controls a robot by issuing commands on corresponding real world objects and the environment. Robots then discover these commands and complete them in the background. We implemented a paper-tag-based interface to support such implicit robot control in a sensor-augmented home environment. Our initial user studies indicated that the paper-tag-based interface is particularly simple to use and provides users with flexibility in planning and controlling their housework tasks in a simulated home environment.


paper-tag-based interface, implicit human robot interaction, domestic service, magic cards


Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Supplemental Material

Project Info



Shengdong Zhao, Koichi Nakamura, Kentaro Ishii, and Takeo Igarashi