Practical surgical interface using a RGB-D camera

Abstract

This paper proposes an interface for controlling medical images using hand gestures. The proposed interface has two modes. One is a surgery-ready mode that a RGB-D camera captures a surgeon's body and the interface provides hand-based interactions with medical images before beginning a surgery. The other is a surgery mode that the camera captures a patient's body, and the surgeon can take a picture of a surgical region and control it using hand gestures during the surgery. The modes have different camera views, thus the proposed interface controls the camera's pose by rotating pan and tilt motors attached to bottom of the camera.