Evidence from the surgeons: gesture control of image data displayed during surgery

We gathered ethnographic evidence from surgeons about the concept of gesture-based control over the display of their patients’ radiographic scan data during surgery. This would give the surgeons direct access to their patients’ scan data without compromising their sterile working field and without needing to rely on other clinicians to interpret display instructions. Our approach involved interviewing surgeons and observing them in the operating theatre. We included evidence from earlier publications in this field and we used a grounded theory approach to analyse our data. Our findings address diversity across the surgical specialties, preoperative versus intraoperative use of the data, preferences for simple natural gestures, the role of another person controlling the display, broad system constraints and the willingness of surgeons to collaborate with their time and effort in this research.This work was supported in part by an Australian Research Council (ARC) Linkage Project (LP100100588) in partnership with Microsoft Corporation and Microsoft Research