AugDesk. Fusing Reality with the Virtual in Document Triage. Part1: Gesture Interactions

Abstract

In this paper we present the first version of AugDesk, an affordable augmented reality prototype desk for sorting documents based on their relevance to an information need. The set-up is based on the findings from previous work in conjunction with a user-centred iterative design process to improve both the software and hardware configuration. In this initial version of the prototype the documents automatically appear on a table from an overhead projector and the user can control the movement and selection of these documents by using gestures, identified from a Microsoft Kinect Sensor. The first part of our work included recording users’ actions to identify the most popular interactions with virtual documents on a table and integrating these into AugDesk.