Towards a discipline for evaluating ubiquitous computing applications

Abstract. Though evaluations are being performed on ubicomp applications, it is difficult for researchers to learn from each other’s results. We believe that this is because no framework exists for conducting user evaluations of ubicomp applications. In this paper, we propose such a framework in hopes of making it easier for researchers to learn from each other’s results, to create effective discount evaluation techniques and design guidelines for ubicomp, to provide a mechanism for researchers to share what they have learned about the appropriateness of different evaluation techniques, and to provide structure so that key areas of evaluation are not overlooked.