When paper meets multi-touch : a study of multi-modal interactions in air traffic controls

Abstract : When multiple modes of interaction are available, it is not obvious whether combining these technologies necessarily leads to a better user experience. It can be difficult to determine which modes are most appropriate for each interaction. However, complex activities such as air traffic control require multiple interaction techniques and modalities. As a result, in this paper, we study the technical challenges of adding finger detection to an augmented flight strip board used by air traffic controllers. We use our augmented strip board to evaluate interactions based on touch, digital pen and physical paper objects. From our user study, we find that users are able to quickly adapt to an interface that offers such a wide range of modalities. The availability of different modalities did not overburden the users and they did not find it difficult to determine the appropriate modality to use for each interaction.