How do Gestures Matter for Mutual Awareness in Cockpits? Disclosing Interactions through Graphical Representations

Valentin Becquet (1) , Catherine Letondal (1) , Jean-Luc Vinot (1) , Sylvain Pauchet (1)

1 ENAC - Ecole Nationale de l'Aviation Civile

This paper presents an approach ensuring mutual awareness among airliner pilots using touch-based interactions. Indeed, touchscreens are making their way into cockpits, but touch-based gestures are less performative than gestures on physical controls, and they are limited in aircraft for efficiency and safety reasons. To support a safer perception by the other pilot, we propose to supplement the perception of performed gestures with graphical representations. Our hypothesis is that representing the effect of gestures is more relevant than representing gestures themselves. We introduce our design choices to build the representations for mutual awareness based on an analysis of the activity and graphical semiology. We report results gathered from walkthroughs of the designs with airliner pilots. These results confirm that representing the effects of gestures is an efficient means for mutual awareness. Our work shows how pilots understand the effect of gesture both as a result and as an impression.

Mots clés: Mutual awareness; Touchscreens; Gesture representation; Collaboration; Critical context; Aeronautics; Visualisation; Gestural input; Design

Domaines: Interface homme-machine [cs.HC]

Valentin Becquet, Catherine Letondal, Jean-Luc Vinot, Sylvain Pauchet. How do Gestures Matter for Mutual Awareness in Cockpits? Disclosing Interactions through Graphical Representations. DIS Designing Interactive Systems 2019, Jun 2019, San Diego - California, United States. pp.593-605, ⟨10.1145/3322276.3322306⟩. ⟨hal-02134640⟩