Pulse and vital sign measurement in mixed reality using a HoloLens

Daniel Mcduff (1) , Christophe Hurter (2) , Mar Gonzalez-Franco (1)

1 Microsoft Research [Redmond]
2 ENAC - Ecole Nationale de l'Aviation Civile

Cardiography, quantitative measurement of the functioning of the heart, traditionally requires customized obtrusive contact sensors. Using new methods photoplethysmography and ballistocardiography signals can be captured using ubiquitous sensors, such as webcams and accelerometers. However, these signals are not visible to the unaided eye. We present Cardiolens-a mixed reality system that enables real-time, hands-free measurement and visu-alization of blood ow and vital signs from multiple people. e system combines a front-facing webcam, imaging ballistocardiography, and remote imaging photoplethysmography methods for recovering pulse signals. A heads up display allows users to view their own heart rate whenever they are wearing the device and the heart rate and heart rate variability of another person simply by looking at them. Cardiolens provides the wearer with a new way to understand physiological signals and has applications in human-computer interaction and in the study of social psychology.

Mots clés: Human-centered computing; Visualization; Computing methodologies Biometrics; Mixed / augmented reality; remote sensing; physiology; interoception; health

Domaines: Interface homme-machine [cs.HC]; Synthèse d'image et réalité virtuelle [cs.GR]; Imagerie médicale

Daniel Mcduff, Christophe Hurter, Mar Gonzalez-Franco. Pulse and vital sign measurement in mixed reality using a HoloLens. 23rd ACM Symposium on Virtual Reality Software and Technology (VRST '17), Nov 2017, Göteborg, Sweden. pp.34, ⟨10.1145/3139131.3139134⟩. ⟨hal-01688220⟩