Using IRT to evaluate measurement precision of selection tests at the french pilot training

Michel Veldhuis (1) , Nadine Matton (2) , Stéphane Vautier (1)

1 UT2
2 IHM Aero - ENAC - Programme transverse IHM Aéronautique

In pilot selection settings, decisions are often based on cutoff scores. In item response theory the measurement precision of a test score can be evaluated by its degree of information. We investigated whether the maximum of test information corresponded to the cutoff zone for 10 cognitive ability tests of the current French civil air transport pilot selection (n?=?577). An item response theory model was fitted to the data. The 6 adequately fitted tests' test information curves were generally maximal in the cutoff score zone. Several ways to improve the absolute level of precision of tests in pilot selection situations are discussed.

Mots clés: item response theory (IRT); pilot selection; cognitive ability tests; test information; cut-off score; three parameter logistic (3PL)

Domaines: Interface homme-machine [cs.HC]

Michel Veldhuis, Nadine Matton, Stéphane Vautier. Using IRT to evaluate measurement precision of selection tests at the french pilot training. International Journal of Aviation Psychology, 2012, 22 (1), pp 18-29. ⟨10.1080/10508414.2012.635123⟩. ⟨hal-01021626⟩