Situational effects may account for gain scores in cognitive ability testing : a longitudinal SEM approach

Nadine Matton (1) , Stéphane Vautier (2) , Éric Raufaste (2)

1 IHM Aero - ENAC - Programme transverse IHM Aéronautique
2 UT2

Mean gainscores for cognitiveability tests between two sessions in a selection setting are now a robust finding, yet not fully understood. Many authors do not attribute such gainscores to an increase in the target abilities. Our approach consists of testingalongitudinalSEM model suitable to this view. We propose to model the scores' changes of a battery of tests between two sessions with a single factor, namely the change in the situational component of the scores. The situational component encompasses all effects due to the specificity of the state of the person in the current situation (e.g., anxiety level, tiredness, test-taking practice) and is allowed to vary from one session to another. By definition, this single component is supposed to influence all tests at a given session. In particular cases such as high-stake selection settings, where applicants are likely to train themselves before retaking the tests, situational factors might even suffice to explain mean score increases. Empirically, our latent change model closely fitted the scores of 752 applicants for entry into the French Aircraft Pilot Training, gathered on a set of three tests (visual perception, mechanical comprehension, and selective attention). Gainscores of moderate to strong effect sizes could be explained by common situationaleffects, with no need for admitting change on ability components. Therefore, gainscoresmay be understood as construct-irrelevant changes.

Mots clés: cognitiveability test; retest effects; practice effects; selection; general intelligence; modelling

Domaines: Interface homme-machine [cs.HC]

Nadine Matton, Stéphane Vautier, Éric Raufaste. Situational effects may account for gain scores in cognitive ability testing : a longitudinal SEM approach. Intelligence, 2009, 37 (4), pp 412-421. ⟨10.1016/j.intell.2009.03.011⟩. ⟨hal-01021628⟩