Evaluation of the reliability and validity of computerized tests of attention

Different aspects of attention can be assessed through psychological tests to identify stable individual or group differences as well as alterations after interventions. Aiming for a wide applicability of attentional assessments, Psychology Experiment Building Language (PEBL) is an open-source softw...

Full description

Saved in:
Bibliographic Details
Published in:PloS one 2023-01, Vol.18 (1), p.e0281196-e0281196
Main Authors: Langner, Robert, Scharnowski, Frank, Ionta, Silvio, G Salmon, Carlos E, Piper, Brian J, Pamplona, Gustavo S P
Format: Article
Language:English
Subjects:
Analysis
Assessments
Attention
Biology and Life Sciences
Cognitive tasks
Consent
Correlation
Correlation coefficient
Correlation coefficients
Examinations
Experiments
Hypothesis testing
Medicine and Health Sciences
Mental task performance
Network reliability
Neuropsychological Tests
Physical Sciences
Psychological assessment
Psychological tests
Psychology
Psychometrics
Public software
Quantitative psychology
Reaction Time
Real property
Reliability analysis
Reliability aspects
Reproducibility of Results
Research and Analysis Methods
Response time
Social Sciences
Software
Technology application
Validity
Valuation
Vigilance
Wakefulness
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Different aspects of attention can be assessed through psychological tests to identify stable individual or group differences as well as alterations after interventions. Aiming for a wide applicability of attentional assessments, Psychology Experiment Building Language (PEBL) is an open-source software system for designing and running computerized tasks that tax various attentional functions. Here, we evaluated the reliability and validity of computerized attention tasks as provided with the PEBL package: Continuous Performance Task (CPT), Switcher task, Psychomotor Vigilance Task (PVT), Mental Rotation task, and Attentional Network Test. For all tasks, we evaluated test-retest reliability using the intraclass correlation coefficient (ICC), as well as internal consistency through within-test correlations and split-half ICC. Across tasks, response time scores showed adequate reliability, whereas scores of performance accuracy, variability, and deterioration over time did not. Stability across application sites was observed for the CPT and Switcher task, but practice effects were observed for all tasks except the PVT. We substantiate convergent and discriminant validity for several task scores using between-task correlations and provide further evidence for construct validity via associations of task scores with attentional and motivational assessments. Taken together, our results provide necessary information to help design and interpret studies involving attention assessments.
ISSN:1932-6203
1932-6203
DOI:10.1371/journal.pone.0281196