medRxiv · Sep 29, 2025

Reliability of remote self-administered web-based digital cognitive measures and comparison to in-person neuropsychological tests: Stricker Learning Span, Symbols Test and the Mayo Test Drive Screening Battery Composite

By Hughes MA, Frank RD, Taylor RL et al.

INTRODUCTION: We describe the reliability of remote self-administered digital cognitive measures completed via the Mayo Test Drive (MTD) web-based platform. METHODS: 1,846 participants (mean age=70, SD=12, range 31-101; 48% male; 96% White; 99% non-Hispanic; 97% cognitively unimpaired) with 2-4 complete MTD sessions at ~7.5-month intervals were included. Test-retest reliability was assessed using single-rating, absolute-agreement, and two-way mixed intraclass correlation coefficients (ICCs) with 95% confidence intervals. ICCs for in-person-administered traditional neuropsychological measures were compared to MTD for a subset of 244 participants. RESULTS: Reliability was good for the MTD Composite [total ICC = 0.79 (0.77, 0.80)], and moderate-to-good for the primary outcome variables for each MTD subtest [total ICCs 0.70-0.83 for Stricker Learning Span and Symbols]. The reliability of the remote self-administered MTD was similar to in-person-administered cognitive measures. DISCUSSION: MTD showed moderate-to-good reliability, supporting its use in longitudinal monitoring.

doi.org/10.1101/2025.09.26.25336467 Open access PubMed 41256113 Biomarkers