Test-retest reliability of four computerized neurocognitive assessment tools in an active duty military population

Wesley R. Cole*, Jacques P. Arrieux, Karen Schwab, Brian J. Ivins, Felicia M. Qashu, Steven C. Lewis

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

102 Scopus citations


Computerized neurocognitive assessment tools(NCATs) are increasingly used for baseline and post-concussion assessments.To date,NCATs have not demonstrated strong test-retest reliabilities. Most studies have used non-military populations and different methodologies, complicating the determination of the utility ofNCATs in military populations. The test-retest reliability of fourNCATs (Automated Neuropsychological Assessment Metrics 4 [ANAM4], CNS-Vital Signs, CogState, and Immediate Post-Concussion Assessment and Cognitive Test [ImPACT]) was investigated in a healthy active duty military sample. Four hundred and nineteen Service Memberswere randomlyassigned to take oneNCATand 215 returned after approximately 30 days for retest. Participants deemed to have inadequate effort during one or both testing sessions, according to the NCATs scoring algorithms, were removed from analyses. Each NCAT had at least one reliability score (intraclass correlation) in the "adequate" range (.70-.79), only ImPACT had one score considered "high" (.80-.89), and no scores met "very high" criteria (.90-.99). However, overall test-retest reliabilities in four NCATs in a military sample are consistent with reliabilities reported in the literature and are lower than desired for clinical decision-making.

Original languageEnglish
Pages (from-to)732-742
Number of pages11
JournalArchives of Clinical Neuropsychology
Issue number7
StatePublished - Nov 2013
Externally publishedYes


  • Cognitive screening
  • Concussion
  • Military
  • NCAT
  • Reliability
  • Traumatic brain injury


Dive into the research topics of 'Test-retest reliability of four computerized neurocognitive assessment tools in an active duty military population'. Together they form a unique fingerprint.

Cite this