Analysis of Inter-rater Reliability in the Run Roll Aim test to Improve its Clinical Utility for Determining Return to Duty Readiness in Soldiers after mTBI (2016)
Undergraduates: Hannah Ryan, Julianna Prim
Faculty Advisor: Karen McCulloch
Department: Biology
The Assessment of Military Multitasking Performance (AMMP) was developed to assist in military return to duty decision-making and consists of 6 dual-task and complex multitask performance scenarios. The Run Roll Aim is one component of the AMMP test and requires a high level of mobility, challenges the vestibular system, and has high-face validity for Soldiers. Initial observational data (trial time, total trial time, correct responses, and total errors) were analyzed for 26 active duty service members at Ft. Bragg, 19 had sustained an mTBI and had persistent symptoms and 7 were healthy controls. The ICC for all categories was within the 95% CI except for total errors, with an ICC value of 0.64. The test was fast-paced, making some components of total errors difficult to judge. Further analysis is planned to address the nature of errors that occurred in various categories, in particular focusing on the directional Stroop effect rating that is part of the task. This component is suspected as a potential problem for consistent ratings. Through analysis of the data, my aim is to determine what component of total errors caused a decrease in inter-rater reliability, as well as further examining possible group differences in errors. This information will be incorporated into future modifications of the Run Roll Aim task to improve its clinical utility.