Abstract:

Traditional military assessments often fall short of capturing the dynamic nature of Warfighter performance on complex decision and problem-solving tasks. Behaviorally Anchored Rating Scales (BARS) offer a solution by providing structured, observable criteria to assess performance in contexts ranging from leadership to planning and adaptability. While traditionally used by psychologists and researchers, BARS can be effectively employed by uniformed personnel to evaluate specific cognitive competencies and the implications for both short-term talent development and long-term career progression. This paper explores the requirements associated with successful application of BARS, drawing on their usage within the U.S. Navy, Marine Corps, and Army, and emphasizing their flexibility to measure performance across various contexts and purposes. Specifically, the paper examines the circumstances under which BARS are particularly beneficial, such as when quantitative data on cognitively complex performance is required, when assessing the quality of skills with no clear answers, and when performance must be observed to be measured. It also discusses the importance of developing a strong BARS rubric grounded in a model of skill development, built with data collected from domain subject matter experts, and reflecting domain-specific language in clear, concise descriptors. Through an analysis of past BARS applications, the paper highlights lessons learned about rater qualifications, proper training and calibration, and implementation approaches. Examples are provided from military use cases including leader selection and development, communication skills, field exercise performance feedback, and validation of automated measures captured via advanced software. Finally, the paper explores future opportunities to enhance BARS application, including leveraging large language models to augment observations and incorporating artificial intelligence to gain efficiencies in rubric development. By expanding the use of BARS across all levels of leadership, military organizations can improve their ability to assess and develop human performance, ensuring objective, consistent evaluations in support of force readiness.

Keywords: ASSESSMENT;BEST PRACTICES;COMPETENCY BASED TRAINING;ENHANCING PERFORMANCE;LEADERSHIP

Menu

Dr. Allison Hancock