The United States Air Force has a vested interest in advancing intelligence, surveillance, and reconnaissance technologies. Although software and hardware testing is performed for these technologies to demonstrate functionality, only limited research has investigated the effect of these tools on human performance. This research describes a process for the identification of suitable metrics to assess the effectiveness of new ISR technologies. We used several factors to determine the potential suitability of candidate measures including their relative sensitivity, reliability, content validity, and task intrusiveness. Additionally, the sensitivity of several measures, including performance-based, physiological and subjective measures, for the discrimination between levels of difficulty of imagery analyst tasking were compared. Twenty participants from a school for training intelligence analysts volunteered. Real recorded footage from two imagery types, wide area motion imagery and full motion video, was presented to analysts in short video clips. Tasking for each clip was provided prior to viewing. Tasking was developed by a subject matter expert and validated by five career analysts who independently rated the tasking in terms of difficulty. Performance data showed a significant difference based on difficulty of tasking as predicted (F(1,19) = 220.32, p < .001), as did subjective difficulty ratings assessed by the NASA-Task Load Index (F(1,19) = 12.84, p < .01). The sensitivity of physiological data to difficulty was mixed. Significant differences based on difficulty rating were identified for fixation duration (F(1, 14) = 5.30, p = .037) and saccade duration (F(1, 14) = 15.13, p < .01). However, no significant differences were identified in heart rate or heart rate variability (p > .05). There were also no significant differences in indices of workload across imagery types. The suitability and applications of these measures for assessing intelligence analyst performance in simulated analyst operational environments is discussed.