U. S. Coast Guard helicopter pilots receive annual instrument and emergency training in the Variable Cockpit Training System simulator. Many portions of initial aircraft transition training are also conducted in the simulator. Initial instrument ratings as well as annual instrument renewals are given on the basis of simulator checkrides, which are automatically soared by the computer. Scares are kept for as many as 12 parameters at a time. This paper discusses the first three years of experience with automated scoring. Moderate correlations were found between subjective instructor scores and automated scores. Although not useful for individual pass-fail decisions, normative comparisons of the automated scores are responsive to changes in the training program.