Requirements for Objective- and Performance-Based Creation and Modification of Complex Training Materials

Abstract

Implementation of simulation and scenario based training for teams and individuals requires generation and delivery of highly complex instructional material. In this paper, preliminary results of a multi-year effort are presented with a focus on scenario development tools in support of advanced individual and team training. As a first step in this effort, a review of the state-of-the-art in simulation- and scenario-based training systems was conducted examining over 20 simulation-and scenario-based training systems. Consistently recurring limitations were evident across all systems in all aspects from preparation to debrief. These limitations, together with other research in automated data collection and diagnosis, have focused attention on the development of a “learner centered”, software-based training management system. The effort described herein supports the building of a system that allows relative novices to use historical performance data to create and modify scenarios based on specific objectives. This system will also create appropriate support materials for training personnel. Success in this endeavor will provide a model for those who have struggled to harness the considerable potential afforded by simulation- and scenario-based training.

Get full access to this article

View all access options for this article.

References

Hall

J. K.

Dwyer

D. J.

Bowers

J. A. Cannon

Salas

Volpe

C. E.

(1993). Toward assessing team tactical decision making under stress: The development of a methodology for structuring team training scenarios. Proceedings of the 15th Annual Interservice/ Industry Training Systems Conference (pp. 87–98). Washington, DC: National Security Industrial Association.

Pemberton Barbara

Classe Douglas

Bradley Charles

Wilson Mike (1994). Automated exercise preparation and distribution for large scale DIS exercises. Proceedings of the 16th Annual Interservice/Industry Training Systems Conference Washington, DC: National Security Industrial Association.

Prince

Oser

Salas

Woodruff

(1993). Increasing hits and reducing misses in CRM/LOS scenarios: Guidelines for simulator scenario development. International Journal of Aviation Psychology, 3, 69–82.

Salas

(1989). A standardized methodology for team training design. In Daniel

Salas

Kotick

D. M.

, Independent Research and Independent Exploratory Development (IR/IED) Program: Annual report FY 1988 (NTSC Technical Report Number 89–009). (pp. 45–48). Orlando, FL: Naval Training Systems Center.

Swezey

R. W.

Llaneras

R. E.

Salas

, (1992). Ensuring teamwork: A checklist for use in designing team training programs. Performance & Instruction, 31, 33–37.

Swezey

R. W.

Salas

(1992). Guidelines for use in team-training development. In Swezey

R. W.

Salas

, Teams: Their training and performance (pp. 219–245). Norwood, NJ: Ablex.

Stretton

Milton L.

Lackie John

(1995). SITS scenario development mission profiles. (SITS program technical report).

Stretton Milton

Lackie John

(1996). Shipboard instructor training and support: Scenario development functional architecture overview. (SITS program technical report).

Tannenbaum

S. I.

Bowers

J. A. Cannon

Salas

Mathieu

J. E.

(1992). Deriving theoretically-based principles of training effectiveness to optimize training system design. Proceeding of the 14th Annual Interservice/Industry Training Systems Conference (pp. 619–631). San Antonio, TX: National Security Industrial Association.