Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation

Abstract

Both optimization techniques and expert systems technologies are popular approaches for developing tools to assist in complex problem-solving tasks. Because of the underlying complexity of many such tasks, however, the models of the world implicitly or explicitly embedded in such tools are often incomplete and the problem-solving methods fallible. The result can be "brittleness" in situations that were not anticipated by the system designers. To deal with this weakness, it has been suggested that "cooperative" rather than "automated" problem-solving systems be designed. Such cooperative systems are proposed to explicitly enhance the collaboration of the person (or a group of people) and the computer system. This study evaluates the impact of alternative design concepts on the performance of 30 airline pilots interacting with such a cooperative system designed to support en-route flight planning. The results clearly demonstrate that different system design concepts can strongly influence the cognitive processes and resultant performances of users. Based on think-aloud protocols, cognitive models are proposed to account for how features of the computer system interacted with specific types of scenarios to influence exploration and decision making by the pilots. The results are then used to develop recommendations for guiding the design of cooperative systems.

Get full access to this article

View all access options for this article.

References

Cohen, M. S. , Leddo, J. H. , and Tolcott, M. A. (1989). Personalized and prescriptive aids for commercial air flight replanning (Report 89–2). Reston, VA: Decision Science Consortium, Inc.

Coombs, M. , and Alty, J. (1987). Expert systems; An alternative paradigm. International Journal of Man-Machine Studies, 20, 21–43.

Elstein, A. , Shulman, L. , and Sprafka, S. (1978). Medical problem solving: An analysis and clinical reasoning. Cambridge, MA: Harvard University Press.

Fraser, J. M. , Smith, P. J. , and Smith, J. W. , Jr. (1992). catalog of errors. International Journal of Man-Machine Studies, 37, 265–307.

Hayes-Roth, B. , and Hayes-Roth, F. (1979). A cognitive model of planning. Cognitive Science, 3, 275–310.

Hoc, J. M. (1988). Cognitive psychology of planning. London: Academic.

Johannsen, G. , and Rouse, W. B. (1983). Studies of planning behavior of aircraft pilots in normal, abnormal, and emergency situations. IEEE Transactions on Systems, Man and Cybernetics, 13, 267–278.

Lehner, P. E. , and Zirk, D. A. (1987). Cognitive factors in user/expert-system interaction. Human Factors, 29, 97–109.

Miller, G. A. , Galanter, E. , and Pribram, K. H. (1960). Plans and the structure of behavior. New York: Holt.

10.

Robertson, S. , Zachery, W. , and Black, J. (Eds.). (1990). Cognition, computing and cooperation. Norwood, NJ: Ablex.

11.

Rudolph, F. M. , Homoki, D. A. , and Sexton, G. A. (1990). “Diverter” decision aiding for in-flight diversions (Contractor Report 182070). Hampton, VA: NASA.

12.

Sacerdoti, E. D. (1974). Planning in a hierarchy of abstraction spaces. Artificial Intelligence, 5, 115–135.

13.

Schank, R. , and Abelson, R. (1977). Scripts, plans, goals, and understanding. Hillsdale, NJ: Erlbaum.

14.

Shute, S. , and Smith, P. J. (1993). Knowledge-based search tactics. Information Processing and Management, 29, 29–45.

15.

Smith, P. J. , McCoy, E. , Layton, C. , and Bihari, T. (1992). Design concepts for the development of cooperative problem-solving systems (OSU Tech. Report CSEL-1992–07). Columbus, OH: Ohio State University, Department of Industrial and Systems Engineering.

16.

Sorensen, J. A. , Waters, M. H. , and Patmore, L. C. (1983). Computer programs for generation and evaluation of near-optimum vertical flight profiles (Contractor Report 3688). Hampton, VA: NASA.

17.

Stefik, M. (1981). Planning with constraints: MOLGEN part I. Artificial Intelligence, 16, 111–140.

18.

Suchman, L. A. (1987). Plans and situated actions: The problem of human machine communication. New York: Cambridge University Press.

19.

Thierauf, R. J. (1988). User-oriented decision support systems: Accent on problem finding. Englewood Cliffs, NJ: Prentice Hall.

20.

Tversky, A. (1972). Elimination by aspects: A theory of choice. Psychological Review, 79, 281–299.

21.

Wilensky, R. (1983). Planning and understanding: A computational approach to human reasoning. Reading, MA: Addison-Wesley.