Assessing the usefulness of domain and methodological tutorials for novice users employing an expert system as an advice-giving tool.

Abstract

The purpose of this dissertation is to examine the impact of domain and methodological tutorials on the attitude and performance of end-users who are neither well-versed in the domain area nor well-versed with an expert system which is designed to assist them in solving software selection tasks. With respect to these tasks and the mechanism for accomplishing them, the end-users can be categorized as "non-technical users." The design of this experiment was a 2 x 2 full factorial laboratory experiment employing eighty novice users as subjects. Each of the experimental subjects was randomly assigned to one of the four treatment groups corresponding to receipt or lack of receipt of tutorials concerning the problem domain and methodology employed by an expert system. The results of this research indicate that there is a significant interaction between receiving the application and expert system tutorial videos; better performance in terms of correct categorization of problems was observed in subjects who saw either both or neither video whereas worse performance was observed in subjects who saw only one video. In general, the video treatments were unrelated to a variety of attitude measures applied to the subjects. However, it was found that prior attitudes towards the use of computers were significantly related to the majority of the (posttest) attitude measures. Further, the general pattern was for attitudes towards computers to improve as a result of undergoing the experimental process with the viewing of the expert system video to be significant in the level of improvement.