(Georgia Institute of Technology, 2008-08-20)
Feigh, Karen M.
The thesis begins by examining the evolution of human performance modeling from the initial stimulus-response methods introduced during the industrial revolution to model factory worker productivity, continues with a discussion of the information processing model where human cognition was modeled as a series of actions carried out in a predefined order, and ends with the concept of cognitive control whereby cognition is not considered a context-free mental process but modeled as an individual's ability to maintain control under varying contexts and to counter the effects of disturbances. The results from a preliminary evaluation conducted to determine if CCMs could be measured and if they provided any additional insight cognitive work are presented, and reveal that CCMs could be measured and the self-assessed CCM varied as predicted. A design process is developed which utilizes the CCMs as representing specific patterns of activity, thus specifying the design requirements. Following this design process, a prototype is created and evaluated using a controlled experiment to examine the effectiveness of the CWSS. The experiment examines performance, workload, and patterns of activity, and has several interesting findings. The first is that performance was independent of the almost all of the predictors and covariates including participant's Self-assessed CCM, with the exception of CCM transitions. As in the preliminary study, participants who reported transitioning between CCMs also reported decreased performance, increased frustration and actually performed worse. Second, perceived performance varied linearly with a participant's self-assessed CCM, but not with the actual performance. Third, participants report lower levels of effort when using a CWSS DM that matched their operational CCM. Finally, the design process successfully created a CWSS with DMs which support strategic and tactical CCMs. Unfortunately, no specific performance improvements were found for cases where the participant's CCM matched the DM as hypothesized, calling into question the effectiveness of creating different design modes for performance improvement.
This thesis presents two methods for measuring CCMs: one direct single scale and one indirect composite scale. The measurements correlate highly. Both have a high degree of face validity and user acceptance. In the end, the composite measure may be a more robust measure of CCM because it provides a greater degree of diagnosticity by specifically inquiring after different aspects of CCM and is less susceptible to an individual's interpretation of the relative importance of the multiple dimensions of CCMs included in the definitions.