The Effect of Testing Location and Task Complexity on Usability Testing Performance and User-Reported Stress Levels
Date of Award
Thesis - Open Access
Master of Science in Human Factors & Systems
Human Factors and Systems
Dahai Liu, PhD
Christina Frederick-Recascino, PhD
Hong Liu, PhD
Usability testing is becoming a more important part of the software design process. New methods allow remote usability testing to occur. Remote testing can be less costly and allow more data to be collected in less time in many cases, provided the user can still provide meaningful data. However, little is known about differences in the user experience between the two testing methods. In an effort to find differences in user experience between remote and traditional website usability testing, this study randomly assigned participants into two groups, one completing a usability test in a traditional lab setting, while the other group utilizing a remote testing location. Both groups completed two tasks, one simple, one complex, using Amazon.com as a test interface. Task time and number of critical incidents reported were the dependent measures. Significant differences were found for task times both in the between and within-subjects conditions for task times. Task times differed significantly between task types; the complex task took generally twice as long as the simple task. No significant differences were found for critical incident reports for both the between and within-subjects conditions. Participants seemed hesitant to report interface problems, preferring to struggle through the task until they satisfied task requirements. Subjective user assessments of the task and website were similar across both conditions. User behavior navigating the site was remarkably similar in both test conditions. Results suggest a similar user testing experience for remote and traditional laboratory usability testing.
Scholarly Commons Citation
Andrzejczak, Chris, "The Effect of Testing Location and Task Complexity on Usability Testing Performance and User-Reported Stress Levels" (2004). Master's Theses - Daytona Beach. 13.