Start Date
3-4-2015 9:30 AM
End Date
3-4-2015 10:30 AM
Presentation Type
Poster
Abstract
With the advancements of new and emerging technology in the modern cockpit, it is important to understand the effect of these enhancements on performance. Our research seeks to examine both the effect of display type and reliability level on an operator’s performance. The goals of this research are to evaluate and compare the new MATB-II to the original MATB, as well as to further investigate the effect of reliability level in a automated aviation environment.
In the current study, we empirically test the impact of a specified reliability level on performance for a controlled and modernistic automated aviation task. Previous data from participant’s performance on the original system, the MATB, determined that there was a relationship between increased levels of automation reliability and a decreased level of correct error detection (Oakley, Mouloua, & Hancock, 2003). When the newer system was introduced, the MATB-II, Stader et al. (2012) divulged a difference between the two present systems of the Multi-Attribute Task Battery (MATB; Comstock & Arnegard, 2002; & MATB-II, NASA LRC, 2011). The current study seeks to determine if the data from an original MAT study, in relation to reliability, could be recreated by using the MATB and the MATB-II; all the while trying to find a difference in performance between the two systems. A 2 (system; MATB vs MATB-II) X 3 (reliability; 50%, 70%, 90%) mixed model ANOVA was conducted based on the data from 84 participants. Results showed that there was a main effect for system, that participants performed significantly better on the MATB-II (M = 74.26, SD = 26.92) than on the original MATB (M = 53.097, SD = 27.507), F(1,81) = 48.68, p
Included in
Applied Behavior Analysis Commons, Cognition and Perception Commons, Cognitive Psychology Commons, Experimental Analysis of Behavior Commons
Automation Reliability and Performance Detection Using Two Systems of the Multi-Attribute Task Battery
With the advancements of new and emerging technology in the modern cockpit, it is important to understand the effect of these enhancements on performance. Our research seeks to examine both the effect of display type and reliability level on an operator’s performance. The goals of this research are to evaluate and compare the new MATB-II to the original MATB, as well as to further investigate the effect of reliability level in a automated aviation environment.
In the current study, we empirically test the impact of a specified reliability level on performance for a controlled and modernistic automated aviation task. Previous data from participant’s performance on the original system, the MATB, determined that there was a relationship between increased levels of automation reliability and a decreased level of correct error detection (Oakley, Mouloua, & Hancock, 2003). When the newer system was introduced, the MATB-II, Stader et al. (2012) divulged a difference between the two present systems of the Multi-Attribute Task Battery (MATB; Comstock & Arnegard, 2002; & MATB-II, NASA LRC, 2011). The current study seeks to determine if the data from an original MAT study, in relation to reliability, could be recreated by using the MATB and the MATB-II; all the while trying to find a difference in performance between the two systems. A 2 (system; MATB vs MATB-II) X 3 (reliability; 50%, 70%, 90%) mixed model ANOVA was conducted based on the data from 84 participants. Results showed that there was a main effect for system, that participants performed significantly better on the MATB-II (M = 74.26, SD = 26.92) than on the original MATB (M = 53.097, SD = 27.507), F(1,81) = 48.68, p