Presenter Email
jonlars@huconglobal.com
Location
Jim W. Henderson Administration & Welcome Center (Bldg. #602)
Start Date
8-14-2017 9:00 AM
End Date
8-14-2017 10:15 AM
Submission Type
Presentation
Other Topic Area
Assessment of performance
Keywords
Integrated assessment of technical and non-technical skills
Abstract
The aviation industry has focused on assessment of non-technical skills and human factors for decades. The ICAO Doc 9995, the IATA EBT implementation guide, authorities and operators are moving towards an evidence-based approach to training and assessment. This presentation will address practical and methodological challenges the FTO’s and instructors are facing when also aiming for evidence-based learning.
A core issue is that performance in the simulator should be addressed by integrating assessment of technical and non-technical skills. Secondly, this assessment regime should be compatible to instructor’s working conditions; usually running the simulator while having observation as a main task. Thirdly, the assessment methodology should provide the instructor/assessor and the assessed pilots with data applicable for further learning regarding both technical proficiency and how human factors influence performance. A fourth need is to provide the FTO with data pertaining to training objectives, standardization of instructor practices, documentation of training activities and organizational learning.
Pilots are working in a complex operative environment and flight safety requires spectrum of competencies and skills that need to be addressed. A traditional approach to this gives an overwhelming number of behavior indicators and the impact of different operative conditions remains a challenge to the validity of the ratings given. We propose an assessment model with a set of generic variables and indicators which mitigate the instructor workload problem, ties the assessments directly to the operative development as observed by the local expert instructor knowing the operation, and provides the FTO with the needed data.
Presenter Biography
Jon Lars Syversen is Senior Psychologist and Chairman of the Board in Hucon Global AS, and for almost 30 years also Director of Scandinavian Institute of Aviation Psychology, SIAP Norway. He has worked as an advisor and consultant delivering assessments, selection, training and leadership development for a wide range of organizations in risk-sensitive industries and the military. His main activity has been selection to flying training schools, helicopter companies and airlines like SAS and Thai Airways International.
Together with SAS Captain Tor Henrik Krokstad he started Hucon Global Ltd in 2010. They share experiences from CRM and Commander training, and also the idea that training and assessment of non-technical skills should be more closely integrated to those of technical and operative skills.
To this end they have developed the “Integrated Assessment Program” – IAP. IAP is a philosophy and approach to training, and it is a tool that now is fully implemented in the leading offshore helicopter company Bristow Norway, employing about 300 pilots. IAP is also used in maritime training and an adapted version is presently being tested for assessment of trauma team performance at George Washington University Hospital.
Hucon Global AS (Norway) is an industrial partner to ERAU in the COE TTHP/FAA Project. In parallel they also have an ongoing project with ERAU regarding assessment methodology and training of ATC’s.
This presentation shows how the objectives of “Evidence-based training”, as recommended by ICAO, EASA and IATA, can be achieved while focusing on learning both for the trainee and for the training organization.
Original PowerPoint, Full-res
The Evidence-Based Approach to Learning
Jim W. Henderson Administration & Welcome Center (Bldg. #602)
The aviation industry has focused on assessment of non-technical skills and human factors for decades. The ICAO Doc 9995, the IATA EBT implementation guide, authorities and operators are moving towards an evidence-based approach to training and assessment. This presentation will address practical and methodological challenges the FTO’s and instructors are facing when also aiming for evidence-based learning.
A core issue is that performance in the simulator should be addressed by integrating assessment of technical and non-technical skills. Secondly, this assessment regime should be compatible to instructor’s working conditions; usually running the simulator while having observation as a main task. Thirdly, the assessment methodology should provide the instructor/assessor and the assessed pilots with data applicable for further learning regarding both technical proficiency and how human factors influence performance. A fourth need is to provide the FTO with data pertaining to training objectives, standardization of instructor practices, documentation of training activities and organizational learning.
Pilots are working in a complex operative environment and flight safety requires spectrum of competencies and skills that need to be addressed. A traditional approach to this gives an overwhelming number of behavior indicators and the impact of different operative conditions remains a challenge to the validity of the ratings given. We propose an assessment model with a set of generic variables and indicators which mitigate the instructor workload problem, ties the assessments directly to the operative development as observed by the local expert instructor knowing the operation, and provides the FTO with the needed data.
Comments
Presented during Session 1: Advances in Flight Training
Hucon Global AS (Norway) is an industrial partner to ERAU in the COE TTHP/FAA Project. We also have a separate agreement with ERAU regarding assessment methodology and training in aviation (pilots and ATC's).