Proposal Type
Research Roundtable Presentation
Start Date
22-1-2026 9:15 AM
End Date
22-1-2026 10:30 AM
Abstract
The purpose of this preliminary study was to test, evaluate, and contribute to validation of the utility of a Pilot Intervention Rating Scale (PIRS) for identifying and categorizing pilot saves as evidenced in voluntary safety reports submitted to the Aviation Safety Reporting System (ASRS). Narratives were text mined for the keywords "automation AND intervention", and derivatives thereof. The reports were then analyzed for relevancy to a pilot intervention of an automated task, which yielded a subset of 35 reports. The PIRS was then applied to each report and a numerical score was assigned based on the consequence of the threat had the pilot not intervened. The results indicated that the preponderance of pilot interventions yielded a high PIRS score corresponding to an unmitigated consequence of an emergency condition. Specifically, the findings revealed gaps in the capability of automated systems to accommodate excessive deviations in track, airspeed, altitude, or attitude in critical phases of flight, which would need to be resolved prior to certification of any fully autonomous aircraft. In addition, the study demonstrated the use of a PIRS decision tree for determining a quantitative multi-level score that categorizes pilot interventions for comparisons and/or consolidation with the findings from other types of voluntary and mandatory safety reports.
Application of a Pilot Intervention Rating Scale to Aviation Safety Reporting System Reports
The purpose of this preliminary study was to test, evaluate, and contribute to validation of the utility of a Pilot Intervention Rating Scale (PIRS) for identifying and categorizing pilot saves as evidenced in voluntary safety reports submitted to the Aviation Safety Reporting System (ASRS). Narratives were text mined for the keywords "automation AND intervention", and derivatives thereof. The reports were then analyzed for relevancy to a pilot intervention of an automated task, which yielded a subset of 35 reports. The PIRS was then applied to each report and a numerical score was assigned based on the consequence of the threat had the pilot not intervened. The results indicated that the preponderance of pilot interventions yielded a high PIRS score corresponding to an unmitigated consequence of an emergency condition. Specifically, the findings revealed gaps in the capability of automated systems to accommodate excessive deviations in track, airspeed, altitude, or attitude in critical phases of flight, which would need to be resolved prior to certification of any fully autonomous aircraft. In addition, the study demonstrated the use of a PIRS decision tree for determining a quantitative multi-level score that categorizes pilot interventions for comparisons and/or consolidation with the findings from other types of voluntary and mandatory safety reports.
