Date of Award
Spring 5-6-2025
Access Type
Thesis - Open Access
Degree Name
Master of Aerospace Engineering
Department
Aerospace Engineering
Committee Chair
Hao Peng
First Committee Member
Hever Moncayo
Second Committee Member
Morad Nazari
Third Committee Member
Liu Yongxin
College Dean
James W. Gregory
Abstract
This study presents a reinforcement learning (RL) approach for reestablishing communication with deep-space satellites under unknown attitude determination and control system (ADCS) failures. When traditional fault-tolerant control methods cannot restore signal, the proposed RL controller acts as a last-resort measure by autonomously reorienting the satellite’s antenna toward Earth while charging the battery via solar panels. A generic reward function, designed for the RL-based method, enables the controller to adapt to diverse failure scenarios, including severe actuator noise, misalignment, and complete actuator failure. Simulations are conducted in the Basilisk environment and trained with the tonic framework and demonstrate ranging capabilities of the RL-based method across a wide range of ADCS failure modes. The controller not only learned two distinct tasks—antenna pointing and solar charging, but also learned how to point the antenna and maintain battery life in a single control scheme. The proposed method showed great success in noisy, misaligned, and underactuated cases and more notably, this approach obviates the need for prior knowledge of fault conditions or disturbance bounds. Future work will explore online RL algorithms for enhanced real-time adaptability and include hardware-in-the-loop simulations to further validate the method’s viability for deep-space missions.
Scholarly Commons Citation
Willoughby, Matthew, "Satellite Reorientation Using Reinforcement Learning Under Unknown Attitude Failure" (2025). Doctoral Dissertations and Master's Theses. 901.
https://commons.erau.edu/edt/901
Included in
Artificial Intelligence and Robotics Commons, Astrodynamics Commons, Navigation, Guidance, Control and Dynamics Commons