Accéder directement au contenu Accéder directement à la navigation
Nouvelle interface
Communication dans un congrès

Acceleration-based Quadrotor Guidance Under Time Delays Using Deep Reinforcement Learning

Abstract : This paper investigates the use of deep reinforcement learning to act as closed-loop guidance for quadrotors and the ability for such a system to be trained entirely in simulation before being transferred for use on a real quadrotor. It improves upon previous work where velocity-based deep reinforcement learning was used to guide the motion of spacecraft. Here, an acceleration-based closed-loop deep reinforcement learning guidance system is developed and compared to previous work. In addition, state augmentation is included due to dynamics delays present. Simulated results show acceleration-based deep reinforcement learning closed-loop guidance has significant performance benefits compared to velocity-based guidance in previous work, namely: a simpler reward function, less overshoot, and better steady-state error. To evaluate the ability for this system to be used on a real quadrotor, the trained system is deployed to the Paparazzi aircraft simulation software, and is implemented on real flight hardware at École Nationale de l’Aviation Civile for an experimental comparison. Experimental results confirm the simulated results—that acceleration-based deep guidance outperforms velocity-based deep guidance and should therefore be used in future work.
Type de document :
Communication dans un congrès
Liste complète des métadonnées

https://hal-enac.archives-ouvertes.fr/hal-03098784
Contributeur : Laurence Porte Connectez-vous pour contacter le contributeur
Soumis le : mardi 5 janvier 2021 - 20:40:40
Dernière modification le : mardi 19 octobre 2021 - 11:02:55

Identifiants

Collections

Citation

Kirk Hovell, Steve Ulrich, Murat Bronz. Acceleration-based Quadrotor Guidance Under Time Delays Using Deep Reinforcement Learning. AIAA Scitech 2021 Forum, Jan 2021, Virtual event, United States. ⟨10.2514/6.2021-1751⟩. ⟨hal-03098784⟩

Partager

Métriques

Consultations de la notice

91