Similar articles

Abstract: Migratory birds depend on the perception of atmospheric updraft for long-distance flight. To realize more efficient autonomous soaring in an unpowered glider, different strategies for using potential sensorimotor cues to achieve autonomous soaring efficiency were compared and optimized. A simulation framework of autonomous soaring for an unpowered glider was developed based on a reinforcement learning algorithm. The framework was composed of three models: an updraft environment model, the glider’s dynamics and control model, and a reinforcement learning agent, which learns to harvest more energy in flight. Based on the simulation, effects of different combinations of 12 potential sensorimotor cues on soaring efficiency were studied. Firstly, the absence of one particular sensorimotor cue and the use of only a single valid cue in autonomous soaring were analyzed. The results showed that the vertical airflow velocity gradient (aw) and the wing-tip updraft velocity difference (τ) have advantages over the other cues. Secondly, strategies combiningaw orτ with other cues were analyzed to achieve more effective autonomous soaring, and seven potentially effective combinations of sensorimotor cues were identified. The final results showed that, among the tested combinations, the combination of vertical airflow velocity (Vw) andτ, enables the most efficient autonomous soaring. This study identified a highly effective sensorimotor cue strategy to guide an intelligent glider to achieve long-distance autonomous soaring flight.

适用于滑翔机高效自主翱翔的感知线索研究

[1]AllenM,2005.Autonomous soaring for improved endurance of a small uninhabitated air vehicle.The 43rd AIAA Aerospace Sciences Meeting and Exhibit, article1025.

[2]ChanWL,LeeCS,HsiaoFB,2011.Real-time approaches to the estimation of local wind velocity for a fixed-wing unmanned air vehicle.Measurement Science and Technology,22(10):105203.

[3]ChungJJ,LawranceNRJ,SukkariehS,2015.Learning to soar: resource-constrained exploration in reinforcement learning.International Journal of Robotics Research,34(2):158-172.

[4]DepenbuschNT,BirdJJ,LangelaanJW,2018a.The AutoSOAR autonomous soaring aircraft part 2: hardware implementation and flight results.Journal of Field Robotics,35(4):435-458.

[5]DepenbuschNT,BirdJJ,LangelaanJW,2018b.The AutoSOAR autonomous soaring aircraft, part 1: autonomy algorithms.Journal of Field Robotics,35(6):868-889.

[6]EdwardsDJ,SilverbergLM,2010.Autonomous soaring: the montague cross-country challenge.Journal of Aircraft,47(5):1763-1769.

[7]EdwardsDJ,KahnAD,KellyM,et al.,2016.Maximizing net power in circular turns for solar and autonomous soaring aircraft.Journal of Aircraft,53(5):1237-1247.

[8]HueyRB,DeutschC,2016.How frigate birds soar around the doldrums.Science,353(6294):26-27.

[9]KahnAD,2017.Atmospheric thermal location estimation.Journal of Guidance, Control, and Dynamics,40(9):2363-2369.

[10]LangelaanJW,AlleyN,NeidhoeferJ,2011.Wind field estimation for small unmanned aerial vehicles.Journal of Guidance, Control, and Dynamics,34(4):1016-1030.

[11]LawranceNRJ,SukkariehS,2011.Autonomous exploration of a wind field with a gliding aircraft.Journal of Guidance, Control, and Dynamics,34(3):719-733.

[12]LiuD,LuF,YangT,et al.,2021.A review of dynamic soaring: a new aapproach to extending the endurance of fixed-wing UAVs.Proceedings of the Unmanned Systems Summit, p.71-77.

[13]MacCreadyPB,1958.Optimum airspeed selector.Soaring,10(11):10.

[14]MooreRJD,ThurrowgoodS,SrinivasanMV,2012.Vision-only estimation of wind field strength and direction from an aerial platform.IEEE/RSJ International Conference on Intelligent Robots and Systems, p.4544-4549.

[15]NotterS,ZürnM,GroßP,et al.,2019.Reinforced learning to cross-country soar in the vertical plane of motion.AIAA Scitech Forum, article1420.

[16]NotterS,SchimpfF,FichterW,2021.Hierarchical reinforcement learning approach towards autonomous cross-country soaring.AIAA Scitech Forum, article2010.

[17]NotterS,MüllerG,FichterW,2022.Integrated updraft localization and exploitation: end-to-end type reinforcement learning approach.Proceedings of the 2022 CEAS EuroGNC conference, CEAS-GNC-2022-077.

[18]PowersTC,SilverbergLM,GopalarathnamA,2020.Artificial lumbered flight for autonomous soaring.Journal of Guidance, Control, and Dynamics,43(3):553-566.

[19]ReddyG,CelaniA,SejnowskiTJ,et al.,2016.Learning to soar in turbulent environments.Proceedings of the National Academy of Sciences of the United States of America,113(33):E4877-E4884.

[20]ReddyG,Wong-NgJ,CelaniA,et al.,2018.Glider soaring via reinforcement learning in the field.Nature,562(7726):236-239.

[21]RhudyMB,LarrabeeT,ChaoHY,et al.,2013.UAV attitude, heading, and wind estimation using GPS/INS and an air data system.AIAA Guidance, Navigation, and Control Conference, article5201.

[22]WaltonC,KaminerI,DobrokhodovV,et al.,2018.Alternate strategies for optimal unmanned aerial vehicle thermaling.Journal of Aircraft,55(6):2347-2356.

[23]WharingtonJ,HerszbergI,1998.Control of a high endurance unmanned air vehicle.Proceedings of the 21st ICAS Congress.

[24]WoodburyTD,DunnC,ValasekJ,2014.Autonomous soaring using reinforcement learning for trajectory generation.The 52nd Aerospace Sciences Meeting, article0990.

[25]ZhaoJC,LiJ,ZengLF,2023.Energy-harvesting strategy investigation for glider autonomous soaring using reinforcement learning.Aerospace,10(10):895.