Distributed game strategy for unmanned aerial vehicle formation with external disturbances and obstacles

Yang YUAN; Yimin DENG; Sida LUO; Haibin DUAN

doi:10.1631/FITEE.2100559

Your Location：

Home >

Browse articles >

Distributed game strategy for unmanned aerial vehicle formation with external disturbances and obstacles

Special Feature on Institutionalized and Systematized Gaming (InSys Gaming) for Multi-agent Systems | Updated：2022-09-08

- Distributed game strategy for unmanned aerial vehicle formation with external disturbances and obstacles
- 具有外部干扰和障碍物的无人机编队分布式博弈策略
- Frontiers of Information Technology & Electronic Engineering Vol. 23, Issue 7, Pages: 1020-1031(2022)
- Affiliations：
  
  1.State Key Laboratory of Virtual Reality Technology and Systems, School of Autonomous Science and Electrical Engineering, Beihang University, Beijing100083, China
  2.School of Mechanical Engineering & Automation, Beihang University, Beijing100191, China
  3.Peng Cheng Laboratory, Shenzhen518000, China
- Author bio：
  
  E-mail: yyuan@buaa.edu.cn;
  E-mail: ymdeng@buaa.edu.cn;
  E-mail: s.luo@buaa.edu.cn;
  ‡Corresponding authors
- Funds：
- DOI：10.1631/FITEE.2100559
  CLC： TP242.6
- Received：02 December 2021，
  
  Revised：2022-05-04，
  
  Published Online：12 July 2022，
  
  Published：23 July 2022
- Accepted：
Scan QR Code
Yang YUAN, Yimin DENG, Sida LUO, et al. Distributed game strategy for unmanned aerial vehicle formation with external disturbances and obstacles[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(7): 1020-1031.
DOI：

Yang YUAN, Yimin DENG, Sida LUO, et al. Distributed game strategy for unmanned aerial vehicle formation with external disturbances and obstacles[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(7): 1020-1031. DOI： 10.1631/FITEE.2100559.

摘要

本文研究了具有外部干扰和障碍物的无人机编队分布式博弈策略，该策略基于分布式模型预测控制（MPC）框架和基于Levy飞行的鸽群优化算法（LFPIO）。首先，提出一种非奇异快速终端滑模观测器（NFTSMO）估计无人机受扰动的影响，并利用Lyapunov函数证明该观测器在固定时间内收敛。其次，设计一种基于拓扑重构的避障策略，使无人机能够以较小能量消耗安全通过障碍物。然后，建立一个分布式MPC框架，该框架中每架无人机仅与邻居交换消息，通过设计分布式MPC代价函数，将无人机编队问题转化为博弈问题，并利用基于Levy飞行的鸽群优化算法求解纳什均衡。最后，利用数值仿真对比实验验证所提策略的有效性。

Abstract

We investigate a distributed game strategy for unmanned aerial vehicle (UAV) formations with external disturbances and obstacles. The strategy is based on a distributed model predictive control (MPC) framework and Levy flight based pigeon inspired optimization (LFPIO). First

we propose a non-singular fast terminal sliding mode observer (NFTSMO) to estimate the influence of a disturbance

and prove that the observer converges in fixed time using a Lyapunov function. Second

we design an obstacle avoidance strategy based on topology reconstruction

by which the UAV can save energy and safely pass obstacles. Third

we establish a distributed MPC framework where each UAV exchanges messages only with its neighbors. Further

the cost function of each UAV is designed

by which the UAV formation problem is transformed into a game problem. Finally

we develop LFPIO and use it to solve the Nash equilibrium. Numerical simulations are conducted

and the efficiency of LFPIO based distributed MPC is verified through comparative simulations.

关键词

Keywords

references

Bhat SP , Bernstein DS , 2000 . Finite-time stability of continuous autonomous systems . SIAM J Contr Optim , 38 ( 3 ): 751 - 766 . https://doi.org/10.1137/S0363012997321358 https://doi.org/10.1137/S0363012997321358

Czyżniewski M , Łangowski R , 2022 . A robust sliding mode observer for non-linear uncertain biochemical systems . ISA Trans , 123 : 25 - 45 . https://doi.org/10.1016/j.isatra.2021.05.040 https://doi.org/10.1016/j.isatra.2021.05.040

Dong LF , Chen YZ , Qu XJ , 2016 . Formation control strategy for nonholonomic intelligent vehicles based on virtual structure and consensus approach . Proc Eng , 137 : 415 - 424 . https://doi.org/10.1016/j.proeng.2016.01.276 https://doi.org/10.1016/j.proeng.2016.01.276

Duan HB , Qiao PX , 2014 . Pigeon-inspired optimization: a new swarm intelligence optimizer for air robot path planning . Int J Intell Comput Cybern , 7 ( 1 ): 24 - 37 . https://doi.org/10.1108/IJICC-02-2014-0005 https://doi.org/10.1108/IJICC-02-2014-0005

Feng X , Muramatsu H , Katsura S , 2021 . Differential evolutionary algorithm with local search for the adaptive periodic-disturbance observer adjustment . IEEE Trans Ind Electron , 68 ( 12 ): 12504 - 12512 . https://doi.org/10.1109/TIE.2020.3040664 https://doi.org/10.1109/TIE.2020.3040664

Gu DB , 2008 . A differential game approach to formation control . IEEE Trans Contr Syst Technol , 16 ( 1 ): 85 - 93 . https://doi.org/10.1109/TCST.2007.899732 https://doi.org/10.1109/TCST.2007.899732

He LL , Bai P , Liang XL , et al. , 2018 . Feedback formation control of UAV swarm with multiple implicit leaders . Aerosp Sci Technol , 72 : 327 - 334 . https://doi.org/10.1016/j.ast.2017.11.020 https://doi.org/10.1016/j.ast.2017.11.020

Huo MZ , Duan HB , Fan YM , 2021 . Pigeon-inspired circular formation control for multi-UAV system with limited target information . Guid Navig Contr , 1 ( 1 ): 2150004 . https://doi.org/10.1142/S2737480721500047 https://doi.org/10.1142/S2737480721500047

Jond HB , Nabiyev V , 2019 . On the finite horizon Nash equilibrium solution in the differential game approach to formation control . J Syst Eng Electron , 30 ( 6 ): 1233 - 1242 . https://doi.org/10.21629/JSEE.2019.06.17 https://doi.org/10.21629/JSEE.2019.06.17

Kalsi K , Lian JM , Hui SF , et al. , 2010 . Sliding-mode observers for systems with unknown inputs: a high-gain approach . Automatica , 46 ( 2 ): 347 - 353 . https://doi.org/10.1016/j.automatica.2009.10.040 https://doi.org/10.1016/j.automatica.2009.10.040

Labbadi M , Cherkaoui M , 2019 . Robust adaptive backstepping fast terminal sliding mode controller for uncertain quadrotor UAV . Aerosp Sci Technol , 93 : 105306 . https://doi.org/10.1016/j.ast.2019.105306 https://doi.org/10.1016/j.ast.2019.105306

Labbadi M , Cherkaoui M , 2020 . Robust adaptive nonsingular fast terminal sliding-mode tracking control for an uncertain quadrotor UAV subjected to disturbances . ISA Trans , 99 : 290 - 304 . https://doi.org/10.1016/j.isatra.2019.10.012 https://doi.org/10.1016/j.isatra.2019.10.012

Lee G , Chwa D , 2018 . Decentralized behavior-based formation control of multiple robots considering obstacle avoidance . Intel Serv Robot , 11 ( 1 ): 127 - 138 . https://doi.org/10.1007/s11370-017-0240-y https://doi.org/10.1007/s11370-017-0240-y

Lee SM , Kim H , Myung H , et al. , 2015 . Cooperative coevolutionary algorithm-based model predictive control guaranteeing stability of multirobot formation . IEEE Trans Contr Syst Technol , 23 ( 1 ): 37 - 51 . https://doi.org/10.1109/TCST.2014.2312324 https://doi.org/10.1109/TCST.2014.2312324

Li JQ , Chen S , Li CY , et al. , 2021 . Distributed game strategy for formation flying of multiple spacecraft with disturbance rejection . IEEE Trans Aerosp Electron Syst , 57 ( 1 ): 119 - 128 . https://doi.org/10.1109/TAES.2020.3010593 https://doi.org/10.1109/TAES.2020.3010593

Li W , Yang BW , Song GH , et al. , 2021 . Dynamic value iteration networks for the planning of rapidly changing UAV swarms . Front Inform Technol Electron Eng , 22 ( 5 ): 687 - 696 . https://doi.org/10.1631/FITEE.1900712 https://doi.org/10.1631/FITEE.1900712

Li YB , Hu XM , 2022 . A differential game approach to intrinsic formation control . Automatica , 136 : 110077 . https://doi.org/10.1016/j.automatica.2021.110077 https://doi.org/10.1016/j.automatica.2021.110077

Lin W , 2014 . Distributed UAV formation control using differential game approach . Aerosp Sci Technol , 35 : 54 - 62 . https://doi.org/10.1016/j.ast.2014.02.004 https://doi.org/10.1016/j.ast.2014.02.004

Liu JC , Wu ZX , Yu JZ , et al. , 2021 . Cooperative target tracking in aquatic environment using dual robotic dolphins . IEEE Trans Syst Man Cybern Syst , 51 ( 8 ): 4782 - 4792 . https://doi.org/10.1109/TSMC.2019.2944753 https://doi.org/10.1109/TSMC.2019.2944753

Luo YH , Bai A , Zhang HG , 2021 . Distributed formation control of UAVs for circumnavigating a moving target in three-dimensional space . Guid Navig Contr , 1 ( 3 ): 2150014 . https://doi.org/10.1142/S273748072150014X https://doi.org/10.1142/S273748072150014X

Olfati-Saber R , 2006 . Flocking for multi-agent dynamic systems: algorithms and theory . IEEE Trans Autom Contr , 51 ( 3 ): 401 - 420 . https://doi.org/10.1109/TAC.2005.864190 https://doi.org/10.1109/TAC.2005.864190

Qiu HX , Duan HB , 2020 . A multi-objective pigeon-inspired optimization approach to UAV distributed flocking among obstacles . Inform Sci , 509 : 515 - 529 . https://doi.org/10.1016/j.ins.2018.06.061 https://doi.org/10.1016/j.ins.2018.06.061

Ran MP , Xie LH , Li JC , 2019 . Time-varying formation tracking for uncertain second-order nonlinear multi-agent systems . Front Inform Technol Electron Eng , 20 ( 1 ): 76 - 87 . https://doi.org/10.1631/FITEE.1800557 https://doi.org/10.1631/FITEE.1800557

Ruan WY , Duan HB , 2020 . Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization . Front Inform Technol Electron Eng , 21 ( 5 ): 740 - 748 . https://doi.org/10.1631/FITEE.2000066 https://doi.org/10.1631/FITEE.2000066

Tan GG , Zhuang JY , Zou J , et al. , 2021 . Coordination control for multiple unmanned surface vehicles using hybrid behavior-based method . Ocean Eng , 232 : 109147 . https://doi.org/10.1016/j.oceaneng.2021.109147 https://doi.org/10.1016/j.oceaneng.2021.109147

Trinh MH , van Tran Q , van Vu D , et al. , 2021 . Robust tracking control of bearing-constrained leader-follower formation . Automatica , 131 : 109733 . https://doi.org/10.1016/j.automatica.2021.109733 https://doi.org/10.1016/j.automatica.2021.109733

Wang AJ , Liao XF , Dong T , 2018 . Fractional-order follower observer design for tracking consensus in second-order leader multi-agent systems: periodic sampled-based event-triggered control . J Franklin Inst , 355 ( 11 ): 4618 - 4628 . https://doi.org/10.1016/j.jfranklin.2018.01.036 https://doi.org/10.1016/j.jfranklin.2018.01.036

Wang B , Shen YY , Zhang YM , 2020 . Active fault-tolerant control for a quadrotor helicopter against actuator faults and model uncertainties . Aerosp Sci Technol , 99 : 105745 . https://doi.org/10.1016/j.ast.2020.105745 https://doi.org/10.1016/j.ast.2020.105745

Wang X , Xu B , Cheng YX , et al. , 2022 . Robust adaptive learning control of space robot for target capturing using neural network . IEEE Trans Neur Netw Learn Syst , early access . https://doi.org/10.1109/TNNLS.2022.3144569 https://doi.org/10.1109/TNNLS.2022.3144569

Wang YX , Zhang T , Cai ZH , et al. , 2020 . Multi-UAV coordination control by chaotic grey wolf optimization based distributed MPC with event-triggered strategy . Chin J Aeronaut , 33 ( 11 ): 2877 - 2897 . https://doi.org/10.1016/j.cja.2020.04.028 https://doi.org/10.1016/j.cja.2020.04.028

Wei LL , Chen M , Li T , 2021 . Disturbance-observer-based formation-containment control for UAVs via distributed adaptive event-triggered mechanisms . J Franklin Inst , 358 ( 10 ): 5305 - 5333 . https://doi.org/10.1016/j.jfranklin.2021.04.050 https://doi.org/10.1016/j.jfranklin.2021.04.050

Xia LN , Li Q , Song RZ , et al. , 2022 . Leader-follower time-varying output formation control of heterogeneous systems under cyber attack with active leader . Inform Sci , 585 : 24 - 40 . https://doi.org/10.1016/j.ins.2021.11.026 https://doi.org/10.1016/j.ins.2021.11.026

Xiong Y , Saif M , 2001 . Sliding mode observer for nonlinear uncertain systems . IEEE Trans Autom Contr , 46 ( 12 ): 2012 - 2017 . https://doi.org/10.1109/9.975511 https://doi.org/10.1109/9.975511

Yang HY , Yin S , Han HG , et al. , 2022 . Sparse actuator and sensor attacks reconstruction for linear cyber-physical systems with sliding mode observer . IEEE Trans Ind Inform , 18 ( 6 ): 3873 - 3884 . https://doi.org/10.1109/TII.2021.3111221 https://doi.org/10.1109/TII.2021.3111221

Yang J , Wang XM , Baldi S , et al. , 2019 . A software-in-the-loop implementation of adaptive formation control for fixed-wing UAVs . IEEE/CAA J Autom Sin , 6 ( 5 ): 1230 - 1239 . https://doi.org/10.1109/JAS.2019.1911702 https://doi.org/10.1109/JAS.2019.1911702

Yu Y , Wang HL , Liu SM , et al. , 2021 . Distributed multi-agent target tracking: a Nash-combined adaptive differential evolution method for UAV systems . IEEE Trans Veh Technol , 70 ( 8 ): 8122 - 8133 . https://doi.org/10.1109/TVT.2021.3091575 https://doi.org/10.1109/TVT.2021.3091575

Zhang DF , Duan HB , Yang YJ , 2017 . Active disturbance rejection control for small unmanned helicopters via Levy flight-based pigeon-inspired optimization . Aircraft Eng Aerosp Technol , 89 ( 6 ): 946 - 952 . https://doi.org/10.1108/AEAT-05-2016-0065 https://doi.org/10.1108/AEAT-05-2016-0065

Zhao J , Sun JM , Cai ZH , et al. , 2022 . Distributed coordinated control scheme of UAV swarm based on heterogeneous roles . Chin J Aeronaut , 35 ( 1 ): 81 - 97 . https://doi.org/10.1016/j.cja.2021.01.014 https://doi.org/10.1016/j.cja.2021.01.014

Zheng Z , Cai SC , 2021 . A collaborative target tracking algorithm for multiple UAVs with inferior tracking capabilities . Front Inform Technol Electron Eng , 22 ( 10 ): 1334 - 1350 . https://doi.org/10.1631/FITEE.2000362 https://doi.org/10.1631/FITEE.2000362

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

A UAV-enabled mobile edge computing paradigm for dependent tasks based on a computing power pool

UAV search-and-rescue planning using an adaptive memetic algorithm

Motor speed estimation and failure detection of a small UAV using density of maxima

Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization

Nonlinear path-following method for fixed-wing unmanned aerial vehicles

Related Author

Xiaonan CUI

Wei LI

Hao YUAN

Ming HE

Yan GUO

Xuebin LAI

Yue WANG

Libin HONG

Related Institution

School of Communications Engineering, Army Engineering University of PLA

School of Command and Control Engineering, Army Engineering University of PLA

School of Information Science and Technology, Hangzhou Normal University

College of Computer Science and Technology, Zhejiang University of Technology

Laboratory of System Engineering and Robotics, Federal University of Paraiba, Joao Pessoa

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰