A collaborative target tracking algorithm for multiple UAVs with inferior tracking capabilities

Zhi ZHENG; Shuncheng CAI

doi:10.1631/FITEE.2000362

Your Location：

Home >

Browse articles >

A collaborative target tracking algorithm for multiple UAVs with inferior tracking capabilities

Regular Papers | Updated：2022-01-05

- A collaborative target tracking algorithm for multiple UAVs with inferior tracking capabilities
- 一种跟踪性能不占优的多无人机协同目标跟踪方法
- Frontiers of Information Technology & Electronic Engineering Vol. 22, Issue 10, Pages: 1334-1350(2021)
- Affiliations：
  
  College of Computer and Cyber Security, Fujian Normal University, Fuzhou 350117, China
- Author bio：
  
  Zhi ZHENG, E-mail: zhengz@fjnu.edu.cn
- Funds：
- DOI：10.1631/FITEE.2000362
  CLC： TP391
- Received：20 July 2020，
  
  Revised：2021-;8-16，
  
  Accepted：31 March 2021，
  
  Published：2021-10
- Accepted：
Scan QR Code
Zhi ZHENG, Shuncheng CAI. A collaborative target tracking algorithm for multiple UAVs with inferior tracking capabilities[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(10): 1334-1350.
DOI：

Zhi ZHENG, Shuncheng CAI. A collaborative target tracking algorithm for multiple UAVs with inferior tracking capabilities[J]. Frontiers of Information Technology & Electronic Engineering, 2021, 22(10): 1334-1350. DOI： 10.1631/FITEE.2000362.

摘要

目标跟踪是无人机领域研究热点之一。本文针对无人机跟踪性能不占优，以及目标具有灵活、智能运动特征的情形，研究了多无人机协同目标跟踪问题。提出一种基于目标意图估计的多无人机协同跟踪策略。首先设计了一种具有降维和最大感知覆盖约束的轨迹特征提取方法，以降低无人机跟踪代价，并对目标典型的3类运动模式，根据环境和目标轨迹主要特征，设计了一种意图估计方法；然后，设计了一种在障碍物环境中基于最小可达距离和最小转角代价的MDA-Voronoi图，证明分析了目标被感知的概率；接着，设计了无人机的协同跟踪策略，以减小目标跟踪丢失的间隙，增加目标被感知的时间；通过纳什

学习方法，在奖励函数中考虑了避障、跟踪代价、感知质量、飞行约束等因素，将最优动作策略作为无人机的控制输入。最后，通过仿真验证了本文方法能在无人机跟踪性能不占优的情况下提高跟踪质量。

Abstract

Target tracking is one of the hottest topics in the field of drone research. In this paper

we study the multiple unmanned aerial vehicles (multi-UAV) collaborative target tracking problem. We propose a novel tracking method based on intention estimation and effective cooperation for UAVs with inferior tracking capabilities to track the targets that may have agile

uncertain

and intelligent motion. For three classic target motion modes

we first design a novel trajectory feature extraction method with the least dimension and maximum coverage constraints

and propose an intention estimation mechanism based on the environment and target trajectory features. We propose a novel Voronoi diagram

called MDA-Voronoi

which divides the area with obstacles according to the minimum reachable distance and the minimum steering angle of each UAV. In each MDA-Voronoi region

the maximum reachable region of each UAV is defined

the upper and lower bounds of the trajectory coverage probability are analyzed

and the tracking strategies of the UAVs are designed to effectively reduce the tracking gaps to improve the target sensing time. Then

we use the Nash Q-learning method to design the UAVs' collaborative tracking strategy

considering factors such as collision avoidance

maneuvering constraints

tracking cost

sensing performance

and path overlap. By designing the reward mechanism

the optimal action strategies are obtained as the control input of the UAVs. Finally

simulation analyses are provided to validate our method

and the results demonstrate that the algorithm can improve the collaborative target tracking performance for multiple UAVs with inferior tracking capabilities.

关键词

Keywords

references

A Adepegba , , , MS Miah , , , D Spinello . . Multi-agent area coverage control using reinforcement learning . . Proc 29 th Int Florida Artificial Intelligence Research Society Conf , , 2016 . . p.368 - - 373 . . . .

SV Bordonaro , , , P Willett , , , Y Bar-Shalom , , , 等 . . Converted measurement sigma point Kalman filter for bistatic sonar and radar tracking . . IEEE Trans Aerosp Electron Syst , , 2019 . . 55 ( ( 1 ): ): 147 - - 159 . . DOI: 10.1109/TAES.2018.2849179 http://doi.org/10.1109/TAES.2018.2849179 . .

J Cai , , , CQ Huang , , , HF Guo . . Multi-sensor cooperative tracking using distributed Nash Q-learning . . Adv Mater Res , , 2012 . . 591-593 1475 - - 1478 . . DOI: 10.4028/www.scientific.net/AMR.591-593.1475 http://doi.org/10.4028/www.scientific.net/AMR.591-593.1475 . .

B Di , , , R Zhou , , , ZN Dong . . Cooperative localization and tracking of multiple targets with the communication-aware unmanned aerial vehicle system . . Contr Dec , , 2016 . . 31 ( ( 4 ): ): 616 - - 622 . . DOI: 10.13195/j.kzyjc.2015.0145 http://doi.org/10.13195/j.kzyjc.2015.0145 . .

JA Douthwaite , , , SY Zhao , , , LS Mihaylova . . Velocity obstacle approaches for multi-agent collision avoidance . . Unmann Syst , , 2019 . . 7 ( ( 1 ): ): 55 - - 64 . . DOI: 10.1142/S2301385019400065 http://doi.org/10.1142/S2301385019400065 . .

GQ Gao , , , B Xin . . A-STC: auction-based spanning tree coverage algorithm for motion planning of cooperative robots . . Front Inform Technol Electron Eng , , 2019 . . 20 ( ( 1 ): ): 18 - - 31 . . DOI: 10.1631/FITEE.1800551 http://doi.org/10.1631/FITEE.1800551 . .

A Goldhoorn , , , A Garrell , , , R Alquĺęzar , , , 等 . . Searching and tracking people with cooperative mobile robots . . Auton Robot , , 2018 . . 42 ( ( 4 ): ): 739 - - 759 . . DOI: 10.1007/s10514-017-9681-6 http://doi.org/10.1007/s10514-017-9681-6 . .

JL Hu , , , MP Wellman . . Nash Q-learning for general-sum stochastic games . . J Mach Learn Res , , 2003 . . 4 1039 - - 1069 . . . .

H Jiang , , , YQ Liang . . Online path planning of autonomous UAVs for bearing-only standoff multi-target following in threat environment . . IEEE Access , , 2018 . . 6 22531 - - 22544 . . DOI: 10.1109/ACCESS.2018.2824849 http://doi.org/10.1109/ACCESS.2018.2824849 . .

MB Khalkhali , , , A Vahedian , , , HS Yazdi . . Multi-target state estimation using interactive Kalman filter for multi-vehicle tracking . . IEEE Trans Intell Transp Syst , , 2020 . . 21 ( ( 3 ): ): 1131 - - 1144 . . DOI: 10.1109/TITS.2019.2902664 http://doi.org/10.1109/TITS.2019.2902664 . .

TC Li . . Single-road-constrained positioning based on deterministic trajectory geometry . . IEEE Commun Lett , , 2019 . . 23 ( ( 1 ): ): 80 - - 83 . . DOI: 10.1109/LCOMM.2018.2879478 http://doi.org/10.1109/LCOMM.2018.2879478 . .

TC Li , , , JY Su , , , W Liu , , , 等 . . Approximate Gaussian conjugacy: parametric recursive filtering under nonlinearity, multimodality, uncertainty, and constraint, and beyond . . Front Inform Technol Electron Eng , , 2017 . . 18 ( ( 12 ): ): 1913 - - 1939 . . DOI: 10.1631/FITEE.1700379 http://doi.org/10.1631/FITEE.1700379 . .

TC Li , , , HM Chen , , , SD Sun , , , 等 . . Joint smoothing and tracking based on continuous-time target trajectory function fitting . . IEEE Trans Autom Sci Eng , , 2019 . . 16 ( ( 3 ): ): 1476 - - 1483 . . DOI: 10.1109/TASE.2018.2882641 http://doi.org/10.1109/TASE.2018.2882641 . .

YS Liu , , , QX Wang , , , HS Hu , , , 等 . . A novel real-time moving target tracking and path planning system for a quadrotor UAV in unknown unstructured outdoor scenes . . IEEE Trans Syst Man Cybern Syst , , 2019 . . 49 ( ( 11 ): ): 2362 - - 2372 . . DOI: 10.1109/TSMC.2018.2808471 http://doi.org/10.1109/TSMC.2018.2808471 . .

W Meng , , , ZR He , , , R Su , , , 等 . . Decentralized multi-UAV flight autonomy for moving convoys search and track . . IEEE Trans Contr Syst Technol , , 2017 . . 25 ( ( 4 ): ): 1480 - - 1487 . . DOI: 10.1109/TCST.2016.2601287 http://doi.org/10.1109/TCST.2016.2601287 . .

SAP Quintero , , , DA Copp , , , JP Hespanha . . Robust UAV coordination for target tracking using output-feedback model predictive control with moving horizon estimation . . American Control Conf , , 2015 . . p. 3758 - - 3764 . . DOI: 10.1109/ACC.2015.7171914 http://doi.org/10.1109/ACC.2015.7171914 . .

S Ragi , , , EKP Chong . . Dynamic UAV path planning for multitarget tracking . . American Control Conf , , 2012 . . p. 3845 - - 3850 . . DOI: 10.1109/ACC.2012.6314653 http://doi.org/10.1109/ACC.2012.6314653 . .

S Ragi , , , EKP Chong . . Decentralized control of unmanned aerial vehicles for multitarget tracking . . Int Conf on Unmanned Aircraft Systems , , 2013 . . p. 260 - - 268 . . DOI: 10.1109/ICUAS.2013.6564698 http://doi.org/10.1109/ICUAS.2013.6564698 . .

WY Ruan , , , HB Duan . . Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization . . Front Inform Technol Electron Eng , , 2020 . . 21 ( ( 5 ): ): 740 - - 748 . . DOI: 10.1631/FITEE.2000066 http://doi.org/10.1631/FITEE.2000066 . .

Y Shao , , , ZF Zhao , , , RP Li , , , 等 . . Target detection for multi-UAVs via digital pheromones and navigation algorithm in unknown environments . . Front Inform Technol Electron Eng , , 2020 . . 21 ( ( 5 ): ): 796 - - 808 . . DOI: 10.1631/FITEE.1900659 http://doi.org/10.1631/FITEE.1900659 . .

G Skorobogatov , , , C Barrado , , , E Salamí . . Multiple UAV systems: a survey . . Unmann Syst , , 2020 . . 8 ( ( 2 ): ): 149 - - 169 . . DOI: 10.1142/S2301385020500090 http://doi.org/10.1142/S2301385020500090 . .

WH Song , , , JA Wang , , , SY Zhao , , , 等 . . Event-triggered cooperative unscented Kalman filtering and its application in multi-UAV systems . . Automatica , , 2019 . . 105 ( ( 3 ): ): 264 - - 273 . . DOI: 10.1016/j.automatica.2019.03.029 http://doi.org/10.1016/j.automatica.2019.03.029 . .

RS Sutton , , , AG Barto . . Introduction to Reinforcement Learning , , : : Cambridge, MA, USA MIT Press , , 1998 . . .

F Vanegas , , , D Campbell , , , M Eich , , , 等 . . UAV based target finding and tracking in GPS-denied and cluttered environments . . IEEE/RSJ Int Conf on Intelligent Robots and Systems , , 2016 . . p.2307 - - 2313 . . DOI: 10.1109/IROS.2016.7759360 http://doi.org/10.1109/IROS.2016.7759360 . .

DB Wang , , , Y Wang , , , WY Jiang , , , 等 . . Unmanned aerial vehicles cooperative path planning for ground target tracking via chemical reaction optimization . . Sci Sin Technol , , 2015 . . 45 ( ( 6 ): ): 583 - - 594 . . DOI: 10.1360/N092015-00126 http://doi.org/10.1360/N092015-00126 . .

L Wang , , , H Peng , , , HY Zhu , , , 等 . . Cooperative tracking of ground moving target using unmanned aerial vehicles in cluttered environment . . Contr Theor Appl , , 2011 . . 28 ( ( 3 ): ): 300 - - 308 . . . .

T Wang , , , RX Qin , , , Y Chen , , , 等 . . A reinforcement learning approach for UAV target searching and tracking . . Multim Tools Appl , , 2019 . . 78 ( ( 4 ): ): 4347 - - 4364 . . DOI: 10.1007/s11042-018-5739-5 http://doi.org/10.1007/s11042-018-5739-5 . .

P Yao , , , HL Wang , , , ZK Su . . Real-time path planning of unmanned aerial vehicle for target tracking and obstacle avoidance in complex dynamic environment . . Aerosp Sci Technol , , 2015 . . 47 ( ( 6 ): ): 269 - - 279 . . DOI: 10.1016/j.ast.2015.09.037 http://doi.org/10.1016/j.ast.2015.09.037 . .

HL Yu , , , K Meier , , , M Argyle , , , 等 . . Cooperative path planning for target tracking in urban environments using unmanned air and ground vehicles . . IEEE/ASME Trans Mech , , 2015 . . 20 ( ( 2 ): ): 541 - - 552 . . DOI: 10.1109/TMECH.2014.2301459 http://doi.org/10.1109/TMECH.2014.2301459 . .

MD Zollars , , , RG Cobb , , , DJ Grymin . . Optimal SUAS path planning in three-dimensional constrained environments . . Unmann Syst , , 2019 . . 7 ( ( 2 ): ): 105 - - 118 . . DOI: 10.1142/S2301385019500031 http://doi.org/10.1142/S2301385019500031 . .

Views

102

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰