Cooperative planning of multi-agent systems based on task-oriented knowledge fusion with graph neural networks

Hanqi DAI; Weining LU; Xianglong LI; Jun YANG; Deshan MENG; Yanze LIU; Bin LIANG

doi:10.1631/FITEE.2100597

Your Location：

Home >

Browse articles >

Cooperative planning of multi-agent systems based on task-oriented knowledge fusion with graph neural networks

Special Feature on Institutionalized and Systematized Gaming (InSys Gaming) for Multi-agent Systems | Updated：2022-09-08

- Cooperative planning of multi-agent systems based on task-oriented knowledge fusion with graph neural networks
- 基于融合任务信息图神经网络的多智能体系统协同规划
- Frontiers of Information Technology & Electronic Engineering Vol. 23, Issue 7, Pages: 1069-1076(2022)
- Affiliations：
  
  1.Department of Automation, Tsinghua University, Beijing100084, China
  2.Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing100084, China
  3.Office of Science and Technology, Tianjin University, Tianjin300350, China
  4.School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzhen518107, China
  5.Faculty Office of Electrical and Electronics Engineering, University of Nottingham, Ningbo315154, China
- Author bio：
  
  E-mail: dhq19@mails.tsinghua.edu.cn;
  ‡Corresponding authors
- Funds：
- DOI：10.1631/FITEE.2100597
  CLC： TP242.6
- Received：31 December 2021，
  
  Accepted：23 May 2022，
  
  Published：23 July 2022
- Accepted：
Scan QR Code
Hanqi DAI, Weining LU, Xianglong LI, et al. Cooperative planning of multi-agent systems based on task-oriented knowledge fusion with graph neural networks[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(7): 1069-1076.
DOI：

Hanqi DAI, Weining LU, Xianglong LI, et al. Cooperative planning of multi-agent systems based on task-oriented knowledge fusion with graph neural networks[J]. Frontiers of Information Technology & Electronic Engineering, 2022, 23(7): 1069-1076. DOI： 10.1631/FITEE.2100597.

摘要

协同规划是多智能体系统博弈领域的关键问题之一。本文聚焦每个智能体只有一个局部观测范围和局部通信情况下的协作规划。提出一种新型协同规划框架，该框架将图神经网络与融合任务信息采样方法相结合。本文的两个主要贡献是基于与前期工作的比较：（1）使用图采样与聚合方法（GraphSAGE）实现动态近邻智能体信息融合，这是该方法首次用于处理协同规划问题；（2）提出一种面向任务的采样方法，从特定方向聚合知识，使所提模型获得高效、稳定的训练过程。实验结果证明了所提方法的有效性。

Abstract

Cooperative planning is one of the critical problems in the field of multi-agent system gaming. This work focuses on cooperative planning when each agent has only a local observation range and local communication. We propose a novel cooperative planning architecture that combines a graph neural network with a task-oriented knowledge fusion sampling method. Two main contributions of this paper are based on the comparisons with previous work: (1) we realize feasible and dynamic adjacent information fusion using GraphSAGE (i.e.

Graph SAmple and aggreGatE)

which is the first time this method has been used to deal with the cooperative planning problem

and (2) a task-oriented sampling method is proposed to aggregate the available knowledge from a particular orientation

to obtain an effective and stable training process in our model. Experimental results demonstrate the good performance of our proposed method.

关键词

Keywords

references

Barer M , Sharon G , Stern R , et al. , 2014 . Suboptimal variants of the conflict-based search algorithm for the multi-agent pathfinding problem . Proc 21 st European Conf on Artificial Intelligence , p. 961 - 962 . doi: 10.3233/978-1-61499-419-0-961 http://doi.org/10.3233/978-1-61499-419-0-961

Dresner K , Stone P , 2008 . A multiagent approach to autonomous intersection management . J Artif Intell Res , 31 ( 1 ): 591 - 656 .

Enright JJ , Wurman PR , 2011 . Optimization and coordinated autonomy in mobile fulfillment systems . Proc 9 th AAAI Conf on Automated Action Planning for Autonomous Mobile Robots , p. 33 - 38 .

Hamilton WL , Ying R , Leskovec J , 2017 . Inductive representation learning on large graphs . Proc 31 st Int Conf on Neural Information Processing Systems , p. 1025 - 1035 .

Krizhevsky A , Sutskever I , Hinton GE , 2017 . ImageNet classification with deep convolutional neural networks . Commun ACM , 60 ( 6 ): 84 - 90 . doi: 10.1145/3065386 http://doi.org/10.1145/3065386

Li QB , Gama F , Ribeiro A , et al. , 2020 . Graph neural networks for decentralized multi-robot path planning . IEEE/RSJ Int Conf on Intelligent Robots and Systems , p. 11785 - 11792 . doi: 10.1109/IROS45743.2020.9341668 http://doi.org/10.1109/IROS45743.2020.9341668

López J , Pérez D , Zalama E , 2011 . A framework for building mobile single and multi-robot applications . Robot Autonom Syst , 59 ( 3-4 ): 151 - 162 . doi: 10.1016/j.robot.2011.01.004 http://doi.org/10.1016/j.robot.2011.01.004

Ortega A , Frossard P , Kovačević J , et al. , 2018 . Graph signal processing: overview, challenges, and applications . Proc IEEE , 106 ( 5 ): 808 - 828 . doi: 10.1109/JPROC.2018.2820126 http://doi.org/10.1109/JPROC.2018.2820126

Prorok A , Kumar V , 2017 . Privacy-preserving vehicle assignment for mobility-on-demand systems . IEEE/RSJ Int Conf on Intelligent Robots and Systems , p. 1869 - 1876 . doi: 10.1109/IROS.2017.8206003 http://doi.org/10.1109/IROS.2017.8206003

Sartoretti G , Kerr J , Shi YF , et al. , 2019 . Primal: pathfinding via reinforcement and imitation multi-agent learning . IEEE Robot Autom Lett , 4 ( 3 ): 2378 - 2385 . doi: 10.1109/LRA.2019.2903261 http://doi.org/10.1109/LRA.2019.2903261

Singhal V , Dahiya D , 2015 . Distributed task allocation in dynamic multi-agent system . Int Conf on Computing, Communication and Automation , p. 643 - 648 . doi: 10.1109/CCAA.2015.7148452 http://doi.org/10.1109/CCAA.2015.7148452

Standley T , Korf R , 2011 . Complete algorithms for cooperative pathfinding problems . Proc 22 nd Int Joint Conf on Artificial Intelligence , p. 668 - 673 .

van den Berg J , Lin M , Manocha D , 2008 . Reciprocal velocity obstacles for real-time multi-agent navigation . IEEE Int Conf on Robotics and Automation , p. 1928 - 1935 . doi: 10.1109/ROBOT.2008.4543489 http://doi.org/10.1109/ROBOT.2008.4543489

van den Berg J , Guy SJ , Lin M , et al. , 2011 . Reciprocal n -body collision avoidance . In: Pradalier C , Siegwart R , Hirzinger G (Eds.), Robotics Research . Springer , Berlin, Heidelberg , p. 3 - 19 . doi: 10.1007/978-3-642-19457-3_1 http://doi.org/10.1007/978-3-642-19457-3_1

van den Berg JP , Overmars MH , 2005 . Prioritized motion planning for multiple robots . IEEE/RSJ Int Conf on Intelligent Robots and Systems , p. 430 - 435 . doi: 10.1109/IROS.2005.1545306 http://doi.org/10.1109/IROS.2005.1545306

Veloso M , Biswas J , Coltin B , et al. , 2015 . Cobots: robust symbiotic autonomous mobile service robots . 24 th Int Joint Conf on Artificial Intelligence , p. 4423 - 4429 .

Verma JK , Ranga V , 2021 . Multi-robot coordination analysis, taxonomy, challenges and future scope . J Intell Rob Syst , 102 : 10 . doi: 10.1007/s10846-021-01378-2 http://doi.org/10.1007/s10846-021-01378-2

Wu ZH , Pan SR , Chen FW , et al. , 2021 . A comprehensive survey on graph neural networks . IEEE Trans Neur Netw Learn Syst , 32 ( 1 ): 4 - 24 . doi: 10.1109/TNNLS.2020.2978386 http://doi.org/10.1109/TNNLS.2020.2978386

Wurman PR , D'Andrea R , Mountz M , 2007 . Coordinating hundreds of cooperative, autonomous vehicles in warehouses . Proc 19 th National Conf on Innovative Applications of Artificial Intelligence , p. 1752 - 1759 .

Yu JJ , LaValle SM , 2013 . Structure and intractability of optimal multi-robot path planning on graphs . Proc 27 th AAAI Conf on Artificial Intelligence , p. 1443 - 1449 .

Zhou J , Cui GQ , Hu SD , et al. , 2020 . Graph neural networks: a review of methods and applications . AI Open , 1 : 57 - 81 . doi: 10.1016/j.aiopen.2021.01.001 http://doi.org/10.1016/j.aiopen.2021.01.001

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Multi-agent differential game based cooperative synchronization control using a data-driven method

Coach-assisted multi-agent reinforcement learning framework for unexpected crashed agents

Affine formation tracking control of unmanned aerial vehicles

A distributed stochastic optimization algorithm with gradient-tracking and distributed heavy-ball acceleration

Finite-time formation control for first-order multi-agent systems with region constraints

Related Author

Zhang REN

Xiwang DONG

Jianglong YU

Yongzhao HUA

Yu SHI

Wengang ZHOU

Jian ZHAO

Youpeng ZHAO

Related Institution

School of Automation Science and Electrical Engineering, Beihang University

Institute of Artificial Intelligence, Beihang University

School of Information Science and Technology, University of Science and Technology of China

College of Intelligence and Computing, Tianjin University

College of Intelligence Science and Technology, National University of Defense Technology

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰