Optimization of formation for multi-agent systems based on LQR

Chang-bin YU; Yin-qiu WANG; Jin-liang SHAO

doi:10.1631/FITEE.1500490

Your Location：

Home >

Browse articles >

Optimization of formation for multi-agent systems based on LQR

Invited Papers | Updated：2022-05-19

- Optimization of formation for multi-agent systems based on LQR
- 基于线性二次最优化的多智能体编队控制
- Frontiers of Information Technology & Electronic Engineering Vol. 17, Issue 2, Pages: 96-109(2016)
- Affiliations：
  
  1School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China
  2Research School of Engineering, The Australian National University, Canberra ACT 0200, Australia
  3School of Mathematics Science, University of Electronic Science and Technology of China, Chengdu 611731, China
- Author bio：
  
  [ "" ]
  E-mail: wh6508@gmail.com
  E-mail: jinliangshao@126.com
- Funds：
- DOI：10.1631/FITEE.1500490
  CLC： TP273
- Received：30 December 2015，
  
  Accepted：20 June 2016，
  
  Published：2016-02
- Accepted：
Scan QR Code
Chang-bin YU, Yin-qiu WANG, Jin-liang SHAO. Optimization of formation for multi-agent systems based on LQR[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(2): 96-109.
DOI：

Chang-bin YU, Yin-qiu WANG, Jin-liang SHAO. Optimization of formation for multi-agent systems based on LQR[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(2): 96-109. DOI： 10.1631/FITEE.1500490.

摘要

目的

随着空间技术和计算机技术的发展，空间飞行器协作控制越来越受到重视。多智能体编队控制是研究这一类问题的基础。本文研究了三种情况下单积分器多智能体系统基于线性二次最优性能指标的编队控制问题，并设计相应的控制算法保证多智能体系统在完成编队的基础上使所定义的性能指标达到最优。

创新点

针对三种不同的单积分器多智能体最优编队情况，分别提出相应的网络连接拓扑以及局部反馈矩阵；不同于其他论文不能给出网络拓扑以及局部最优反馈矩阵的具体解析解，本文给出相应的解析解，并且证明解析解与实际物理系统完全相符。

方法

应用代数图论以及矩阵理论的相关知识，针对无物理耦合的多智能体系统，通过求解代数里卡蒂方程，设计智能体之间的网络连接拓扑以及局部反馈矩阵，保证多智能体系统在完成编队的同时相应的LQR指标最优。针对有物理耦合的多智能体系统，同样通过求解代数里卡蒂方程，得到相应的网络连接拓扑以及局部反馈矩阵，保证多智能体系统在完成编队的基础上使相应的LQR指标最优；针对有物理耦合但无法设计网络拓扑的多智能体系统，将最优指标写成局部反馈增益的函数，通过求最优指标的导数，得到最优局部反馈增益。

结论

对于无物理耦合单积分器多智能体的编队问题与有物理耦合单积分器多智能体的编队问题，分别设计网络连接拓扑以及局部反馈矩阵，在多智能体系统完成编队的基础上保证相应的性能指标达到最优。对于有物理耦合但无法改变通讯网络拓扑的单积分器多智能体系统编队问题，设计最优局部反馈增益，在多智能体系统完成编队的同时保证性能指标最优。

Abstract

In this paper

three optimal linear formation control algorithms are proposed for first-order linear multi-agent systems from a linear quadratic regulator (LQR) perspective with cost functions consisting of both interaction energy cost and individual energy cost

because both the collective object (such as formation or consensus) and the individual goal of each agent are very important for the overall system. First

we propose the optimal formation algorithm for first-order multi-agent systems without initial physical couplings. The optimal control parameter matrix of the algorithm is the solution to an algebraic Riccati equation (ARE). It is shown that the matrix is the sum of a Laplacian matrix and a positive definite diagonal matrix. Next

for physically interconnected multi-agent systems

the optimal formation algorithm is presented

and the corresponding parameter matrix is given from the solution to a group of quadratic equations with one unknown. Finally

if the communication topology between agents is fixed

the local feedback gain is obtained from the solution to a quadratic equation with one unknown. The equation is derived from the derivative of the cost function with respect to the local feedback gain. Numerical examples are provided to validate the effectiveness of the proposed approaches and to illustrate the geometrical performances of multi-agent systems.

关键词

Keywords

references

G Alefeld , , , N Schneider . . On square roots of Mmatrices . . Linear Algebra Appl. , , 1982 . . 42 119 - - 132 . . DOI: 10.1016/0024-3795(82)90143-4 http://doi.org/10.1016/0024-3795(82)90143-4 . .

C Altafini . . Consensus problems on networks with antagonistic interactions . . IEEE Trans. Autom. Contr. , , 2013 . . 58 ( ( 4 ): ): 935 - - 946 . . DOI: 10.1109/TAC.2012.2224251 http://doi.org/10.1109/TAC.2012.2224251 . .

B.D.O Anderson , , , J.B Moore . . Optimal Control: Linear Quadratic Methods , , 2007 . . : : USA Dover Publications , , . .

M Basiri , , , A.N Bishop , , , P Jensfelt . . Distributed control of triangular formations with angle-only constraints . . Syst. Contr. Lett. , , 2010 . . 59 ( ( 2 ): ): 147 - - 154 . . DOI: 10.1016/j.sysconle.2009.12.010 http://doi.org/10.1016/j.sysconle.2009.12.010 . .

A.N Bishop . . A very relaxed control law for bearingonly triangular formation control . . 2011 . . Proc. 18th IFAC World Congress . . . .

F Borrelli , , , T Keviczky . . Distributed LQR design for identical dynamically decoupled systems . . IEEE Trans. Autom. Contr. , , 2008 . . 53 ( ( 8 ): ): 1901 - - 1912 . . DOI: 10.1109/TAC.2008.925826 http://doi.org/10.1109/TAC.2008.925826 . .

Y Cao , , , W Ren . . Optimal linear-consensus algorithms: an LQR perspective . . IEEE Trans. Syst. Man Cybern. Part B , , 2010 . . 40 ( ( 3 ): ): 819 - - 830 . . DOI: 10.1109/TSMCB.2009.2030495 http://doi.org/10.1109/TSMCB.2009.2030495 . .

D.V Dimarogonas , , , K.H Johansson . . Stability analysis for multi-agent systems using the incidence matrix: quantized communication and formation control . . Automatica , , 2010 . . 46 ( ( 4 ): ): 695 - - 700 . . DOI: 10.1016/j.automatica.2010.01.012 http://doi.org/10.1016/j.automatica.2010.01.012 . .

R Ghadami , , , B Shafai . . Decomposition-based distributed control for continuous-time multi-agent systems . . IEEE Trans. Autom. Contr. , , 2013 . . 58 ( ( 1 ): ): 258 - - 264 . . DOI: 10.1109/TAC.2012.2204153 http://doi.org/10.1109/TAC.2012.2204153 . .

R Ghadami , , , B Shafai . . Distributed observer-based LQR design for multi-agent systems . . 2014 . . World Automation Congress . . DOI: 10.1109/WAC.2014.6936025 http://doi.org/10.1109/WAC.2014.6936025 . .

C Godsil , , , G.F Royle . . Algebraic Graph Theory , , 2013 . . : : USA Springer , , . .

J Guo , , , Z Lin , , , M Cao , , , 等 . . Adaptive control schemes for mobile robot formations with triangularised structures . . IET Contr. Theory Appl. , , 2010 . . 4 ( ( 9 ): ): 1817 - - 1827 . . DOI: 10.1049/iet-cta.2009.0513 http://doi.org/10.1049/iet-cta.2009.0513 . .

R.A Horn , , , C.R Johnson . . Matrix Analysis , , 1985 . . : : USA Cambridge University Press , , . .

R.A Horn , , , C.R Johnson . . Topics in Matrix Analysis , , 1991 . . : : USA Cambridge University Press , , . .

H Huang , , , C Yu , , , Q Wu . . Distributed LQR design for multi-agent formations . . 2010 . . Proc. 49th IEEE Conf. on Decision and Control . . DOI: 10.1109/CDC.2010.5716988 http://doi.org/10.1109/CDC.2010.5716988 . .

Z Li , , , Z Duan , , , F.L Lewis . . Distributed robust consensus control of multi-agent systems with heterogeneous matching uncertainties . . Automatica , , 2014 . . 50 ( ( 3 ): ): 883 - - 889 . . DOI: 10.1016/j.automatica.2013.12.008 http://doi.org/10.1016/j.automatica.2013.12.008 . .

T Liu , , , Z Jiang . . Distributed nonlinear control of mobile autonomous multi-agents . . Automatica , , 2014 . . 50 ( ( 4 ): ): 1075 - - 1086 . . DOI: 10.1016/j.automatica.2014.02.023 http://doi.org/10.1016/j.automatica.2014.02.023 . .

K.H Movric , , , F.L Lewis . . Cooperative optimal control for multi-agent systems on directed graph topologies . . IEEE Trans. Autom. Contr. , , 2014 . . 59 ( ( 3 ): ): 769 - - 774 . . DOI: 10.1109/TAC.2013.2275670 http://doi.org/10.1109/TAC.2013.2275670 . .

K.K Oh , , , M.C Park , , , H.S Ahn . . A survey of multiagent formation control . . Automatica. , , 2015 . . 53 ( ( 3 ): ): 424 - - 440 . . DOI: 10.1016/j.automatica.2014.10.022 http://doi.org/10.1016/j.automatica.2014.10.022 . .

J Qin , , , H Gao . . A sufficient condition for convergence of sampled-data consensus for double-integrator dynamics with nonuniform and time-varying communication delays . . IEEE Trans. Autom. Contr. , , 2012 . . 57 ( ( 9 ): ): 2417 - - 2422 . . DOI: 10.1109/TAC.2012.2188425 http://doi.org/10.1109/TAC.2012.2188425 . .

J Qin , , , H Gao , , , W.X Zheng . . Second-order consensus for multi-agent systems with switching topology and communication delay . . Syst. Contr. Lett. , , 2011 . . 60 ( ( 6 ): ): 390 - - 397 . . DOI: 10.1016/j.sysconle.2011.03.004 http://doi.org/10.1016/j.sysconle.2011.03.004 . .

W Ren , , , R.W Beard , , , E.M Atkins . . Information consensus in multivehicle cooperative control . . IEEE Contr. Syst. Mag. , , 2007 . . 27 ( ( 2 ): ): 71 - - 82 . . DOI: 10.1109/MCS.2007.338264 http://doi.org/10.1109/MCS.2007.338264 . .

G Shi , , , K.C Sou , , , H Sandberg , , , 等 . . A graphtheoretic approach on optimizing informed-node selection in multi-agent tracking control . . Phys. D , , 2014 . . 267 104 - - 111 . . DOI: 10.1016/j.physd.2013.07.014 http://doi.org/10.1016/j.physd.2013.07.014 . .

F Xiao , , , L Wang , , , J Chen , , , 等 . . Finite-time formation control for multi-agent systems . . Automatica , , 2009 . . 45 ( ( 11 ): ): 2605 - - 2611 . . DOI: 10.1016/j.automatica.2009.07.012 http://doi.org/10.1016/j.automatica.2009.07.012 . .

C Yu , , , J.M Hendrickx , , , B Fidan , , , 等 . . Three and higher dimensional autonomous formations: rigidity, persistence and structural persistence . . Automatica , , 2007 . . 43 ( ( 3 ): ): 387 - - 402 . . DOI: 10.1016/j.automatica.2006.08.025 http://doi.org/10.1016/j.automatica.2006.08.025 . .

C Yu , , , B.D.O Anderson , , , S Dasgupta , , , 等 . . Control of minimally persistent formations in the plane . . SIAM J. Contr. Optim. , , 2009 . . 48 ( ( 1 ): ): 206 - - 233 . . DOI: 10.1137/060678592 http://doi.org/10.1137/060678592 . .

H Zhang , , , F.L Lewis , , , A Das . . Optimal design for synchronization of cooperative systems: state feedback, observer and output feedback . . IEEE Trans. Autom. Contr. , , 2011 . . 56 ( ( 8 ): ): 1948 - - 1952 . . DOI: 10.1109/TAC.2011.2139510 http://doi.org/10.1109/TAC.2011.2139510 . .

S Zhao , , , F Lin , , , K Peng , , , 等 . . Distributed control of angle-constrained cyclic formations using bearing-only measurements . . Syst. Contr. Lett. , , 2014 . . 63 12 - - 24 . . DOI: 10.1016/j.sysconle.2013.10.003 http://doi.org/10.1016/j.sysconle.2013.10.003 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

Reinforcement learning based privacy-preserving consensus tracking control of nonstrict-feedback discrete-time multi-agent systems

Event-triggered distributed cross-dimensional formation control for heterogeneous multi-agent systems

Towards resilient average consensus in multi-agent systems: a detection and compensation approach

Modified dynamic event-triggered scaled formation control for multi-agent systems via a sparrowsearch algorithm based co-design algorithm

Event-triggered distributed optimization for model-free multi-agent systems

Related Author

Dong YUE

Fanming HUANG

Yang YANG

Huimin WEI

Chen PENG

Min ZHAO

Jingpei WANG

Chengcheng ZHAO

Related Institution

Advanced Technology Institute for Carbon Neutrality, Nanjing University of Posts and Telecommunications

College of Automation & College of Artificial Intelligence, Nanjing University of Posts and Telecommunications

School of Mathematics and Statistics, Nantong University

School of Mechatronic Engineering and Automation, Shanghai University

Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰