Learning Near-Optimal Broadcasting Intervals in Decentralized Multi-Agent Systems using Online Least-Square Policy Iteration (CROSBI ID 291261)
Prilog u časopisu | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Palunko, Ivana ; Tolić, Domagoj ; Prkačin, Vicko
engleski
Learning Near-Optimal Broadcasting Intervals in Decentralized Multi-Agent Systems using Online Least-Square Policy Iteration
Here, agents learn how often to exchange information with neighbours in cooperative multi‐ agent systems (MASs) such that their linear quadratic regulator (LQR)‐like performance indices are minimized. The investigated LQR‐like cost functions capture trade‐offs between the energy consumption of each agent and MAS local control performance in the presence of exogenous disturbances, delayed and noisy data. Agent energy consumption is critical for prolonging the MAS mission and is composed of both control (e.g. acceleration, velocity) and communication efforts. Taking provably stabilizing upper bounds on broadcasting intervals as optimization constraints, an online off‐policy model‐free learning algorithm based on least square policy iteration (LSPI) to minimize the cost function of each agent is employed. Consequently, the obtained broadcasting intervals adapt to the most recent information (e.g. delayed and noisy agents' inputs and/or outputs) received from neighbours whilst provably stabilize the MAS. Chebyshev polynomials are utilized as the approximator in the LSPI whereas Kalman filtering handles sampled, corrupted, and delayed data. Subsequently, convergence and near‐optimality of our LSPI scheme are inspected. The proposed methodology is verified experimentally using an inexpensive motion capture system and nano quadrotors.
multi-agent systems ; decentralized control ; learning (artificial intelligence) ; optimal control
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o izdanju
15 (8)
2021.
1054-1067
objavljeno
1751-8644
1751-8652
10.1049/cth2.12102
Povezanost rada
Elektrotehnika, Matematika, Računarstvo