« Previous AbstractReal-time measurements of product compounds formed through the reaction of ozone with breath exhaled VOCs    Next Abstract[An overview on analytical method of volatile organic compounds in water] »

IEEE Trans Neural Netw Learn Syst

Title:		Stigmergic Independent Reinforcement Learning for Multiagent Collaboration
Author(s):		Xu X; Li R; Zhao Z; Zhang H;
Address:
Journal Title:		IEEE Trans Neural Netw Learn Syst
Year:		2022
Volume:		20220831
Issue:		9
Page Number:		4285 - 4299
DOI:		10.1109/TNNLS.2021.3056418
ISSN/ISBN:		2162-2388 (Electronic) 2162-237X (Linking)
Abstract:		"With the rapid evolution of wireless mobile devices, there emerges an increased need to design effective collaboration mechanisms between intelligent agents to gradually approach the final collective objective by continuously learning from the environment based on their individual observations. In this regard, independent reinforcement learning (IRL) is often deployed in multiagent collaboration to alleviate the problem of a nonstationary learning environment. However, behavioral strategies of intelligent agents in IRL can be formulated only upon their local individual observations of the global environment, and appropriate communication mechanisms must be introduced to reduce their behavioral localities. In this article, we address the problem of communication between intelligent agents in IRL by jointly adopting mechanisms with two different scales. For the large scale, we introduce the stigmergy mechanism as an indirect communication bridge between independent learning agents, and carefully design a mathematical method to indicate the impact of digital pheromone. For the small scale, we propose a conflict-avoidance mechanism between adjacent agents by implementing an additionally embedded neural network to provide more opportunities for participants with higher action priorities. In addition, we present a federal training method to effectively optimize the neural network of each agent in a decentralized manner. Finally, we establish a simulation scenario in which a number of mobile agents in a certain area move automatically to form a specified target shape. Extensive simulations demonstrate the effectiveness of our proposed method"
Keywords:
Notes:		"PubMed-not-MEDLINEXu, Xing Li, Rongpeng Zhao, Zhifeng Zhang, Honggang eng 2021/02/16 IEEE Trans Neural Netw Learn Syst. 2022 Sep; 33(9):4285-4299. doi: 10.1109/TNNLS.2021.3056418. Epub 2022 Aug 31"