M2M通信中基于多智能体强化学习的无线资源分配算法
Multi-agent reinforcement learning based resource allocation for M2M communication

摘要 蜂窝网络因为其广覆盖、高可靠和支持高速移动等优点，是机器对机器（M2M）通信的理想载体.然而，由于机器类型通信设备具有的业务种类繁多和数量大等特点，现有的无线资源分配算法并不完全适用.为了解决这个问题，不同于传统的集中式资源分配算法，提出了基于多智能体强化学习的分布式无线资源分配算法.具有强化学习能力的机器类通信（MTC）设备可以自主选择资源块和功率等级，以达到在较低的功率消耗下得到较高的用户体验质量的目标.为了实现不同设备之间的协作，引入了多智能体强化学习，每个智能体有能力预测其他智能体的策略.仿真结果表明：本文算法在用户体验质量、功率消耗和计算复杂度方面达到了很好的性能.
Abstract：Cellular network is an ideal carrier for Machine to Machine (M2M) communication benefited from its characteristics such as broad coverage, high reliability and supporting for high-speed mobility. However, because of the various service types and huge amount of the Machine Type Communication (MTC) devices, the existing resource allocation algorithm is not fully applicable. In order to deal with this matter, in this paper, different from the traditional centralized algorithm, a distributed wireless resource allocation algorithm based on reinforcement learning is developed where the MTC devices with the ability of reinforcement learning can smartly choose resource blocks and power levels. The goal of them is to increase the Quality of Experience (QoE) with low power consumption. In order to achieve the collaboration between different devices, the multi-agent reinforcement learning algorithm is also introduced by which the MTC devices have the ability to predict the other devices’ activities. The simulation results show that the proposed algorithm achieves good performance in terms of QoE, power consumption and computation complexity.