|
|
基于分布式Q学习的Femtocell两层网络功率控制方法
|
Abstract:
随着下一代无线通信技术的发展，Femtocell的概念应运而生。Femtocell是一种可以改善室内覆盖的家庭基站，其主要致力于增加室内覆盖，改善系统性能，减少Macrocell网络通信负担。然而，在Femtocell与Macrocell共存的双层网络中存在同信道干扰问题，这会降低系统性能。本文首先分析了分布式Q学习算法在Femtocell与Macrocell构成的两层网络下行链路功率控制中的应用，在此基础上仿真并分析了独立Q学习(Independent Q-learning，IQL)算法和合作Q学习(Cooperation Q-learning，CQL)算法，并对CQL
| [1] | J. Zhang, G. de la Roche. Femtocells: Technologies and deployment. Hoboken: John Wiley and Sons, Ltd., 2010. |
| [2] | S. A. Grandhi, J. Zander. Constrained power control in cellular radio systems. 1994 IEEE 44th Vehicular Technology Con- ference, 1994, 2: 824-828. |
| [3] | C. J. C. H. Watldns. Learning from delayed rewards. PhD Thesis, Cambridge: University of Cambridge, 1989. |
| [4] | S. Mahadevan, J. Connell. Automatic programming of behavior- based robots using reinforcement learning. Proceedings of the 1991 National Conference on AI, 1991: 768-773. |
| [5] | R. S. Sutton, A. G. Barto. Reinforcement learning: An intro- duction. Cambridge: MIT Press, 1998. |
| [6] | C. J. C. H. Watkins, P. Dayan. Technical note Q-learning. Journal of Machine Learning, 1992, 8(3-4): 279-292. |
| [7] | J. R. Kok, N. Vlassis. Collaborative multiagent reinforcement learning by payoffpropagation. The Journal of Machine Learning Research, 2006, 7: 1789-1828.
ttp://portal.acm.org/citation.cfm?id=1248547.124861 |
| [8] | M. Ahmadabadi, M. Asadpour. Expertness based cooperative Q-learning. Systems, Man, and Cybernetics, Part B: IEEE Transactions on Cybernetics, 2002, 32(1): 66-76. |
| [9] | A. Galindo-Serrano, L. Giupponi. Distributed Q-learning for aggregated interference control in cognitive radio networks. IEEE Transactions on Vehicular Technology, 2010, 59(4): 1823- 1834. |
| [10] | A. Galindo, L. Giupponi. Decentralized Q-learning for aggregated interference control in completely and partially observable cognitive radio networks. 2010 7th IEEE Proceed- ings of the Consumer Communications and Networking Conference (CCNC), Las Vegas, 2010: 1-6. |
| [11] | A. Galindo-Serrano, L. Giupponi and M. Dohler. Cognition and docition in OFDMA-based Femtocell networks. 2010 IEEE Global Telecommunications Conference, Miami, 2010: 1-6. |
| [12] | R. Jain, D.-M. Chiu and W. Hawe. A quantitative measure of fairness and discrimination for resource allocation in shared computer systems. Maynard: Eastern Research Laboratory, Digital Equipment Corporation, 1998. |
