%0 Journal Article
%T A Robust Active Queue Management Algorithm Based on Reinforcement Learning<br>基于再励学习的主动队列管理算法
%A ZHANG Yan-Bing
%A HANG Da-Ming
%A MA Zheng-Xin
%A CAO Zhi-Gang
%A <br>张雁冰
%A 杭大明
%A 马正新
%A 曹志刚
%J 软件学报
%D 2004
%I 
%X From the viewpoint of decision theory, AQM (active queue management) can be considered as an optimal decision problem. In this paper, a new AQM scheme, Reinforcement Learning Gradient-Descent (RLGD), is described based on the optimal decision theory of reinforcement learning. Aiming to maximize the throughput and stabilize the queue length, RLGD adjusts the update step adaptively, without the demand of knowing the rate adjustment scheme of the source sender. Simulation demonstrates that RLGD can lead to the convergence of the queue length to the desired value quickly and maintain the oscillation small. The results also show that the RLGD scheme is very robust to disturbance under various network conditions and outperforms the traditional REM and PI controllers significantly.
%K congestion control
%K active queue management
%K reinforcement learning<br>拥塞控制
%K 主动队列管理
%K 再励学习
%U http://www.alljournals.cn/get_abstract_url.aspx?pcid=5B3AB970F71A803DEACDC0559115BFCF0A068CD97DD29835&cid=8240383F08CE46C8B05036380D75B607&jid=7735F413D429542E610B3D6AC0D5EC59&aid=4BD82093C22F10F6&yid=D0E58B75BFD8E51C&vid=23CCDDCD68FFCC2F&iid=DF92D298D3FF1E6E&sid=602F518C16859E7D&eid=4759DE41370E2E7A&journal_id=1000-9825&journal_name=软件学报&referenced_num=5&reference_num=20