Two Classes of Abstract Modes about Markov Decision Processes
马尔可夫决策过程两种抽象模式

Using Markov decision processes on abstract level,one can compactly and declaratively represent complex Markov decision processes.And one can solve real-world problems that generally have very large state space with regular MDPs.This paper introduces central concepts of two classes of abstract MDPs:structured mode and generalized mode.Then precise or approximate algorithms for looking for optimal policy for abstract MDPs are reviewed,including an algorithm that is totally different from regular Markov decis...