全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

Some Limit Properties of the Harmonic Mean of Transition Probabilities for Markov Chains in Markovian Environments Indexed by Cayley's Trees

DOI: 10.1155/2013/961571

Full-Text   Cite this paper   Add to My Lib

Abstract:

We prove some limit properties of the harmonic mean of a random transition probability for finite Markov chains indexed by a homogeneous tree in a nonhomogeneous Markovian environment with finite state space. In particular, we extend the method to study the tree-indexed processes in deterministic environments to the case of random enviroments. 1. Introduction A tree is a graph which is connected and doesn't contain any circuits. Given any two vertices , let be the unique path connecting and . Define the graph distance to be the number of edges contained in the path . Let be an infinite tree with root . The set of all vertices with distance from the root is called the th generation of , which is denoted by . We denote by the union of the first generations of . For each vertex , there is a unique path from to and for the number of edges on this path. We denote the first predecessor of by . The degree of a vertex is defined to be the number of neighbors of it. If every vertex of the tree has degree , we say it is Cayley’s tree, which is denoted by . Thus, the root vertex has neighbors in the first generation and every other vertex has neighbors in the next generation. For any two vertices and of tree , write if is on the unique path from the root to . We denote by the farthest vertex from satisfying and . We use the notation and denote by the number of vertices of . In the following, we always let denote the Cayley tree . A tree-indexed Markov chain is the particular case of a Markov random field on a tree. Kemeny et al. [1] and Spitzer [2] introduced two special finite tree-indexed Markov chains with finite transition matrix which is assumed to be positive and reversible to its stationary distribution, and these tree-indexed Markov chains ensure that the cylinder probabilities are independent of the direction we travel along a path. In this paper, we omit such assumption and adopt another version of the definition of tree-indexed Markov chains which is put forward by Benjamini and Peres [3]. Yang and Ye[4] extended it to the case of nonhomogeneous Markov chains indexed by infinite Cayley’s tree and we restate it here as follows. Definition 1 (T-indexed nonhomogeneous Markov chains (see [4])). Let be an infinite Cayley tree, a finite state space, and a stochastic process defined on probability space , which takes values in the finite set . Let be a distribution on and a transition probability matrix on . If, for any vertex , then will be called -valued nonhomogeneous Markov chains indexed by infinite Cayley’s tree with initial distribution (1) and

References

[1]  J. G. Kemeny, J. L. Snell, and A. W. Knapp, Denumerable Markov Chains, Springer, New York, NY, USA, 2nd edition, 1976.
[2]  F. Spitzer, “Markov random fields on an infinite tree,” The Annals of Probability, vol. 3, no. 3, pp. 387–398, 1975.
[3]  I. Benjamini and Y. Peres, “Markov chains indexed by trees,” The Annals of Probability, vol. 22, no. 1, pp. 219–243, 1994.
[4]  W. Yang and Z. Ye, “The asymptotic equipartition property for nonhomogeneous Markov chains indexed by a homogeneous tree,” IEEE Transactions on Information Theory, vol. 53, no. 9, pp. 3275–3280, 2007.
[5]  T. Berger and Z. X. Ye, “Entropic aspects of random fields on trees,” IEEE Transactions on Information Theory, vol. 36, no. 5, pp. 1006–1018, 1990.
[6]  Z. Ye and T. Berger, “Ergodicity, regularity and asymptotic equipartition property of random fields on trees,” Journal of Combinatorics, Information & System Sciences, vol. 21, no. 2, pp. 157–184, 1996.
[7]  Z. Ye and T. Berger, Information Measures for Discrete Random Fields, Science Press, Beijing, China, 1998.
[8]  R. Pemantle, “Automorphism invariant measures on trees,” The Annals of Probability, vol. 20, no. 3, pp. 1549–1566, 1992.
[9]  W. Yang and W. Liu, “Strong law of large numbers for Markov chains field on a Bethe tree,” Statistics & Probability Letters, vol. 49, no. 3, pp. 245–250, 2000.
[10]  W. Yang, “Some limit properties for Markov chains indexed by a homogeneous tree,” Statistics & Probability Letters, vol. 65, no. 3, pp. 241–250, 2003.
[11]  H. Huang and W. Yang, “Strong law of large numbers for Markov chains indexed by an infinite tree with uniformly bounded degree,” Science in China A, vol. 51, no. 2, pp. 195–202, 2008.
[12]  R. Cogburn, “Markov chains in random environments: the case of Markovian environments,” The Annals of Probability, vol. 8, no. 5, pp. 908–916, 1980.
[13]  R. Pemantle and Y. Peres, “Critical random walk in random environment on trees,” The Annals of Probability, vol. 23, no. 1, pp. 105–140, 1995.
[14]  Y. Hu and Z. Shi, “Slow movement of random walk in random environment on a regular tree,” The Annals of Probability, vol. 35, no. 5, pp. 1978–1997, 2007.
[15]  Y. Q. Li, H. S. Wang, and Z. Wang, “Some strong limit theorems of geometric average of transition probabilities and their function for Markov chains in Markovian environments,” Acta Mathematica Scientia A, vol. 31, no. 2, pp. 508–517, 2011 (Chinese).

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133