The paper deals with the existence, uniqueness, and iterative approximations of solutions for the functional equations arising in dynamic programming of multistage decision making processes in Banach spaces BC(S) and B(S) and complete metric space BB(S), respectively. Our main results extend, improve, and generalize the results due to several authors. Some examples are also given to demonstrate the advantage of our results over existing one in the literature. 1. Introduction In this paper, we introduce and study the existence and uniqueness of solutions for the following functional equation arising in dynamic programming of multistage decision processes: where “opt” denotes the “sup” or “inf,” and stand for the state and decision vectors, respectively, represents the transformation of the processes, and denotes the optimal return function with initial state . It is clear that (1) includes many functional equations and system of functional equations as special case, respectively. Bellman [1] was the first to investigate the existence and uniqueness of solutions for the following functional equation: in a complete metric space . Bhakta and Mitra [2] obtained the existence and uniqueness of solutions for the functional equations in a Banach space and in , respectively. Bhakta and Choudhury [3] established the existence of solutions for the functional equations (2) in . In 2003, Liu and Ume [4] pointed out that the form of the functional equations of dynamic programming is as follows: In 2004, Liu et al. [5] obtained an existence, uniqueness, and iterative approximation of solutions for the functional equation In 2006, Liu et al. [6] provided the sufficient conditions which ensure the existence and uniqueness and iterative approximation of solution for the functional equation In 2007, Liu and Kang [7] studied the following functional equation: and gave an existence and uniqueness result of solution for the functional equation. In 2011, Jiang et al. [8] investigated the following functional equation: and gave some existence and uniqueness results and iterative approximations of solutions for the functional equation in . In Section 2, we recall some basic concepts, notations, and lemmas. In Section 3, we utilize the fixed point theorem due to Boyd and Wong [9] to establish the existence, uniqueness, and iterative approximation of solution for the functional equation (1) in Banach spaces and complete metric spaces. Also, we construct some nontrivial examples to explain our results. The results presented here generalize, improve, and extend the results of
References
[1]
R. Bellman, Dynamic Programming, Princeton University Press, Princeton, NJ, USA, 1957.
[2]
P. C. Bhakta and S. Mitra, “Some existence theorems for functional equations arising in dynamic programming,” Journal of Mathematical Analysis and Applications, vol. 98, no. 2, pp. 348–362, 1984.
[3]
P. C. Bhakta and S. R. Choudhury, “Some existence theorems for functional equations arising in dynamic programming II,” Journal of Mathematical Analysis and Applications, vol. 131, no. 1, pp. 217–231, 1988.
[4]
Z. Liu and J. S. Ume, “On properties of solutions for a class of functional equations arising in dynamic programming,” Journal of Optimization Theory and Applications, vol. 117, no. 3, pp. 533–551, 2003.
[5]
Z. Liu, R. P. Agarwal, and S. M. Kang, “On solvability of functional equations and system of functional equations arising in dynamic programming,” Journal of Mathematical Analysis and Applications, vol. 297, no. 1, pp. 111–130, 2004.
[6]
Z. Liu, Y. Xu, J. S. Ume, and S. M. Kang, “Solutions to two functional equations arising in dynamic programming,” Journal of Computational and Applied Mathematics, vol. 192, no. 2, pp. 251–269, 2006.
[7]
Z.-Q. Liu and S. M. Kang, “Existence and uniqueness of solutions for two classes of functional equations arising in dynamic programming,” Acta Mathematicae Applicatae Sinica. English Series, vol. 23, no. 2, pp. 195–208, 2007.
[8]
G. Jiang, S. M. Kang, and Y. C. Kwun, “Solvability and algorithms for functional equations originating from dynamic programming,” Fixed Point Theory and Applications, vol. 2011, Article ID 701519, 30 pages, 2011.
[9]
D. W. Boyd and J. S. W. Wong, “On nonlinear contractions,” Proceedings of the American Mathematical Society, vol. 20, pp. 458–464, 1969.
[10]
H. K. Pathak and Deepmala, “Existence and uniqueness of solutions of functional equations arising in dynamic programming,” Applied Mathematics and Computation, vol. 218, no. 13, pp. 7221–7230, 2012.
[11]
Z. Liu, “Existence theorems of solutions for certain classes of functional equations arising in dynamic programming,” Journal of Mathematical Analysis and Applications, vol. 262, no. 2, pp. 529–553, 2001.
[12]
R. P. Agarwal, N. Hussain, and M.-A. Taoudi, “Fixed point theorems in ordered Banach spaces and applications to nonlinear integral equations,” Abstract and Applied Analysis, vol. 2012, Article ID 245872, 15 pages, 2012.
[13]
Deepmala and H. K. Pathak, “A study on some problems on existence of solutions for nonlinear functional-integral equations,” Acta Mathematica Scientia B, vol. 33, no. 5, pp. 1305–1313, 2013.
[14]
N. Hussain and M. A. Taoudi, “Krasnosel'skii-type fixed point theorems with applications to Volterra integral equations,” Fixed Point Theory and Applications, vol. 2013, article 196, 2013.
[15]
N. Hussain, A. R. Khan, and R. P. Agarwal, “Krasnosel'skii and Ky Fan type fixed point theorems in ordered Banach spaces,” Journal of Nonlinear and Convex Analysis, vol. 11, no. 3, pp. 475–489, 2010.
[16]
Z. Liu, H. Dong, and S. M. Kang, “Solving a class of func- tional equations using fixed point theorems,” Journal of Inequalities and Applications, vol. 2013, article 516, 2013.