Although frequently encountered in many practical applications, singular nonlinear optimization has been always recognized as a difficult problem. In the last decades, classical numerical techniques have been proposed to deal with the singular problem. However, the issue of numerical instability and high computational complexity has not found a satisfactory solution so far. In this paper, we consider the singular optimization problem with bounded variables constraint rather than the common unconstraint model. A novel neural network model was proposed for solving the problem of singular convex optimization with bounded variables. Under the assumption of rank one defect, the original difficult problem is transformed into nonsingular constrained optimization problem by enforcing a tensor term. By using the augmented Lagrangian method and the projection technique, it is proven that the proposed continuous model is convergent to the solution of the singular optimization problem. Numerical simulation further confirmed the effectiveness of the proposed neural network approach.
R. Ge and Z. Xia, “Solving a Type of Modified BFGS Algorithm with Any Rank Defects and the Local Q-Su perliner Convergence Properties,” Journal of Computa tional and Applied Mathematics, Vol. 22, No. 1-2, 2006, pp. 193-208.
R. Ge and Z. Xia, “A Type of Modified BFGS Algorithm with Rank Defects and Its Global Convergence in Convex Minimization,” Journal of Pure and Applied Mathematics: Advances and Applications, Vol. 3, No. 1, 2010, pp. 17-35.
Y. S. Xia and J. Wang, “A New Neural Network for Solv ing Linear Programming Problems and Its Applications,” IEEE Transactions on Neural Networks, Vol. 7, No. 2, 1996, pp. 525-529. doi:10.1109/72.485686
Y. S. Xia, J. Wang, “A General Methodology for De signing Globally Convergent Optimization Neural Net works,” IEEE Transactions on Neural Networks, Vol. 9, No. 6, 1998, pp. 1331-1343. doi:10.1109/72.728383
Y. S. Xia, H. Leung and J. Wang, “A Projection Neural Network and Its Application to Constrained Optimization Problems,” IEEE Transactions on Circuits and Systems I, Vol. 49, No. 4, 2002, pp. 447-458.
Y. S. Xia and J. Wang, “A General Projection Neural Network for Solving Monotone Variational Inequality and Related Optimization Problems,” IEEE Transactions on Neural Networks, Vol. 15, No. 2, 2004, pp. 318-328.
X. Gao, L. Z. Liao and W. Xue, “A Neural Network for a Class of Convex Quadratic Minimax Problems with Con straints,” IEEE Transactions on Neural Networks, Vol. 15, No. 3, 2004, pp. 622-628. doi:10.1109/TNN.2004.824405
C. Y. Sun and C. B. Feng, “Neural Networks for Non convex Nonlinear Programming Problems: A Switching Control Approach,” Lecture Notes in Computer Science, Vol. 3496, 2005, pp. 694-699.
Q. Tao, X. Liu and M. S. Xue, “A Dynamic Genetic Al gorithm Based on Continuous Neural Networks for a Kind of Non-Convex Optimization Problems,” Applied Mathematics and Computation, Vol. 150, No. 3, 2004, pp. 811-820. doi:10.1016/S0096-3003(03)00309-6
F. Lamnabhi-Lagarrigue and G. Stefani, “Singular Optimal Control Problem: On the Necessary Conditions of Optimality,” SIAM: SIAM Journal on Control and Opti mization, Vol. 28, No. 4, 1990, pp. 823-840.
L. Liu, R. Ge and P. Gao, “A Novel Neural Network for Solving Singular Nonlinear Convex Optimization Prob lems,” Lecture Notes in Computer Science, Vol. 7063, 2011, pp. 554-561. doi:10.1007/978-3-642-24958-7_64
X. Du, Y. Yang and M. Li, “Further Studies on the Heste nes-Powell augmented Lagrangian Function for Equality Constraints in Nonlinear Programming Problems,” OR Transactions, Vol. 10, No. 1, 2006, pp. 38-46.