A new approach for multiobjective optimization is proposed in this paper. The method based on the cross-entropy method for single objective optimization (SO) is adapted to MO optimization by defining an adequate sorting criterion for selecting the best candidates samples. The selection is made by the nondominated sorting concept and crowding distance operator. The effectiveness of the approach is tested on several academic problems (e.g., Schaffer, Fonseca, Fleming, etc.). Its performances are compared with those of other multiobjective algorithms. Simulation results and comparisons based on several performance metrics demonstrate the effectiveness of the proposed method. 1. Introduction Optimization is a basic tool for several decision making in engineering area. In these fields, we have many conflicting objectives to satisfy. Usually, we convert all objectives to one, single objective (SO) function. The goal is to find out the maximum/minimum of this SO function subject to maintain the physical constraints of the system. The results reflect a compromise between all objectives. The idea is to formulate the function to achieve this desired compromise. By aggregating all objectives in a weighted function, or by transforming all objectives into only one objective, and retaining one objective which will be added to constraints, the conversion from MO to SO is done. But the weakness and the limitation of the aggregation are as follows.(1)The requirement of a prior knowledge about the relative importance of the objectives, and the limits on the objectives that are converted into constraints.(2)The aggregated function leads to only one solution.(3)Trade-offs between objectives cannot be easily evaluated.(4)The solution may not be attainable unless the search space is convex. The aggregation is not recommended for the systems with conflicting objectives. Also, we need to know all possible solutions of all objectives simultaneously. In the business word it is called “the trade-off analysis”. There are several areas in engineering where the performing of the trade-off analysis is necessary, such as the following.(1)The design of controllers while reducing the cost, which are two conflicting objectives.(2)The placement of more functional blocks on chip while minimizing the chip area and/or power dissipation.(3)The finding of the vehicle which has the highest range while at the same time consuming minimum amount of energy.(4)The minimization of the operation cost while maintaining a stable work force [1–3]. MO problems are more difficult to solve compared to the
References
[1]
W. Stadler, Multicriteria Optimization in Engineering and in the Sciences, Plenum Press, New York, NY, USA, 1998.
[2]
M. T. Tabucanon, Multiple Criteria Decision Making Industry, Elsevier Science, New York, NY, USA, 1988.
[3]
C. A. Coello Coello, D. A. van Veldhuizen, and G. B. Lamont, Evolutionary Algorithms for Solving Multi-Objective Problems, Kluwer Academic Publishers, New York, NY, USA, 2002.
[4]
T. P. Bagchi, Multiobjective Scheduling by Genetic Algorithms, Kluwer Academic Publisher, New York, NY, USA, 1999.
[5]
A. Berizzi, C. Bovo, M. Innorta, and P. Marannino, “Multiobjective optimization techniques applied to modern power systems,” in Proceedings of the IEEE Power Engineering Society Winter Meeting, vol. 3, pp. 1503–1508, Columbus, Ohio, USA, February 2001.
[6]
J. Horn, N. Nafpliotis, and D. E. Goldberg, “A Niched Pareto genetic algorithm for multiobjective optimization,” in Proceedings of the 1st IEEE Conference on Evolutionary Computation, IEEE World Congress on Computational Intelligence, vol. 1, pp. 82–87, Orlando, Fla, USA, June 1994.
[7]
N. Srinivas and K. Deb, “Multiobjective function optimization using nondominated sorting genetic algorithms,” Evolutionary Computation, vol. 2, no. 3, pp. 221–248, 1994.
[8]
E. Zitzler and L. Thiele, “An evolutionary algorithm for multiobjective optimization: the strength pareto approach,” Tech. Rep. 43, TIK, Swiss Federal Institute of Technology (ETH), 1998.
[9]
K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, “A fast and elitist multiobjective genetic algorithm: NSGA-II,” IEEE Transactions on Evolutionary Computation, vol. 6, no. 2, pp. 182–197, 2002.
[10]
J. Kennedy and R. C. Eberhart, Swarm Intelligence, Morgan Kauffman, Burlington, Mass, USA, 2001.
[11]
M.-P. Song and G.-C. Gu, “Research on particle swarm optimization: a review,” in Proceedings of the International Conference on Machine Learning and Cybernetics, vol. 4, pp. 2236–2241, August 2004.
[12]
C. A. Coello Coello, G. T. Pulido, and M. S. Lechuga, “Handling multiple objectives with particle swarm optimization,” IEEE Transactions on Evolutionary Computation, vol. 8, no. 3, pp. 256–279, 2004.
[13]
I. Das and J. E. Dennis, “Normal-boundary intersection: a new method for generating the Pareto surface in nonlinear multicriteria optimization problems,” SIAM Journal on Optimization, vol. 8, no. 3, pp. 631–657, 1998.
[14]
R. Y. Rubinstein, “Optimization of computer simulation models with rare events,” European Journal of Operational Research, vol. 99, no. 1, pp. 89–112, 1997.
[15]
R. Y. Rubinstein and D. P. Kroese, The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning, Information Science and Statistics, Springer, New York, NY, USA, 2004.
[16]
D. Ernst, M. Glavic, G.-B. Stan, S. Mannor, and L. Wehenkel, “The cross-entropy method for power system combinatorial optimization problems,” in Proceedings of the 7th IEEE Power Engineering Society (PowerTech '07), pp. 13–17, Lausanne, Switzerland, July 2007.
[17]
P. T. de Boer, Analysis and efficient simulation of queueing models of telecommunication systems [Ph.D. thesis], University of Twente, Enschede, The Netherlands, 2000.
[18]
B. E. Helvik and O. Wittner, “Using the cross-entropy method to guide/govern mobile agent’s path finding in networks,” in Proceedings of the 3rd International Workshop on Mobile Agents for Telecommunication Applications (MATA ’01), pp. 255–268, 2001.
[19]
A. V. Babayan, D. A. Savic, and G. A. Walters, “Multiobjective optimization for the least-cost design of water distribution systems under correlated uncertain parameters,” in Proceedings of the World Water and Environmental Resources Congress, pp. 1–11, Anchorage, Alaska, USA, May 2005.
[20]
M. Carney and P. Cunningham, “Calibrating probability density forecasts with multi-objective search,” TCD-CS-2006-07, Department of Computer Science, The University of Dublin, Dublin, Ireland, 2006.
[21]
A. ünveren and A. Acan, “Multi-objective optimization with cross entropy method: stochastic learning with clustered pareto fronts,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '07), pp. 3065–3071, Singapore, September 2007.
[22]
J. Bekker and C. Aldrich, “The cross-entropy method in multi-objective optimisation: an assessment,” European Journal of Operational Research, vol. 211, no. 1, pp. 112–121, 2011.
[23]
D. E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley, Boston, Mass, USA, 1989.
[24]
J. Wu and A. C. S. Chung, “Cross entropy: a new solver for Markov random field modeling and applications to medical image segmentation,” in Proceedings of the on Medical Image Computing and Computer-Assisted Intervention (MICCAI '05), vol. 3749 of Lecture Notes in Computer Science, pp. 229–237, October 2005.
[25]
B.-B. Li and L. Wang, “A hybrid quantum-inspired genetic algorithm for multiobjective flow shop scheduling,” IEEE Transactions on Systems, Man, and Cybernetics, Cybernetics B, vol. 37, no. 3, pp. 576–591, 2007.