The active surveillance of public and private sites is increasingly becoming a very important and critical issue. It is, therefore, imperative to develop mobile surveillance systems to protect these sites. Modern surveillance systems encompass spatially distributed mobile and static sensors in order to provide effective monitoring of persistent and transient objects and events in a given area of interest (AOI). The realization of the potential of mobile surveillance requires the solution of different challenging problems such as task allocation, mobile sensor deployment, multisensor management, cooperative object detection and tracking, decentralized data fusion, and interoperability and accessibility of system nodes. This paper proposes a market-based approach that can be used to handle different problems of mobile surveillance systems. Task allocation and cooperative target tracking are studied using the proposed approach as two challenging problems of mobile surveillance systems. These challenges are addressed individually and collectively. 1. Introduction One of the most active research topics is how to automate surveillance tasks based on mobile and fixed sensors platforms [1]. Many benefits can be anticipated from the use of multisensor systems in surveillance applications [2, 3], such as decreasing task completion time and increasing mission reliability. Generally, monitoring of public and private sites is the main application of multisensor surveillance systems. The primary objectives of the surveillance systems are to provide the information that makes the system able to understand and predict the actions and the interactions of the observed objects in order to carry out different tasks. Examples of these tasks would include target search, identification, and tracking. Advanced surveillance systems encompass spatially distributed mobile and static sensors in order to provide effective monitoring of persistent and transient objects and events in a given area of interest (AOI) [4]. Mobile surveillance systems incorporate self-organized networks of mobile sensing nodes of different modalities, data and information fusion nodes, acting nodes, and control nodes. These self-organized nodes can collaboratively and continuously sense within the volume of interest, as well as physically manipulate and interact with it. The main goal of the surveillance system is to adjust the sensing conditions for improved visibility, and thereby improve performance [5]. In such setting, surveillance is a complex problem posing many challenging problems. This paper
References
[1]
F. M. D. Fave, S. Canu, L. Iocchi, D. Nardi, and V. A. Ziparo, “Multi-objective multi-robot surveillance,” in Proceedings of the 4th International Conference on Autonomous Robots and Agents (ICARA '09), pp. 68–73, Wellington, New Zealand, February 2009.
[2]
G. L. Foresti, C. S. Regazzoni, and P. K. Varshney, Multisensor Surveillance Systems: The Fusion Perspective, Kluwer Academic Publishers, 2003.
[3]
J. C. Castillo, F. A. Cano, J. S. Cuerda, and A. F. Caballero, “Multisensory architecture for intelligent surveillance systems—integration of segmentation, tracking and activity analysis,” in Proceedings of 13th ICEIS International Conference, pp. 157–162, 2011.
[4]
A. Elmogy, F. Karray, and A. Khamis, “Auctionbased consensus mechanism for cooperative tracking in multi-sensor surveillance systems,” in Proceedings of 4th International Conference in Humanoid, Nanotechnology, Information Technology, Communication Control, Environment and Management (HNICEM '09), pp. 149–158, Manila, Philippines, March 2009.
[5]
H. F. Durrant-Whyte, “Sensor models and multisensor integration,” International Journal of Robotics Research, vol. 7, no. 6, pp. 97–113, 1988.
[6]
B. P. Gerkey and M. J. Mataric, “Sold!: auction methods for multirobot coordination,” IEEE Transactions on Robotics and Automation, vol. 18, no. 5, pp. 758–768, 2002.
[7]
M. B. Dias and A. Stentz, “A market approach to multi-robot coordination,” Tech. Rep. CMURI-TR-01-26, Carnegie Mellon University, Pittsburgh, Pa, USA, 2002.
[8]
A. M. Elmogy, Market-based framework for mobile surveillance systems [Ph.D. thesis], University of Waterloo, Waterloo, ON, Canada, 2010.
[9]
D. Makris and T. Ellis, “Learning semantic scene models from observing activity in visual surveillance,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 35, no. 3, pp. 397–408, 2005.
[10]
X. Wang, S. Wang, and D. Bi, “Distributed visual-target-surveillance system in wireless sensor networks,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 39, no. 5, pp. 1134–1146, 2009.
[11]
H. Sayyaadi and M. Moarref, “A distributed algorithm for proportional task allocation in networks of mobile agents,” IEEE Transactions on Automatic Control, vol. 56, no. 2, pp. 405–410, 2011.
[12]
R. R. Murphy, “Human-robot interaction in rescue robotics,” IEEE Transactions on Systems, Man and Cybernetics Part C, vol. 34, no. 2, pp. 138–153, 2004.
[13]
R. Zlot and A. Stentz, “Market-based multirobot coordination for complex tasks,” International Journal of Robotics Research, vol. 25, no. 1, pp. 73–101, 2006.
[14]
A. M. Elmogy, A. M. Khamis, and F. O. Karray, “Dynamic complex task allocation in multisensor surveillance systems,” in Proceedings of the 3rd International Conference on Signals, Circuits and Systems (SCS '09), Djerba, Tunisia, November 2009.
[15]
G. Isbitiren and O. B. Akan, “Three-dimensional underwater target tracking with acoustic sensor networks,” IEEE Transactions on Vehicular Technology, vol. 60, no. 8, pp. 3897–3906, 2011.
[16]
N. Kalra, D. Ferguson, and A. Stentz, “Hoplites: a market-based framework for planned tight coordination in multirobot teams,” in Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1170–1177, April 2005.
[17]
X. F. Xie and J. Liu, “Multiagent optimization system for solving the traveling salesman problem (TSP),” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 39, no. 2, pp. 489–502, 2009.
[18]
H. K. Tsai, J. M. Yang, Y. F. Tsai, and C. Y. Kao, “An evolutionary algorithm for large traveling salesman problems,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 34, no. 4, pp. 1718–1729, 2004.
[19]
C. Wurll, D. Henrich, and H. Worn, “Multi-goal path planning for industrial robots,” in Proceedings of International Conference on Robotics and Application (RA '99), Santa Barbara, Calif, USA, 1999.
[20]
A. Kolling and S. Carpin, “Cooperative observation of multiple moving targets: an algorithm and its formalization,” International Journal of Robotics Research, vol. 26, no. 9, pp. 935–953, 2007.
[21]
S. Martinez-Jaramillo and E. P. K. Tsang, “An heterogeneous, endogenous and coevolutionary GP-based financial market,” IEEE Transactions on Evolutionary Computation, vol. 13, no. 1, pp. 33–55, 2009.
[22]
R. M. Zlot, An auction-based approach to complex task allocation for multirobot teams [Ph.D. thesis], Pittsburgh, Pa, USA, 2006.
[23]
M. B. Dias, TraderBots: a new paradigm for robust and efficient multi-robot coordination in dynamic environments [Ph.D. thesis], Robotics Institute, Carnegie Mellon University, 2004.
[24]
X. Zheng, S. Koenig, and C. Tovey, “Improving sequential single-item auctions,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '06), pp. 2238–2244, Beijing, China, October 2006.
[25]
M. Berhault, H. Huang, P. Keskinocak et al., “Robot exploration with combinatorial auctions,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1957–1962, October 2003.
[26]
B. P. Gerkey and M. J. Mataric, “Sold!: auction methods for multi-robot control,” IEEE Transactions on Robotics and Automation, vol. 18, no. 5, pp. 758–768, 2002.
[27]
S. C. Botelho and R. Alami, “M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '99), pp. 1234–1239, May 1999.
[28]
F. Tang and S. Saha, “An anytime winner determination algorithm for time-extended multi-robot task allocation,” in Proceedings of the International Conference on Automation, Robotics, and Control Systems, pp. 123–130, 2008.
[29]
M. H. Rothkopf, A. Peke？, and R. M. Harstad, “Computationally manageable combinational auctions,” Management Science, vol. 44, no. 8, pp. 1131–1147, 1998.
[30]
J. Sparbert, K. Dietmayer, and D. Streller, “Objecttracking in traffic scenes with multi-hypothesis approach using laser range images,” in Proceedings of IEEE 4th International Conference on Intelligent Transportation System, 2001.
[31]
H. Zhao, J. Cui, H. Zha, K. Katabira, X. Shao, and R. Shibasaki, “Monitoring an intersection using a network of laser scanners,” in Proceedings of the 11th International IEEE Conference on Intelligent Transportation Systems (ITSC '08), pp. 428–433, Beijing, China, December 2008.
[32]
H. Zhao and R. Shibasaki, “A novel system for tracking pedestrians using multiple single-row laser-range scanners,” IEEE Transactions on Systems, Man, and Cybernetics Part A, vol. 35, no. 2, pp. 283–291, 2005.
[33]
B. Kluge, C. K？hler, and E. Prassler, “Fast and robust tracking of multiple moving objects with a laser range finder,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '01), pp. 1683–1688, May 2001.
[34]
L. E. Parker, “Distributed algorithms for multi-robot observation of multiple moving targets,” Autonomous Robots, vol. 12, no. 3, pp. 231–255, 2002.
[35]
J. B. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297, University of California Press, Berkeley, Calif, USA, 1967.
[36]
T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu, “An efficient k-means clustering algorithms: analysis and implementation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 881–892, 2002.
[37]
H. Ritter, T. Martinetz, and K. Schulten, Neural Computation and Self-Organizing Maps: An Introduction, Addison-Wesley Longman, Boston, Mass, USA, 1st edition, 1992.
[38]
T. Kohonen, Self-Organization and Associative Memory, Information Sciences, Heidelberg, Germany, 3rd edition, 1989.
[39]
A. Kolling and S. Carpin, “Multirobot cooperation for surveillance of multiple moving targets—a new behavioral approach,” in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '06), pp. 1311–1316, May 2006.
