Ubiquitous Life Care (u-Life care) is receiving attention because it provides high quality and low cost care services. To provide spontaneous and robust healthcare services, knowledge of a patient’s real-time daily life activities is required. Context information with real-time daily life activities can help to provide better services and to improve healthcare delivery. The performance and accuracy of existing life care systems is not reliable, even with a limited number of services. This paper presents a Human Activity Recognition Engine (HARE) that monitors human health as well as activities using heterogeneous sensor technology and processes these activities intelligently on a Cloud platform for providing improved care at low cost. We focus on activity recognition using video-based, wearable sensor-based, and location-based activity recognition engines and then use intelligent processing to analyze the context of the activities performed. The experimental results of all the components showed good accuracy against existing techniques. The system is deployed on Cloud for Alzheimer’s disease patients (as a case study) with four activity recognition engines to identify low level activity from the raw data captured by sensors. These are then manipulated using ontology to infer higher level activities and make decisions about a patient’s activity using patient profile information and customized rules.
References
[1]
Buyya, R.; Yeo, C.S.; Venugopal, S.; Broberg, J.; Brandic, I. Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst 2009, 25, 599–616.
[2]
Le, X.H.; Lee, S.; Truc, P.; Vinh, L.T.; Khattak, A.M.; Han, M.; Hung, D.V.; Hassan, M.M.; Kim, M.; Koo, K.-H.; Lee, Y.-K.; Huh, E.-N. Secured WSN-integrated cloud computing for u-life care. Proceedings of the 7th IEEE Consumer Communications and Networking Conference (CCNC), Las Vegas, NV, USA, 9–12 January 2010.
[3]
Khattak, A.M.; Vinh, L.T.; Hung, D.V.; Truc, P.T.H.; Hung, L.X.; Guan, D.; Pervez, Z.; Han, M.; Lee, S.Y.; Lee, Y.K. Context-aware human activity recognition and decision making. Proceedings of the 12th International Conference on e-Health Networking, Application Services (IEEE HealthCom 2010), Lyon, France, July 2010.
[4]
Wang, F.; Turner, K.J. An ontology-based actuator discovery and invocation framework in home care systems. Proceedings of the 7th International Conference on Smart Homes and Health Telematics, Berlin, Germany, June 2009; pp. 66–73.
[5]
Henricksen, K.; Indulska, J. Modelling and using imperfect context information. Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications Workshops, Washington, DC, USA, March 2004.
[6]
Pollack, M.E.; Brown, L.E.; Colbry, D.; McCarthy, C.E.; Orosz, C.; Peintner, B.; Ramakrishnan, S.; Tsamardinos, I. Autominder: An intelligent cognitive orthotic system for people with memory impairment. Robot. Auton. Syst 2003, 44, 273–282.
[7]
Sohn, T.; Li, K.A.; Lee, G.; Smith, I.; Scott, J.; Griswold, W.G. Place-its: A study of location-based reminders on mobile phones. Proceedings of the Ubicomp, Tokyo, Japan, 11–14 September 2005; pp. 232–250.
[8]
Du, K.; Zhang, D.; Zhou, X.; Mokhtari, M.; Hariz, M.; Qin, W. HYCARE: A hybrid context-aware reminding framework for elders with mild dementia. Proceedings of the 2008 International Conference On Smart Homes and Health Telematics (ICOST ’08), Ames, IA, USA, 28 June–2 July 2008.
[9]
Vinh, L.T.; Hung, L.X.; Hung, N.Q.; Kim, H.I.; Han, M.; Lee, Y.; Lee, S. Semi markov conditional random fields for accelerometer based activity recognition. Appl. Intell 2010, 35, 226–241.
[10]
Gorelick, L.; Blank, M.; Shechtman, E.; Irani, M.; Basri, R. Actions as space-time shapes. IEEE Trans. Pattern Anal. Mach. Intell 2007, 29, 2247–2253.
[11]
Kass, M.; Witkin, A.; Terzopoulos, D. Snakes: Active contour models. Int. J. Comput. Vis 1998, 1, 321–333.
[12]
Chan, T.; Vese, L. Active contours without edges. IEEE Trans. Image Proc 2001, 10, 266–277.
[13]
Choi, E.; Lee, C. Feature extraction based on the Bhattacharyya distance. Pattern Recognit 2003, 36, 1703–1709.
[14]
Truc, P.T.H.; Lee, S.Y.; Kim, T.-S. A density distance augmented Chan-Vese active contour for CT bone segmentation. Proceedings of the 30th Annual International Conference of IEEE in Medicine and Biology Society, Vancouver, BC, Canada, 20–25 August 2008.
[15]
Hyvarinen, A. New approximations of differential entropy for independent component analysis and project ionpursuit. Adv. Neural Inf. Process. Syst 1998, 10, 273–279.
[16]
Hyvarinen, A.; Karhunen, J.; Oja, E. Independent Component Analysis; Wiley: New York, NY, USA, 2001.
[17]
Kaufman, L.; Rousseeuw, P.J. Finding Groups in Data: An Introduction to Cluster Analysis; John Wiley and Sons: New York, NY, USA, 1990.
[18]
Sarawagi, S.; Cohen, W. Semi-Markov Conditional Random fields for Information Extraction, Available online: http://www.cs.cmu.edu/~wcohen/postscript/semiCRF.pdf (accessed on 26 October 2011).
[19]
Huynh, T.; Fritz, M.; Schiele, B. Discovery of activity patterns using topic models. Proceedings of the 10th International Conference on Ubiquitous Computing (UBICOMP), Seoul, Korea, 21–24 September 2008.
[20]
Ahmad, U.; Gavrilov, A.; Lee, S.Y.; Lee, Y.K. Self-scalable fuzzy ArtMap for received signal strength based location systems. J. Softcomput 2008, 12, 699–713.
[21]
Chen, Y.; Kleisouris, K.; Li, X.; Trappe, W.; Martin, R.P. The robustness of localization algorithms to signal strength attacks: A comparative study. Proceedings of the IEEE International Conference on Distributed Computing in Sensor Systems, San Francisco, CA, USA, 18–20 June 2006.
[22]
Duc, L.V.; Dang, V.H.; Lee, S.Y.; Lee, S.H. Distributed localization in wireless sensor networks based on force-vectors. Proceedings of the 4th International Conference on Intelligent Sensors, Sensor Networks and Information Processing, Sydney, Australia, December 2008.
[23]
Battiti, R.; Villani, A.; Nhat, T.L. Neural network model for intelligent networks: Deriving the location from signal patterns. Proceedings of the 1st Annual Symposium on Autonomous Intelligent Networks and Systems, Los Angeles, CA, USA, May 2002.
[24]
Gruber, T. A translation approach to portable ontology specifications. Knowl. Acquis 1993, 5, 199–220.
[25]
Singh, M.; Huhns, M. Service Oriented Computing: Semantics, Processes, Agents; John Wiley and Sons: West Sussex, UK, 2005.
[26]
Marmasse, N.; Schmandt, C. Location-aware information delivery with commotion. Proceedings of the 2nd International Symposium on Handheld and Ubiquitous Computing, Bristol, UK, 25–27 September 2000; pp. 157–171.
[27]
Lorincz, K.; Chen, B.; Challen, G.W.; Chowdhury, A.R.; Patel, S.; Bonato, P.; Welsh, M. Mercury: A wearable sensor network platform for high-fidelity motion analysis. Proceedings of the 7th ACM Conference on Embedded Networked Sensor Systems (SenSys ’09), Berkeley, CA, USA, November 2009.
[28]
Yoo, I.; Song, M. Biomedical ontologies and text mining for biomedicine and healthcare: A survey. J. Comput. Sci. Eng 2008, 2, 109–136.
[29]
Chen, L.; Nugent, C.; Wang, H. A Knowledge-Driven Approach to Activity Recognition in Smart Homes, Available online: http://doi.ieeecomputersociety.org/10.1109/TKDE.2011.51 (accessed on 26 October 2011).
[30]
Microsoft Health Vault, Available online: http://healthvault.com (accessed on 26 October 2011).
[31]
Google Health, Available online: https://www.google.com/health (accessed on 26 October 2011).