Non-contact human body measurement plays an important role in surveillance, physical healthcare, on-line business and virtual fitting. Current methods for measuring the human body without physical contact usually cannot handle humans wearing clothes, which limits their applicability in public environments. In this paper, we propose an effective solution that can measure accurate parameters of the human body with large-scale motion from a Kinect sensor, assuming that the people are wearing clothes. Because motion can drive clothes attached to the human body loosely or tightly, we adopt a space-time analysis to mine the information across the posture variations. Using this information, we recover the human body, regardless of the effect of clothes, and measure the human body parameters accurately. Experimental results show that our system can perform more accurate parameter estimation on the human body than state-of-the-art methods.
References
[1]
De Aguiar, E.; Stoll, C.; Theobalt, C.; Ahmed, N.; Seidel, H.P.; Thrun, S. Performance capture from sparse multi-view video. ACM Trans. Graph. 2008, 27. Article No. 98.
[2]
Liu, Y.; Stoll, C.; Gall, J.; Seidel, H.P.; Theobalt, C. Markerless Motion Capture of Interacting Characters using Multi-View Image Segmentation. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA, 21–23 June 2011; pp. 1249–1256.
[3]
Stoll, C.; Hasler, N.; Gall, J.; Seidel, H.; Theobalt, C. Fast Articulated Motion Tracking using a Sums of Gaussians Body Model. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain, 8–11 November 2011; pp. 951–958.
[4]
Straka, M.; Hauswiesner, S.; Ruther, M.; Bischof, H. Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time. Proceedings of the IEEE International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, ETH Zürich, Switzerland, 13–15 October 2012; pp. 41–48.
[5]
Khoshelham, K.; Elberink, S.O. Accuracy and resolution of Kinect depth data for indoor mapping applications. Sensors 2012, 12, 1437–1454.
[6]
Weiss, A.; Hirshberg, D.; Black, M.J. Home 3D Body Scans from Noisy Image and Range Data. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain, 8–11 November 2011; pp. 1951–1958.
[7]
Cui, Y.; Chang, W.; N？ll, T.; Stricker, D. KinectAvatar: Fully Automatic Body Capture using a Single Kinect. Proceedings of the Asian Conference on Computer Vision Workshops, Daejeon, Korea, 5–9 November 2012; pp. 133–147.
[8]
Moeslund, T.B.; Hilton, A.; Krüger, V. A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 2006, 104, 90–126.
[9]
Ye, M.; Wang, X.; Yang, R.; Ren, L.; Pollefeys, M. Accurate 3D Pose Estimation from a Single Depth Image. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain, 8–11 November 2011; pp. 731–738.
[10]
Fechteler, P.; Hilsmann, A.; Eisert, P. Kinematic ICP for Articulated Template Fitting. Proceedings of the 17th International Workshop on Vision, Modeling & Visualization, Magdeburg, Germany, 12–14 November 2012; pp. 215–216.
[11]
Shotton, J.; Sharp, T.; Kipman, A.; Fitzgibbon, A.; Finocchio, M.; Blake, A.; Cook, M.; Moore, R. Real-time human pose recognition in parts from single depth images. Commun. ACM 2013, 56, 116–124.
[12]
Ganapathi, V.; Plagemann, C.; Koller, D.; Thrun, S. Real Time Motion Capture using a Single Time-Of-Flight Camera. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, 13–18 June 2010; pp. 755–762.
[13]
Wei, X.; Zhang, P.; Chai, J. Accurate realtime full-body motion capture using a single depth camera. ACM Trans. Gr. 2012, 31, 188:1–188:12.
[14]
Anguelov, D.; Srinivasan, P.; Koller, D.; Thrun, S.; Rodgers, J.; Davis, J. SCAPE: Shape completion and animation of people. ACM Trans. Gr. 2005, 24, 408–416.
[15]
Guan, P.; Reiss, L.; Hirshberg, D.A.; Weiss, A.; Black, M.J. DRAPE: Dressing any person. ACM Trans. Gr. 2012, 31, 35:1–35:10.
[16]
Hasler, N.; Stoll, C.; Rosenhahn, B.; Thorm？hlen, T.; Seidel, H.P. Estimating body shape of dressed humans. Comput. Gr 2009, 33, 211–216.
[17]
Bregler, C.; Hertzmann, A.; Biermann, H. Recovering Non-Rigid 3D Shape from Image Streams. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Hilton Head, SC, USA, 13–18 June 2000.
[18]
Xiao, J.; Chai, J.X.; Kanade, T. A Closed-Form Solution to Non-Rigid Shape and Motion Recovery. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic, 11–14 May 2004; pp. 573–587.
[19]
Akhter, I.; Sheikh, Y.; Khan, S.; Kanade, T.; et al. Nonrigid Structure from Motion in Trajectory Space. Proceedings of the Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada, 8–13 December 2008; pp. 41–48.
[20]
Dai, Y.; Li, H.; He, M. A Simple Prior-Free Method for Non-Rigid Structure-from-Motion Factorization. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Providence, Rhode Island, RI, USA, 16–21 June 2012; pp. 2018–2025.
[21]
Hasler, N.; Stoll, C.; Sunkel, M.; Rosenhahn, B.; Seidel, H.P. A Statistical Model of Human Pose and Body Shape. Proceedings of the Annual Conference of the European Association for Computer Graphics, Munich, Germany, 30 March–3 April 2009; pp. 337–346.
[22]
Gauvain, J.L.; Lee, C.H. Maximum a posteriori estimation for multivariate gaussian mixture observations of Markov chains. IEEE Trans. Audio Speech Lang. Process. 1994, 2, 291–298.
[23]
Rublee, E.; Rabaud, V.; Konolige, K.; Bradski, G. ORB: An Efficient Alternative to SIFT or SURF. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain, 8–11 November 2011; pp. 2564–2571.
[24]
Myronenko, A.; Song, X. Point set registration: Coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32, 2262–2275.
[25]
Baker, S.; Matthews, I. Lucas-Kanade 20 years on: A unifying framework. Int. J. Comput. Vis. 2004, 56, 221–255.
[26]
Bregler, C.; Malik, J.; Pullen, K. Twist based acquisition and tracking of animal and human kinematics. Int. J. Comput. Vis. 2004, 56, 179–194.
[27]
Murray, R.M.; Li, Z.; Sastry, S.S.; Sastry, S.S. A Mathematical Introduction to Robotic Manipulation; CRC Press: Boca Raton, FL, USA, 1994.
[28]
Desbrun, M.; Meyer, M.; Schr？der, P.; Barr, A.H. Implicit Fairing of Irregular Meshes using Diffusion and Curvature Flow. Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA, 8–13 August 1999; pp. 317–324.
