KALMAN FILTER AND NARX NEURAL NETWORK FOR ROBOT VISION BASED HUMAN TRACKING

Emina Petrović, Žarko Ćojbašić, Danijela Ristić-Durrant, Vlastimir Nikolić, Ivan Ćirić, Srđan Matić

DOI Number
-
First page
43
Last page
51

Abstract


Tracking human is an important and challenging problem in video-based intelligent robot systems. In this paper, a vision-based human tracking system is supposed to provide sensor input for vision-based control of a mobile robot that works in a team helping the human co-worker. A comparison between NARX neural network and Kalman filter in solving the prediction problem of human tracking in robot vision is presented. After collecting video data from a robot, simulation results obtained from the Kalman filter model are used to compare with the simulation results obtained from the NARX Neural network.


Key words: robot vision, Kalman filter, neural networks, human tracking


Full Text:

PDF

References


J. Borenstein, D. Thomas, B. Sights, L. Ojedo, P. BAnkole, D. Fellars, "Human leader and robot follower team: correcting leader's position from follower's heading," in Proc. of the SPIE Defense, Security and Sensing, Orlando, Florida, 2010.

S. Ji, W. Xu, M. Yang, K. Yu, "3D convolutional neural networks for human action recognition," in Proc. of the 27th International Conference on Machine Learning, Haifa, Israel, 2010.

G. Cielinak, M. Miladinovic, D. Hammarin, L. Goranson, A. Lilienthal, T. Duckett, "Appearance based tracking of persons with an omnidirectional vision sensor," in Proc. of Computer Vision and Pattern Recognition Workshop, 2003. [Online]. Available: http://dx.doi.org/10.1109/CVPRW.2003.10072

J. Bobruk, D. Austin, "Laser motion detection and hypothesis tracking from a mobile platform," in Proc. of the Australian Conference on Robotics & Automation, pp. 1–10, 2004.

P. Urcola, L. Montano, "Adapting robot team behavior from interaction with a group of people," in Proc. Intelligent Robots and Systems, pp. 2887–2894, 2011. [Online]. Available: http://dx.doi.org/10.1109/IROS.2011.6094961

D. Beymer, K. Konolige, "Tracking people from a mobile platform," Experimental Robotics VIII, pp. 234–244, 2003. [Online]. Available: http://dx.doi.org/10.1007/3-540-36268-1_20

M. Burke, W. Brink, "Gain-scheduling control of a monocular vision-based human-following robot," in Proc. of 18th World Congress of the International Federation of Automatic Control, Milano, Italy, 2011, pp. 8177–8182.

N. Bellotto, H. Hu, "A bank of unscented Kalman filters for multimodal human perception with mobile service robots," International Journal of Social Robotics, vol. 2, no. 2, pp. 121–136, 2010. [Online]. Available: http://dx.doi.org/10.1007/s12369-010-0047-x

J. A. Corrales, F. A. Candelas, F. Torres, "Kalman filtering for sensor fusion in a human tracking system," Intech, pp. 59–72, 2010.

N. Bellotto, H. Hu, "Multisensor-based human detection and tracking for mobile service robots," IEEE Transactions on systems, Man, and Cybernetics-part B: Cybernetics, vol. 39, no. 1, pp. 167–181, 2009. [Online]. Available: http://dx.doi.org/10.1109/TSMCB.2008.2004050

R. E. Kalman, "A new approach to linear filtering and prediction problems," Journal of Basic Engineering, vol. 82, no. 1, pp. 35–45, 1960.

J. Satake, J. Miura, "Robust stereo-based person detection and tracking for a person following robot," in Proc. of the Workshop on People Detection and Tracking, Kobe, Japan, May 2009.

Y. Zheng, Y Meng, "Real-time people tracking and following using a vision-controlled mobile robot," Robot Vision: New Research, 2009.

C.Y. Tsai, X. Dutoit, K.T. Song, H.V. Brussel, M. Nuttin, "Robust face tracking control of a mobile robot using self-tuning Kalman filter and echo state network," Asian Journal of Control, vol. 12, no. 4, pp 488–509, 2010. [Online]. Available: http://dx.doi.org/10.1002/asjc.204

E. Petrović, D. Ristić-Durrant, A. Leu, V. Nikolić, "A novel approach to human tracking for robotic Follower," in Proc. XI International SAUM Conference on Systems, Automatic Control and Measurements, Niš, Serbia, 2012, pp.178–181.

Leu, D. Aiteanu, A. Gräser, "A novel stereo camera based collision warning system for automotive applications," in Proc of 6th IEEE International Symposium on applied Computational Intelligence and Informatics, SACI 2011, Timisoara, Romania, 2011, pp. 409–414, 2011. [Online]. Available: http://dx.doi.org/10.1109/SACI.2011.5873038

S. Chen, "Kalman filter for robot vision: a survey," IEEE Transactions on Industrial Electronics, vol. 59, no. 11, pp. 4409–4420, 2012. [Online]. Available: http://dx.doi.org/10.1109/TIE.2011.2162714

Pelliccioni, T. Tirabassi, "Air dispersion model and neural network: a new perspective for integrated models in the simulation of complex situations," Environmental Modeling & Software, vol. 21, no. 4, pp. 539–546, 2006. [Online]. Available: http://dx.doi.org/10.1016/j.envsoft.2004.07.015

I. Ćirić, Ž. Ćojbašić, V. Nikolić, P. Živković, M. Tomić, "Air quality estimation by computational intelligence methodologies," Thermal Science, vol. 16, iss. 2, pp. 493–504, 2012. [Online]. Available: http://dx.doi.org/10.2298/TSCI120503186C


Refbacks

  • There are currently no refbacks.


Print ISSN: 1820-6417
Online ISSN: 1820-6425