LOW-LEVEL SENSOR FUSION-BASED HUMAN TRACKING FOR MOBILE ROBOT

Danijela Ristić-Durrant, Ge Gao, Adrian Leu

DOI Number
-
First page
17
Last page
32

Abstract


In this paper, a novel sensor-based human tracking method that enables a mobile robot to follow a human with high robustness and responsiveness is presented. The method is based on low-level sensor data fusion combining depth data from a stereo camera and an infrared 2D laser range finder (LRF) to detect target human in the near surrounding of the robot. After initial position of target human is located by sensor fusion-based human detection, a novel tracking algorithm that combines a laser data-based search window and Kalman filter is used to recursively predict and update estimations of target human position in robot’s coordinate system. The use of tracking window contributes to reduction of computational cost by defining region of interest (ROI) enabling so real-time performance. The performance of proposed system was tested in several indoor scenarios. Experimental results show that the proposed human detection algorithm is robust and human tracking algorithm is able to handle fast human movements and keep tracking of target human in various scenarios.

Full Text:

PDF

References


S. Chen, "Kalman filter for robot vision: A survey," IEEE Transactions on Industrial Electronics, vol. 59, no. 11, pp. 4409 – 4420, 2012. [Online]. Available: http://dx.doi.org/10.1109/TIE.2011.2162714

J. Lee, W. Yu, J. Hwang, C. Kim, "A lazy decision approach based on ternary thresholding for robust target object detection," in Proceedings of IEEE International Conference on Robotics and Automation, pp. 3924–3929, 2014. [Online]. Available: http://dx.doi.org/10.1109/ICRA.2014.6907428

S. Kai, H. Yuan, C. Li, "Sensor fusion based human detection and tracking system for human-robot interaction," in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4835–4840, 2012. [Online]. Available: http://dx.doi.org/10.1109/IROS.2012.6386222

G. Gate, A. Breheret, F. Nashashibi, "Fast pedestrian detection in dense environment with a laser scanner and a camera," in Proceedings of IEEE 69th Vehicular Technology Conference, pp. 1–6, 2009. [Online]. Available: http://dx.doi.org/10.1109/VETECS.2009.5073555

E. Petrovic, A. Leu, D. Ristić-Durrant, V. Nikolić, "Stereo vision-based human tracking for robotic follower," International Journal of Advanced Robotic Systems, 2013. [Online]. Available: http://dx.doi.org/10.5772/56124

C. Chou, J. Li, M. Chang, L. Fu "Multi-robot cooperation based human tracking system using laser range finder," in Proceedings of IEEE International Conference on Robotics and Automation, pp. 532 – 537, 2011. [Online]. Available: http://dx.doi.org/10.1109/ICRA.2011.5980484

L. Spinello, R. Triebel, R. Siegwart "Multi-modal people detection and tracking in crowded scenes," in Proceedings of the Twenty/Third AAAI Conference on Artificial Intelligence, 2008. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.149.4095

G. Gao, Calibration of stereo camera and 2d laser scanner for environment perception. Technical report, Institute of Automation, University of Bremen, 2014.

R. Siegwart, I. Nourbakhsh, D. Scaramuzza, Introduction to Autonomous Mobile Robots. Massachusetts Institute of Technology, 2011.

T. Tao, J. C. Koo, H. R. Choi, "A fast block matching algorithm for stereo correspondence," in Proceedings of IEEE Conference on Cybernetics and Intelligent Systems, pp. 38– 41, 2008. [Online]. Available: http://dx.doi.org/10.1109/ICCIS.2008.4670774

S. K. Natarajan, D. Ristic-Durrant, A. Leu, A. Graeser, "Robust stereo-vision based 3D modeling of real-world objects for assistive robotic applications," in Proceedings of the IEEE International Conference on Intelligent Robots and Systems, pp. 786–792, 2011. [Online]. Available: http://dx.doi.org/10.1109/

IROS.2011.6094716

M. K. Hu, "Visual Pattern Recognition by Moment Invariants," IRE Transaction on Information Theory, 1962. [Online]. Available: http://dx.doi.org/10.1109/TIT.1962.1057692

R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2004

G. P. Zhang, "Neural networks for classification: a survey,” IEEE Transactions on Systems, Man and Cybernetics, Part C: Applications and Reviews, vol. 30, no. 4, pp. 451–462, 2000. [Online]. Available: http://dx.doi.org/ 10.1109/5326.897072

R. Faragher "Understanding the basis of the kalman filter via a simple and intuitive derivation," IEEE Signal Processing Magazine, vol. 29, no. 5, pp. 128 - 132, 2012. [Online]. Available: http://dx.doi.org/

1109/MSP.2012.2203621

G. Welch, G. Bishop, An introduction to the Kalman filter. Techn. Rep., Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC. 1995. [Online]. Available: http:// http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.79.6578&rep=rep1&type=pdf

CORBYS-Cognitive Control Framework for Robotic Systems, [Online]. Available: www.corbys.eu


Refbacks

  • There are currently no refbacks.


Print ISSN: 1820-6417
Online ISSN: 1820-6425