Yu Liang, Chao Wu

DOI Number
First page
Last page


To obtain a real-time situational awareness about the specific behavior of targets-of-interest using large-scale sensory data-set, this paper presents a generic sensor-oriented information system based on Hadoop Ecosystem, which is denoted as SOIS-Hadoop for simplicity.  Robotic heterogeneous sensor nodes bound by wireless sensor network are used to track things-of-interest. Hadoop Ecosystem enables highly scalable and fault-tolerant acquisition, fusion and storage, retrieval, and processing of sensory data. In addition, SOIS-Hadoop employs temporally and spatially dependent mathematical model to formulate the expected behavior of targets-of-interest, based on which the observed behavior of targets can be analyzed and evaluated.  Using two real-world sensor-oriented information processing and analysis problems as examples, the mechanism of SOIS-Hadoop is also presented and validated in detail.


Sensor-oriented information system, Hadoop Ecosystem, target of interest, wireless sensor network, mathematical model

Full Text:



O. Bott, M. Marschollek, K.-H. Wolf, and R. Haux, "Towards new scopes: sensor-enhanced regional health information systems-part 1: architectural challenges", Meth. Inform. Med., vol. 46, pp. 476-483, 2007.

J. V. C. Schneider, Information Systems Today: Managing in the Digital World. Prentice Hall, 2015.

F. Zhao, J. Shin, and J. Reich, "Information-driven dynamic sensor collaboration", IEEE Signal Process. Mag., vol. 19, pp. 61-72, 2002.

W. M. Ulrich, Legacy systems: transformation strategies. Prentice Hall, 2002.

S. Fernandes, Y. Liang, S. Sritharan, X. Wei, and R. Kandiah, "Real Time Detection of Improvised Explosive Devices using Hyperspectral Image Analysis", in 2010 IEEE National Aerospace and Electronics Conference (NAECON 2010). 2010.

S. Fernandes and Y. Liang, "Chipping and segmentation of target of interest from low-resolution electro-optical data", in SPIE Defense, Security, and Sensing. 2013, pp. 87440R-87440R-8.

K. Grolinger, W. A. Higashino, A. Tiwari, and M. A. Capretz, "Data management in cloud environments: NoSQL and NewSQL data stores", J. Cloud. Comput. Adv. Syst. Appl., vol. 2, p. 22, 2013.

Y. Liang, W. Melvinb, S. Fernandesa, M. Hendersona, S. I. Sritharanc, and D. Barkerd, "A Crowd Motion Analysis Framework Based on Analog Heat-Transfer Model", American Journal of Science and Engineering, vol. 2, pp. 33-43, 2013.

Y. Liang, M. Henderson, S. Fernandes, and J. Sanderson, "Vehicle tracking and analysis within a city", in SPIE Defense, Security, and Sensing. 2013, pp. 87510F-87510F-15.

Y. Liang, M. Szularz, and L. T. Yang, "Finite-element-wise domain decomposition iterative solvers with polynomial preconditioning", Math. Comput. Model., vol. 58, pp. 421-437, 2013.

A. S. Foundation. (2014). Hadoop Releases. Available: http://www.apache.org/

Y. Liang and C. Wu, "A Sensor-Oriented Information System Based on Hadoop Cluster", in Proceedings on the International Conference on Internet Computing (ICOMP). 2014, p. 1.

Y. Liang and C. Wu, "An agent-based mathematical model about carp aggregation", in SPIE Sensing Technology+ Applications. 2015, pp. 94860Q-94860Q-11.

R. C. Taylor, "An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics", BMC Bioinformatics, vol. 11, p. S1, 2010.

Y. Liang, W. Melvin, S. I. Sritharan, S. Fernandes, and D. Barker, "CMA-HT: a crowd motion analysis framework based on heat-transfer analog model", in SPIE Defense, Security, and Sensing. 2012, pp. 84020J-84020J-13.

Y. Liang, Z. Shi, S. I. Sritharan, and H. Wan, "Simulation of the Spread of Epidemic Disease Using Persistent Surveillance Data", in proceeding of COMSOL 2010. Boston, 2010.

K. Langendoen and N. Reijers, "Distributed localization in wireless sensor networks: a quantitative comparison", Comput. Netw., vol. 43, pp. 499-518, 2003.

H. Qi and J. B. Moore, "Direct Kalman filtering approach for GPS/INS integration", IEEE Trans. Aerosp. Electron. Syst., vol. 38, pp. 687-693, 2002.

G. A. Bekey, Autonomous robots: from biological inspiration to implementation and control. MIT press, 2005.

G. Anastasi, M. Conti, M. Di Francesco, and A. Passarella, "Energy conservation in wireless sensor networks: A survey", Ad hoc networks, vol. 7, pp. 537-568, 2009.

T. S. Rappaport, Wireless communications: principles and practice. vol. 2: prentice hall, 2002.

J. N. Al-Karaki and A. E. Kamal, "Routing techniques in wireless sensor networks: a survey", IEEE Wireless Commun., vol. 11, pp. 6-28, 2004.

Y. Liang, J. Weston, and M. Szularz, "Generalized least-squares polynomial preconditioners for symmetric indefinite linear equations", Parallel. Comput., vol. 28, pp. 323-341, 2002.

J. Sanderson and Y. Liang, "No-reference image quality measurement for low-resolution images", in SPIE Defense, Security, and Sensing. 2013, pp. 874404-874404-17.

W. Ren and R. W. Beard, Distributed consensus in multi-vehicle cooperative control. Springer, 2008.

S. Camazine, Self-organization in biological systems. Princeton University Press, 2003.

I. D. Couzin, J. Krause, R. James, G. D. Ruxton, and N. R. Franks, "Collective memory and spatial sorting in animal groups", J. Theor. Biol., vol. 218, pp. 1-11, 2002.

A. Deutsch and S. Dormann, Cellular automaton modeling of biological pattern formation. 2005.

A. Huth and C. Wissel, "The simulation of the movement of fish schools", J. Theor. Biol., vol. 156, pp. 365-385, 1992.

P. B. Johnsen and A. D. Hasler, "Winter aggregations of carp (Cyprinus carpio) as revealed by ultrasonic tracking", Trans. Am. Fish. Soc., vol. 106, pp. 556-559, 1977.

R. Jullien and R. Botet, Aggregation and fractal aggregates. World Scientific Pub Co Inc, 1987.

S. Stöcker, "Models for tuna school formation", Math. Biosci., vol. 156, pp. 167-190, 1999.

T. Vicsek, A. Czirók, E. Ben-Jacob, I. Cohen, and O. Shochet, "Novel type of phase transition in a system of self-driven particles", Phys. Rev. Lett., vol. 75, p. 1226, 1995.

M. Bando, K. Hasebe, A. Nakayama, A. Shibata, and Y. Sugiyama, "Dynamical model of traffic congestion and numerical simulation", Phys. Rev. E: Stat., Nonlinear, Soft Matter Phys., vol. 51, p. 1035, 1995.

M. J. Lighthill and G. B. Whitham, "On kinematic waves. II. A theory of traffic flow on long crowded roads", in Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences. 1955, pp. 317-345.

H. M. Zhang, "A mathematical theory of traffic hysteresis", Transport. Res. B-Meth., vol. 33, pp. 1-23, 1999.

A. C. R. C. Committee, "Asian carp control strategy framework", 2013.

E. H. Buck, H. F. Upton, C. V. Stern, and J. E. Nicols, "Asian carp and the Great Lakes region", 2010.

J. Rosenfeld, "Assessing the habitat requirements of stream fishes: an overview and evaluation of different approaches", Trans. Am. Fish. Soc., vol. 132, pp. 953-968, 2003.

R. Naylor, S. Williams, and D. Strong, "Aquaculture-a gateway for exotic species", Science (Wash.), vol. 294, pp. 1655-1656, 2001.

R. Goldburg, M. S. Elliott, R. Naylor, and P. O. Commission, Marine aquaculture in the United States: environmental impacts and policy options. Pew Oceans Commission, 2001.

T. M. Koel, K. S. Irons, and E. N. Ratcliff, "Asian carp invasion of the upper Mississippi River system", US Department of the Interior, US Geological Survey, Upper Midwest Environmental Sciences Center, 2000.

P. Bajer, C. Chizinski, and P. Sorensen, "Using the Judas technique to locate and remove wintertime aggregations of invasive common carp", Fish. Manage. Ecol., vol. 18, pp. 497-505, 2011.

A. R. Leach, Molecular modelling: principles and applications. Prentice Hall, 2001.

A. Czirók, M. Vicsek, and T. Vicsek, "Collective motion of organisms in three dimensions", Physica. A., vol. 264, pp. 299-304, 1999.

C. W. Reynolds, "Flocks, herds and schools: A distributed behavioral model", in ACM Siggraph Computer Graphics. 1987, pp. 25-34.

A. Aw and M. Rascle, "Resurrection of" second order" models of traffic flow", SIAM journal on applied mathematics, vol. 60, pp. 916-938, 2000.

Y. Liang, The Use of Parallel Polynomial Preconditioners: In the Solution of Systems of Linear Equations. LAP LAMBERT Academic Publishing, 2013.

A. Toselli and O. Widlund, Domain decomposition methods: algorithms and theory. vol. 3: Springer, 2005.

S. Theodoridis, Machine Learning: A Bayesian and Optimization Perspective. Academic Press, 2015.


  • There are currently no refbacks.

ISSN: 0353-3670 (Print)

ISSN: 2217-5997 (Online)

COBISS.SR-ID 12826626