PROCESSING AND ANALYSIS OF BIG TRAJECTORY DATA USING MAPREDUCE

Natalija M. Stojanović, Dragan H. Stojanović

DOI Number
-
First page
19
Last page
27

Abstract


In this paper, we present research work related to processing and analysis of big trajectory data using MapReduce framework. We describe the MapReduce-based algorithms and applications implemented on Hadoop for processing spatial join between big trajectory data and set of POI regions and appropriate aggregation of join results. The experimental evaluation and results in detecting trajectory patterns of particular users and the most popular places in the city demonstrate the feasibility of our approach. The visual analytics of MapReduce job output improve the trajectory and movement analysis.

Full Text:

PDF

References


A. Clematis, M. Mineter, R. Marciano, "High performance computing with geographical data," Parallel Computing, vol. 29, no. 10, pp. 1275–1279, 2003.

S. Shekhar, "High performance computing with spatial datasets," in Proceedings of the ACM SIGSPATIAL International Workshop on High Performance and Distributed Geographic Information Systems - HPDGIS, 2010, pp. 1–2. [Online]. Available: http://dx.doi.org/10.1145/1869692.1869693

A. Aji, F. Wang, H. Vo, R. Lee, Q. Liu, X. Zhang, J. Saltz, "Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce," in Proceedings VLDB Endowment, vol. 6, no. 11, Aug. 2013. [Online]. Available: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3814183/

J. Zhang, "Towards Personal High-Performance Geospatial Computing (HPC-G)," in Proceedings of the ACM SIGSPATIAL International Workshop on High Performance and Distributed Geographic Information Systems - HPDGIS, 2010, pp. 3–10. [Online]. Available: http://dx.doi.org/ 10.1145/1869692.1869694

J. Dean, S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," Communications of ACM, vol. 51, no. 1, p. 107, Jan. 2008. [Online]. Available: http://dx.doi.org/ 10.1145/1327452.1327492

T. White, Hadoop: The Definitive Guide, 3rd Edition. O’Reilly Media, 2012.

V. Mayer-Schönberger, K. Cukier, Big Data: A Revolution That Will Transform How We Live, Work, and Think. Eamon Dolan/Houghton Mifflin Harcourt, 2013, p. 256.

A. Cary, Z. Sun, V. Hristidis, N. Rishe, "Experiences on Processing Spatial Data with Using MapReduce in Practice," in Proceedings of 21st International Conference on Scientific and Statistical Database Management, 2009, pp. 302 – 319. [Online]. Available: http://dx.doi.org/10.1007/978-3-642-02279-1_24

K. Wang, J. Han, B. Tu, J. Dai, W. Zhou, X. Song, "Accelerating Spatial Data Processing with MapReduce," in Proceedings of the 2010 IEEE 16th International Conference on Parallel and Distributed Systems, 2010, pp. 229–236. [Online]. Available: http://dx.doi.org/10.1109/ICPADS.2010.76

S. Zhang, J. Han, Z. Liu, K. Wang, Z. Xu, "SJMR: Parallelizing spatial join with MapReduce on clusters," in Proceedings of the IEEE International Conference on Cluster Computing and Workshops, 2009, pp. 1–8. [Online]. Available: http://dx.doi.org/10.1109/CLUSTR.2009.5289178

Q. Ma, B. Yang, W. Qian, A. Zhou, "Query Processing of Massive Trajectory Data based on MapReduce," in Proceeding of the Ffirst international workshop on Cloud Data Management - CloudDB ’09, 2009, pp. 9–16. [Online]. Available: http://dx.doi.org/10.1145/1651263.1651266

B. Yang, Q. Ma, W. Qian, A. Zhou, "Truster: Trajectory data processing on clusters," in Proceedings of 14th International Conf. on Database Systems for Advanced Applications, 2009, pp. 768–771. [Online]. Available: http://dx.doi.org/10.1007/978-3-642-00887-0_69

A. Eldawy, M. F. Mokbel, "A Demonstration of SpatialHadoop: An Efficient MapReduce Framework for Spatial Data," Proceedings VLDB Endowment, vol. 6, no. 12, pp. 1230–1233, Aug. 2013. [Online]. Available: http://dx.doi.org/10.14778/2536274.2536283

S. Mascetti, D. Freni, C. Bettini, X. S. Wang, S. Jajodia, "On the Impact of User Movement Simulations in the Evaluation of LBS Privacy-Preserving Techniques," in Proceedings of the 1st Internationl Workshop on Privacy in Location-Based Applications, 2008, vol. 397. [Online]. Available: http://sunsite.informatik.rwth-aachen.de/Publications/CEUR-WS/Vol-397/paper5.pdf


Refbacks

  • There are currently no refbacks.


Print ISSN: 1820-6417
Online ISSN: 1820-6425