A COMPREHENSIVE COMPARATIVE STUDY OF MACHINE LEARNING MODELS FOR PREDICTING CRYPTOCURRENCY
Abstract
This study aims to find the best performing model in predicting cryptocurrencies using different machine learning models. In our study, an analysis was performed on various cryptocurrencies such as Aave, BinanceCoin, Bitcoin, Cardano, Cosmos, Dogecoin, Ethereum, Solana, Tether, Tron, USDCoin and XRP. Decision Trees, Random Forests, K-Nearest Neighbours (KNN), Gradient Boost Machine (GBM), LightGBM, XGBoost, CatBoost, Artificial Neural Networks (ANN), Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and Short Term Memory networks in Long Comparisons (LSTM) models were used. The performance of the models is compared with Mean Squared Error (MSE), Root Mean Square Error (RMSE) and Mean Absolute Error (MAE). The study results show that there is no single model that consistently outperforms others for all cryptocurrencies. Models such as XGBoost and Random Forests show consistent and strong performance across different cryptocurrencies, proving their robustness in this particular use case. Deep learning algorithms, including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and Long Short Term Memory Networks (LSTMs), show significant accuracy in predicting some cryptocurrencies.
Keywords
Full Text:
PDFReferences
F. Alonso and M. Á. Sicilia, "Cryptocurrency Curated News Event Database From GDELT," Research Square (Research Square), Oct. 2022.
F. D’Amario and Milos Ciganovic, "Forecasting Cryptocurrencies Log-Returns: a LASSO-VAR and Sentiment Approach," arXiv (Cornell University), Sep. 2022.
S. A. Manavi, G. Jafari, S. Rouhani, and M. Ausloos, "Demythifying the belief in cryptocurrencies decentralized aspects. A study of cryptocurrencies time cross-correlations with common currencies, commodities and financial indices," Physica A: Statistical Mechanics and its Applications, vol. 556, p. 124759, Oct. 2020.
L. J. Tjahyana, "Studi Netnografi Pola Komunikasi Jaringan Komunitas Cryptocurrency Dogecoin Pada Twitter," Jurnal Komunikatif, vol. 10, no. 1, pp. 16–37, Jul. 2021.
S. Ichsani and N. S. Mahendra, "Return and Risk Analysis on Cryptocurrency Assets," Kontigensi : Jurnal Ilmiah Manajemen, vol. 10, no. 1, pp. 149–160, Jun. 2022.
B. Ebner, L. Eid, and B. Klar, "Cauchy or not Cauchy? New goodness-of-fit tests for the Cauchy distribution," arXiv (Cornell University), Jun. 2021.
R. Kher, S. Terjesen, and C. Liu, "Blockchain, Bitcoin, and ICOs: a review and research agenda," Small Business Economics, Jan. 2020.
Q. A. Al-Haija and A. A. Alsulami, "High Performance Classification Model to Identify Ransomware Payments for Heterogeneous Bitcoin Networks,” Electronics, vol. 10, no. 17, p. 2113, Aug. 2021.
P. K. Singh, A. K. Pandey, and S. C. Bose, “A new grey system approach to forecast closing price of Bitcoin, Bionic, Cardano, Dogecoin, Ethereum, XRP Cryptocurrencies," Quality & Quantity, Jul. 2022.
L. H. S. Fernandes, E. Bouri, J. W. L. Silva, L. Bejan, and F. H. A. de Araujo, "The resilience of cryptocurrency market efficiency to COVID-19 shock," Physica A: Statistical Mechanics and its Applications, p. 128218, Oct. 2022.
J.-F. Pietschmann and M. Schlottbom, "Data driven gradient flows," arXiv (Cornell University), May 2022.
L. Juškaitė and L. Gudelytė-Žilinskienė, "Investigation of the Feasibility of Including Different Cryptocurrencies in the Investment Portfolio for its Diversification," Journal Business, Management and Economics Engineering, vol. 20, no. 01, pp. 172–188, May 2022.
K. He, Q. Yang, L. Ji, J. Pan, and Y. Zou, "Financial Time Series Forecasting with the Deep Learning Ensemble Model," Mathematics, vol. 11, no. 4, p. 1054, Jan. 2023.
L. Rokach and O. Z. Maimon, Data mining with decision trees: theory and applications. New Jersey Etc.: World Scientific, Cop, 2015.
B. Gupta, A. Rawat, A. Jain, A. Arora, and N. Dhami, "Analysis of Various Decision Tree Algorithms for Classification in Data Mining," International Journal of Computer Applications, vol. 163, no. 8, pp. 15–19, Apr. 2017.
A. Singh, "A New Investment Opportunity: Bitcoin & Ethereum Cryptocurrency," International Journal of Scientific Research in Engineering and Management, vol. 06, no. 10, Oct. 2022.
A. A. Oyedele, A. O. Ajayi, L. O. Oyedelec, S. A. Bello, and K. O. Jimoh, "Performance evaluation of deep learning and boosted trees for cryptocurrency closing price prediction," Expert Systems with Applications, p. 119233, Nov. 2022.
H. Anantharaman, A. Mubarak, and B.T Shobana, "Modelling an Adaptive e-Learning System Using LSTM and Random Forest Classification," Nov. 2018.
M. Fratello and R. Tagliaferri, "Decision Trees and Random Forests," pp. 374–383, Jan. 2016.
C. Liu, Y. Chan, S. H. Alam Kazmi, and H. Fu, "Financial Fraud Detection Model: Based on Random Forest," International Journal of Economics and Finance, vol. 7, no. 7, Jun. 2015.
Z. Rustam and G. S. Saragih, "Predicting Bank Financial Failures using Random Forest," IEEE Xplore, May 01, 2018.
A. Inamdar, A. Bhagtani, S. Bhatt, and P. M. Shetty, "Predicting Cryptocurrency Value using Sentiment Analysis," IEEE Xplore, May 01, 2019. https://ieeexplore.ieee.org/abstract/document/9065838 (accessed Mar. 30, 2022).
Z. Zhang, "Introduction to machine learning: k-nearest neighbors," Annals of Translational Medicine, vol. 4, no. 11, pp. 218–218, Jun. 2016.
Y. Lee, C.-H. Wei, and K.-C. Chao, "Non-parametric machine learning methods for evaluating the effects of traffic accident duration on freeways," Archives of Transport, vol. 43, no. 3, pp. 91–104, Sep. 2017.
Y. A. Ünvan, and C. Ergenç "Stock Market Forecasting with Machine Learning: The case of BIST-100 Index," International Research Journal of Modernization in Engineering Technology and Science, Jun. 2023.
J. Behera, A. K. Pasayat, H. Behera, and P. Kumar, "Prediction based mean-value-at-risk portfolio optimization using machine learning regression algorithms for multi-national stock markets," Engineering Applications of Artificial Intelligence, vol. 120, p. 105843, Apr. 2023.
M. Chen, U. Challita, W. Saad, C. Yin, and M. Debbah, "Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial, " IEEE Communications Surveys & Tutorials, vol. 21, no. 4, pp. 3039–3071, 2019.
M. C. Nwadiugwu, "Neural Networks, Artificial Intelligence and the Computational Brain," arXiv.org, Dec. 25, 2020. https://arxiv.org/abs/2101.08635
V. Uraikul, C. W. Chan, and P. Tontiwachwuthikul, "Artificial intelligence for monitoring and supervisory control of process systems," Engineering Applications of Artificial Intelligence, vol. 20, no. 2, pp. 115–131, Mar. 2007.
S. Islam et al., "A comprehensive survey on applications of transformers for deep learning tasks," Expert Systems with Applications, pp. 122666–122666, Nov. 2023.
S. Zhang et al., "Architectural Complexity Measures of Recurrent Neural Networks," Neural Information Processing Systems, 2016.
P. B. Weerakody, K. W. Wong, G. Wang, and W. Ela, "A review of irregular time series data handling with gated recurrent neural networks," Neurocomputing, vol. 441, pp. 161–178, Jun. 2021.
A. Shewalkar, D. Nyavanandi, and S. A. Ludwig, "Performance Evaluation of Deep Neural Networks Applied to Speech Recognition: RNN, LSTM and GRU," Journal of Artificial Intelligence and Soft Computing Research, vol. 9, no. 4, pp. 235–245, Oct. 2019.
E. Brophy, Z. Wang, Q. She, and T. Ward, "Generative adversarial networks in time series: A survey and taxonomy," arXiv:2107.11098 [cs], Jul. 2021, Available: https://arxiv.org/abs/2107.11098
A. Khan, A. Sohail, U. Zahoora, and A. S. Qureshi, "A survey of the recent architectures of deep convolutional neural networks,” Artificial Intelligence Review, vol. 53, Apr. 2020.
X. Lu et al., "Fault diagnosis for photovoltaic array based on convolutional neural network and electrical time series graph," Energy Conversion and Management, vol. 196, pp. 950–965, Sep. 2019.
M. Al-Smadi, B. Talafha, M. Al-Ayyoub, and Y. Jararweh, "Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews," International Journal of Machine Learning and Cybernetics, vol. 10, no. 8, pp. 2163–2175, Mar. 2018.
G. Liu and J. Guo, "Bidirectional LSTM with attention mechanism and convolutional layer for text classification," Neurocomputing, vol. 337, pp. 325–338, Apr. 2019.
L. Yao and Y. Guan, "An Improved LSTM Structure for Natural Language Processing," IEEE Xplore, Dec. 01, 2018. https://ieeexplore.ieee.org/document/8690387 (accessed Dec. 25, 2021).
M. K. Nammous and K. Saeed, "Natural Language Processing: Speaker, Language, and Gender Identification with LSTM," Advances in intelligent systems and computing, pp. 143–156, Jan. 2019.
N. Aziz, E. A. P. Akhir, I. A. Aziz, J. Jaafar, M. H. Hasan, and A. N. C. Abas, "A Study on Gradient Boosting Algorithms for Development of AI Monitoring and Prediction Systems," IEEE Xplore, Oct. 01, 2020. https://ieeexplore.ieee.org/document/9247843 (accessed Sep. 13, 2022).
Y. C. Chang, K.-H. Chang, and G.-J. Wu, "Application of eXtreme gradient boosting trees in the construction of credit risk assessment models for financial institutions," Applied Soft Computing, vol. 73, pp. 914–920, Dec. 2018.
P. Carmona, F. Climent, and A. Momparler, "Predicting failure in the U.S. banking sector: An extreme gradient boosting approach," International Review of Economics & Finance, vol. 61, pp. 304–323, May 2019.
J. S. Heo, D.-H. Kwon, J.-B. Kim, Y.-H. Han, and C.-H. An, "Prediction of Cryptocurrency Price Trend Using Gradient Boosting," KIPS Transactions on Software and Data Engineering, vol. 7, no. 10, pp. 387–396, Oct. 2018.
T. Kavzoglu and A. Teke, "Predictive Performances of Ensemble Machine Learning Algorithms in Landslide Susceptibility Mapping Using Random Forest, Extreme Gradient Boosting (XGBoost) and Natural Gradient Boosting (NGBoost)," Arabian Journal for Science and Engineering, Jan. 2022.
T. R. Noviandy, G. M. Idroes, A. Maulana, I. Hardi, E. S. Ringga, and Rinaldi Idroes, "Credit Card Fraud Detection for Contemporary Financial Management Using XGBoost-Driven Machine Learning and Data Augmentation Techniques," Indatu Journal of Management and Accounting, vol. 1, no. 1, pp. 29–35, Sep. 2023.
R. Qin, "The Construction of Corporate Financial Management Risk Model Based on XGBoost Algorithm," Journal of Mathematics, vol. 2022, pp. 1–8, Apr. 2022.
Y. Wang and Y. Guo, "Forecasting method of stock market volatility in time series data based on mixed model of ARIMA and XGBoost," China Communications, vol. 17, no. 3, pp. 205–221, Mar. 2020.
F. Alzamzami, M. Hoda, and A. E. Saddik, "Light Gradient Boosting Machine for General Sentiment Classification on Short Texts: A Comparative Evaluation," IEEE Access, vol. 8, pp. 101840–101858, 2020.
A. Shehadeh, O. Alshboul, R. E. Al Mamlook, and O. Hamedat, "Machine learning models for predicting the residual value of heavy construction equipment: An evaluation of modified decision tree, LightGBM, and XGBoost regression," Automation in Construction, vol. 129, p. 103827, Sep. 2021.
X. Sun, M. Liu, and Z. Sima, "A novel cryptocurrency price trend forecasting model based on LightGBM," Finance Research Letters, Dec. 2018.
R. Xu, Y. Chen, T. Xiao, J. Wang, and X. Wang, "Predicting the trend of stock index based on feature engineering and CatBoost model," International Journal of Financial Engineering, p. 2150027, May 2021.
L. Tian, L. Feng, L. Yang, and Y. Guo, "Stock price prediction based on LSTM and LightGBM hybrid model," The Journal of Supercomputing, Feb. 2022.
A. A. Ibrahim, R. L., M. M., R. O., and G. A., "Comparison of the CatBoost Classifier with other Machine Learning Methods," International Journal of Advanced Computer Science and Applications, vol. 11, no. 11, 2020.
L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, "CatBoost: unbiased boosting with categorical features," Neural Information Processing Systems, 2018. https://proceedings.neurips.cc/paper/2018/hash/14491b756b3a51daac41c24863285549-Abstract.html
Mousavi and H. Nikoomaram, "A comparative study of the performance of Stock trading strategies based on LGBM and CatBoost algorithms.," International Journal of Finance & Managerial Accounting, vol. 7, no. 26, pp. 63–75, Jul. 2022
R. Xu, Y. Chen, T. Xiao, J. Wang, and X. Wang, "Predicting the trend of stock index based on feature engineering and CatBoost model," International Journal of Financial Engineering, p. 2150027, May 2021.
Refbacks
- There are currently no refbacks.
ISSN: 0353-3670 (Print)
ISSN: 2217-5997 (Online)
COBISS.SR-ID 12826626