THE STUDY OF OBJECTS CLUSTERING ALGORITHMS BASED ON SELF-ORGANIZING KOHONEN CARDS USING METHODS OF EXTRACTING FACTORS

Egor Markushin, Guzel Shkaberina, Natalya Rezova, Aleksey Popov, Lev Kazakovtsev

DOI Number
https://doi.org/10.22190/FUMI240616041M
First page
563
Last page
596

Abstract


We proposed algorithms for objects clustering based on self-organizing Kohonen maps using various methods of extracting factors (factor analysis: Principal Component Analysis, Maximum Likelihood Estimation, Principal Component Analysis based on Singular Value Decomposition). We performed experiments with different distance measures (Mahalanobis, Euclidean, squared Euclidean, Manhattan), various ways of neuron weights initialization (random, with choice of weight coefficients from a dataset). The computational experiments showed that the use methods of extracting factors in the SOM algorithm improves the accuracy of clustering in most cases. Moreover, clustering accuracy decreases with increasing number of homogeneous batches in a mixed lot.

Keywords

self-organizing Maps, factor analysis, clustering algorithms

Full Text:

PDF

References


H. Allende, C. Moraga and R. Salas: Robust estimator for the learning process in neural networks applied in time series. ICANN, LNCS. 2415 (2002), 1080–1086.

H. Allende, S. Moreno, C. Rogel, and R. Salas: Robust Self-organizing Maps. In: Progress in Pattern Recognition, Image Analysis and Applications, CIARP 2004, Lecture Notes in Computer Science (A. Sanfeliu, J.F. Martinez Trinidad, J.A. Carrasco

Ochoa, eds.), Springer, Berlin, Heidelberg, 2004, 3287.

H. Bauer, K. Pawelzik and G. Theo: A Topographic Product for the Optimization of Self-Organizing Feature Maps. Neural Information Processing Systems. 4 (1991), 1140–1147.

M. N. Belousova and V. A. Belousov: Cluster analysis of the investment attractiveness of enterprises. Financial analytics: problems and solutions. 10(2) (2017), 181–191.

D. Brugger, M. Bogdan and W. Rosenstiel: Automatic cluster detection in Kohonen’s SOM. IEEE Trans Neural Netw. 92 (1981), 161–172.

G. Cabanes and Y. Bennani: Unsupervised Topographic Learning for Spatiotemporal Data Mining. Advances in Artificial Intelligence. 832542 (2010), 1–12.

E. Coz, B. Art´ı˜nano, A. L. Robinson, G. S. Casuccio, T. L. Lersch and S. N. Pandis: Individual Particle Morphology and Acidity. Aerosol Science and Technology. 42(3) (2008), 224–232.

D. L. Davies and D. W. Bouldin: A Cluster Separation Measure. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1(2) (1979), 224–227.

S. C. Dinger, M. A. Van Wyk and S. Carmona: Clustering gene expression data using a diffraction-inspired framework. BioMed Eng OnLine. 11 (2012), 85.

J. C. Dunn: A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters. Journal of Cybernetics. 3 (1973), 32–57.

B. Fritzke: A Growing Neural Gas Network Learns Topologies. Neural Information Processing Systems. 7 (1994), 625–632.

B. Fritzke: Growing cell structures—a self-organizing network for unsupervised and supervised learning. Neural networks. 7(9) (1994), 1441–1460.

H. Harman: Modern factor analysis. The university of Chicago press, Chicago, 1967.

https://github.com/milaan9/Clustering-Datasets (last access: 14.06.2024).

S. Kaski, T. Honkela, K. Lagus and T. Kohonen: WEBSOM – Self-organizing maps of document collections. Neurocomputing. 21(1-3) (1998), 101–117.

S. Kaski and K. Lagus: Comparing self-organizing maps. In: Partificial Neural Networks — ICANN 1996. Lecture Notes in Computer Science (C. von der Malsburg, W. von Seelen, J.C. Vorbr¨uggen, B. Sendhoff, eds.), Springer, Berlin, Heidelberg, 1996, 1112.

K. Kiviluoto: Topology preservation in self-organizing maps. In: Proceedings of International Conference on Neural Networks (ICNN’96),Washington, DC, USA, 1996, 294–299.

T. Kohonen: Self-Organizing Maps. Springer-Verlag Berlin Heidelberg, Berlin, 2001.

D. Lawley and A. Maxwell: Factor analysis as a statistical method. Butterworths, London, 1963.

E. L´opez-Rubio, EJ. Palomo and E. Dom´ınguez: Bregman divergences for growing hierarchical self-organizing networks. Int J Neural Sys. 24(4) (2014), 1450016.

S. S. Makhrov: Neural network clustering of wireless sensor network nodes. T-Comm. 6 (2014).

E. Merenyi, B. Csatho and K. Tasdemir: Knowledge discovery in urban environments from fused multi-dimensional imagery. Urban Remote Sensing Joint Event, Paris, France, 2007, 1–13.

W. Messner: Advancing our understanding of cultural heterogeneity with unsupervised machine learning. Journal of International Management. 28(2) (2022), 100885.

A. M. Newman and J. B. Cooper: AutoSOME: a clustering method for identifying gene expression modules without prior knowledge of cluster number. BMC Bioinformatics. 11 (2010), 117.

W. Pearson: LIII. On lines and planes of closest fit to systems of points in space. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science. 2(11) (1901), 559—572.

A. C. Pehlivanli, O. K. Ersoy and T. Ibrikci: Drug/nondrug classification with consensual Self-Organising Map and Self-Organising Global Ranking algorithms. International Journal of Computational Biology and Drug Design (IJCBDD). 1 (2008), 4.

P. J. Rousseeuw: Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. BMC Bioinformatics. 20 (1987), 53–65.

P. J. Saheb-Al-Zamani at ai.: Limited regeneration in long acellular nerve allografts is associated with increased Schwann cell senescence. Experimental Neurology. 247 (2013), 165–177.

G. Shkaberina, N. Rezova, E. Tovbis and L. Kazakovtsev: Visual Assessment of Cluster Tendency with Variations of Distance Measures. Algorithms. 16 (2023), 5.

P. E. Sokolov: The use of Kohonen maps to assess the radioactivity of building materials. Bulletin of Science and Education of the North-West of Russia. 1 (2017).

K. Tasdemir and E. Merenyi: A Validity Index for Prototype-Based Clustering of Data Sets With Complex Cluster Structures. IEEE Trans Syst Man Cybern B Cybern. 41(4) (2011), 1039–53.

J. Tian, M. N. Azarian and M. Pecht: Anomaly Detection Using Self-Organizing Maps-Based K-Nearest Neighbor Algorithm. Proceedings of the European Conference of the PHM Society. 2(1) (2014).

K. Uberla: Factorenanalyse. Springer-Verlag, Berlin, 1977.

J. Vesanto and E. Alhoniemi: Clustering of the self-organizing map. IEEE Transactions on Neural Networks. 11(3) (2023), 586–600.

J. Vesanto and M. Sulkava: Distance Matrix Based Clustering of the Self- Organizing Map. In: Artificial Neural Networks — ICANN 2002, Lecture Notes in Computer Science (J.R. Dorronsoro, eds.), Springer, Berlin, Heidelberg, 2022, 2415.

T. Villmann, R. Der, M. Herrmann and T. M. Martinetz: Topology preservation in self-organizing feature maps: exact definition and measurement. IEEE Trans Neural Netw. 8(2) (2023), 256–266.

S. Wu and T. W. S. Chow: Clustering of the self-organizing map using a clastering validity index based on inter-cluster and intra cluster density. Pattern Recognition. 37 (2004), 175–188.

A. V. Zelensky and A. V. Zelensky: Modeling of the training process in biathlon using artificial intelligence. Scientific notes of Lesgaft University. 2(144) (2007).




DOI: https://doi.org/10.22190/FUMI240616041M

Refbacks

  • There are currently no refbacks.




© University of Niš | Created on November, 2013
ISSN 0352-9665 (Print)
ISSN 2406-047X (Online)