Optimization Inspired by the Organization of Interiors Applied to Cluster Analysis

Alfredo Silveira Araújo Neto

doi:10.22456/2175-2745.125288

Authors

Alfredo Silveira Araújo Neto Techway Informática Ltda. http://orcid.org/0000-0002-5217-0090

DOI:

https://doi.org/10.22456/2175-2745.125288

Keywords:

Evolutive Computing, Metaheuristics, Combinatorial Optimization, Pattern Recognition

Abstract

Cluster analysis consists of a procedure capable of establishing, based on a similarity measure, the classification of a collection of objects into disjoint subsets of elements, so that the items included in a group or subset are more similar to each other than objects added to a distinct group. For represent an operation capable of being interpreted as a combinatorial optimization problem, which has as a criterion function to minimize the squared error associated with the established subdivision of items, it observe that the application of approximation algorithms to its resolution has been frequently performed. In this circumstance, this study proposes the use of a metaheuristic inspired by the composition and decoration of internal environments to cluster analysis, and compares the results obtained by this method with the responses achieved by five other classification techniques. Particulary, a non-parametric statistical evaluation, which compared the subdivisions determined by the method suggested with the subsets established by the K-means clustering algorithm and by meta-heuristics inspired by biological behaviors and physical phenomena, indicated that the proposed strategy it obtned groupings equivalent or more congruent than those determined by the other partitioning methods.

Downloads

Download data is not yet available.

References

BENABDELLAH, A. C.; BENGHABRIT, A.; BOUHADDOU, I. A survey of clustering algorithms for an industrial context. Procedia Computer Science, Amsterdam, v. 148, p. 291–302, oct. 2019.

JAIN, A. K.; DUBES, R. C. Algorithms for Clustering Data. New Jersey: Prentice Hall, 1998.

EVERITT, B. S. et al. Cluster Analysis. London: John Wiley & Sons, Ltd, 2011.

HAN, J.; KAMBER, M. Data Mining: Concepts and Techniques. San Francisco: Morgan Kaufmann Publishers, 2015.

WIERZCHON, S. T.; KLOPOTEK, M. A. Algorithms of Cluster Analysis. Warsaw: Institute of Computer Science, Polish Academy of Sciences, 2015.

JAIN, A. K.; MURTY, M. N.; FLYNN, P. Data clustering: A review. ACM Computing Surveys, New York, v. 31, n. 3, p. 264–323, sep. 1999.

MAO, J.; JAIN, A. A self-organizing network for hyperellipsoidal clustering (hec). IEEE Transactions on Neural Networks, New York, v. 7, n. 1, p. 16–29, jan. 1996.

HANSEN, P.; JAUMARD, B. Cluster analysis and mathematical programming. Mathematical Programming, Heidelberg, v. 79, p. 191–215, oct. 1997.

XU, R.; WUNSCH, D. C. Clustering. Piscataway, New Jersey: IEEE Press, 2009.

ALOISE, D. et al. Np-hardness of euclidian sum-of-squares clustering. Machine Learning, Boston, v. 75, n. 2, p. 245–248, jan. 2009.

GASS, S. I.; HARRIS, C. M. Encyclopedia of Operations Research and Management Science. New York: Springer, 2013.

MAULIK, U.; BANDYOPADHYAY, S. Genetic algorithm-based clustering technique. Pattern Recognition, Oxford, v. 33, n. 9, p. 1455–1465, sep. 2000.

ABOUBI, Y.; DRIAS, H.; KAMEL, N. Bat-clara: Bat-inspired algorithm for clustering large applications. IFAC-PapersOnLine, Kidlington, v. 49, n. 12, p. 243–248, jun. 2016.

INKAYA, T.; KAYALIGIL, S.; OZDEMIREL, N. E. Ant colony optimization based clustering methodology. Applied Soft Computing, Amsterdam, v. 28, p. 301–311, mar. 2015.

KARABOGA, D.; OZTURK, C. A novel clustering approach: Artificial bee colony (abc) algorithm. Applied Soft Computing, Amsterdam, v. 11, n. 1, p. 652–657, jan. 2011.

CURA, T. A particle swarm optimization approach to clustering. Expert Systems with Applications, Amsterdam, v. 39, n. 1, p. 1582–1588, jan. 2012.

ISIMETO, R. et al. An enhanced clustering analysis based on glowworm swarm optimization. In: 2017 IEEE 4th International Conference on Soft Computing Machine Intelligence (ISCMI). New York: IEEE, 2017. p. 42–49.

KAUR, A.; KUMAR, Y. A new metaheuristic algorithm based on water wave optimization for data clustering. Evolutionary Intelligence, Berlin, v. 15, p. 759–783, mar. 2021.

SELIM, S. Z.; ALSULTAN, K. A simulated annealing algorithm for the clustering problem. Pattern Recognition, Amsterdam, v. 24, n. 10, p. 1003–1008, oct. 1991.

HATAMLOU, A. Black hole: A new heuristic optimization approach for data clustering. Information Sciences, Amsterdam, v. 222, p. 175–184, feb. 2013.

GANDOMI, A. H. Interior search algorithm (isa): A novel approach for global optimization. ISA Transactions, New York, v. 53, n. 4, p. 1168–1183, jul. 2014.

YILDIZ, B. S. Natural frequency optimization of vehicle components using the interior search algorithm. Materials Testing, Berlin, v. 59, n. 5, p. 456–458, may 2017.

TALATAHARI, S.; AZIZI, M. Optimum design of building structures using tribe-interior search algorithm. Structures, Oxford, v. 28, p. 1616–1633, dec. 2020.

EL-HAY, E.; EL-HAMEED, M.; EL-FERGANY, A. Optimized parameters of sofc for steady state and transient simulations using interior search algorithm. Energy, Oxford, v. 166, p. 451–461, jan. 2019.

KLER, D.; RANA, K. P. S.; KUMAR, V. Parameter extraction of fuel cells using hybrid interior search algorithm. International Journal of Energy Research, New York, v. 43, n. 7, p. 2854–2880, jun. 2019.

KARTHIK, N.; PARVATHY, A. K.; ARUL, R. Multi-objective economic emission dispatch using interior search algorithm. International Transactions on Electrical Energy Systems, Chichester, v. 29, n. 1, p. e2683, jan. 2019.

MORAVEJ, M.; AMANI, P.; HOSSEINI-MOGHARI, S.-M. Groundwater level simulation and forecasting using interior search algorithm-least square support vector regression (isa–lssvr). Groundwater for Sustainable Development, Amsterdam, v. 11, p. 100447, oct. 2020.

GANDOMI, A. H. et al. Coupled eagle strategy and differential evolution for unconstrained and constrained global optimization. Computers & Mathematics with Applications, Oxford, v. 63, n. 1, p. 191–200, jan. 2012.

KENNEDY, J.; EBERHART, R. Particle swarm optimization. In: Proceedings of ICNN’95 - International Conference on Neural Networks. New York: IEEE, 1995. v. 4, p. 1942–1948.

FRÄNTI, P.; SIERANOJA, S. K-means properties on six clustering benchmark datasets. Applied Intelligence, Dordrecht, v. 48, n. 12, p. 4743–4759, jul. 2018. Disponível em: ⟨http://cs.uef.fi/sipu/datasets/⟩. Acesso em: 12 abril 2023.

DUA, D.; GRAFF, C. UCI Machine Learning Repository. 2017. Disponível em: ⟨http://archive.ics.uci.edu/ml⟩. Acesso em: 12 abril 2023.

XIE, H. et al. Improving k-means clustering with enhanced firefly algorithms. Applied Soft Computing, Amsterdam, v. 84, p. 1–22, nov. 2019.

ZHU, W. et al. Clustering algorithm based on fuzzy c-means and artificial fish swarm. Procedia Engineering, Amsterdam, v. 29, p. 3307–3311, dec. 2012.

SHAPIRO, S. S.; WILK, M. B. An analysis of variance test for normality (complete samples). Biometrika, Oxford, v. 52, n. 3–4, p. 591–611, dec. 1965.

TEAM, R. C. R: A Language and Environment for Statistical Computing. Vienna, Austria, 2020. Disponível em: ⟨https://www.R-project.org/⟩. Acesso em: 12 abril 2023.

FRIEDMAN, M. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association, New York, v. 32, n. 200, p. 675–701, dec. 1937.

NEMENYI, P. Distribution-free multiple comparisons. 1963. Thesis (Ph.D.) - Department of Mathematics, Princeton University, Princeton, p. 254, 1963.

CUI, X.; POTOK, T. E.; PALATHINGAL, P. Document clustering using particle swarm optimization. In: Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005. New York: IEEE, 2005. p. 185–191.

ZOU, W. et al. A clustering approach using cooperative artificial bee colony algorithm. Discrete Dynamics in Nature and Society, Amsterdam, v. 2010, n. 2, p. 1–17, nov. 2010.

MACQUEEN, J. Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics. Berkeley, California: University of California Press, 1967. p. 281–297.

COHEN, J. Statistical power analysis for the behavioural sciences. New York: Academic Press, 1988.