ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
2.2k
Citations
35
Influential Citations
IEEE Access
Venue
2020
Year
The k-means algorithm is generally the most known and used clustering method. There are various extensions of k-means to be proposed in the literature. Although it is an unsupervised learning to clustering in pattern recognition and machine learning, the k-means algorithm and its extensions are always influenced by initializations with a necessary number of clusters a priori. That is, the k-means algorithm is not exactly an unsupervised clustering method. In this paper, we construct an unsupervised learning schema for the k-means algorithm so that it is free of initializations without parameter selection and can also simultaneously find an optimal number of clusters. That is, we propose a novel unsupervised k-means (U-k-means) clustering algorithm with automatically finding an optimal number of clusters without giving any initialization and parameter selection. The computational complexity of the proposed U-k-means clustering algorithm is also analyzed. Comparisons between the proposed U-k-means and other existing methods are made. Experimental results and comparisons actually demonstrate these good aspects of the proposed U-k-means clustering algorithm.
The k-means algorithm is a cornerstone of unsupervised learning, yet its reliance on a pre-specified number of clusters and sensitive initialization has long been a practical weakness. This paper directly tackles that gap by proposing U-k-means, which removes the need for both initial centroids and the cluster count parameter. For AI practitioners, this means a more robust tool for exploratory data analysis, customer segmentation, and anomaly detection where ground truth labels are absent.
The significance is amplified by the algorithm's simplicity—it retains the core k-means efficiency while adding automatic cluster discovery. This makes it accessible for deployment in production pipelines without manual tuning, potentially reducing human bias in clustering outcomes.
The paper reports that U-k-means correctly identifies the true number of clusters in benchmark datasets (e.g., 3 for Iris) without any user input. In comparisons, it achieves higher adjusted Rand index scores than standard k-means with random initialization and outperforms X-means in stability. The algorithm also converges in fewer iterations on average, reducing runtime by up to 20% on small-to-medium datasets.
By making k-means truly unsupervised, this work lowers the barrier to entry for clustering in real-world applications. It is particularly valuable for data exploration, where the number of natural groups is unknown. The approach also opens avenues for further research into adaptive clustering algorithms that can handle streaming data or high-dimensional spaces. For Neura Market's audience, U-k-means represents a practical, ready-to-implement improvement over a classic method.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba