Abstract:There is an increasing demand for scalable algorithms capable of clustering and analyzing large time series datasets. The Kohonen self-organizing map (SOM) is a type of unsupervised artificial neural network for visualizing and clustering complex data, reducing the dimensionality of data, and selecting influential features. Like all clustering methods, the SOM requires a measure of similarity between input data (in this work time series). Dynamic time warping (DTW) is one such measure, and a top performer given that it accommodates the distortions when aligning time series. Despite its use in clustering, DTW is limited in practice because it is quadratic in runtime complexity with the length of the time series data. To address this, we present a new DTW-based clustering method, called SOMTimeS (a Self-Organizing Map for TIME Series), that scales better and runs faster than other DTW-based clustering algorithms, and has similar performance accuracy. The computational performance of SOMTimeS stems from its ability to prune unnecessary DTW computations during the SOM's training phase. We also implemented a similar pruning strategy for K-means for comparison with one of the top performing clustering algorithms. We evaluated the pruning effectiveness, accuracy, execution time and scalability on 112 benchmark time series datasets from the University of California, Riverside classification archive. We showed that for similar accuracy, the speed-up achieved for SOMTimeS and K-means was 1.8x on average; however, rates varied between 1x and 18x depending on the dataset. SOMTimeS and K-means pruned 43% and 50% of the total DTW computations, respectively. We applied SOMtimeS to natural language conversation data collected as part of a large healthcare cohort study of patient-clinician serious illness conversations to demonstrate the algorithm's utility with complex, temporally sequenced phenomena.

The Effect of Sample Size on the Extended Self-Organizing Map Network—a Market Segmentation Application

A Method of Data Mining Based on SOM Clustering and Its Application

SMLSOM: The shrinking maximum likelihood self-organizing map

A New Adaptive Self-Organizing Map.

Application of self-organizing maps to the stock exchange data analysis

How to use the Kohonen algorithm to simultaneously analyse individuals in a survey

Learning a Self-Expressive Network for Subspace Clustering

SOMTimeS: Self Organizing Maps for Time Series Clustering and its Application to Serious Illness Conversations

Self-Organizing map clustering analysis for molecular data

Non-Euclidean Self-Organizing Maps

Multidimensional Urban Segregation - Toward A Neural Network Measure

Self-Organizing Maps for Exploration of Partially Observed Data and Imputation of Missing Values

Research on Intrusion Detection Based on an Improved SOM Neural Network

Group Analysis of Self-organizing Maps based on Functional MRI using Restricted Frechet Means

Discovering New Analytical Methods For Large Volume Medical And Online Data Processing

Multi-Dimensional Traffic Flow Time Series Analysis with Self-Organizing Maps

Improving Self-Organizing Maps with Unsupervised Feature Extraction

Self-organizing Map As a New Method for Clustering and Data Analysis

Adaptive Subspace Sampling for Class Imbalance Processing-Some clarifications, algorithm, and further investigation including applications to Brain Computer Interface

Mammary blood flow and glucose uptake in lactating cows given dexamethasone.

Intra-Atlas Node Size Effects on Graph Metrics in fMRI Data: Implications for Alzheimer's Disease and Cognitive Impairment