Temporal Skeletonization on Sequential Data: Patterns, Categorization, and Visualization

Sequential pattern analysis targets on finding statistically relevant temporal structures where the values are delivered in a sequence. With the growing complexity of real-world dynamic scenarios, more and more symbols are often needed to encode a meaningful sequence. This is so-called “curse of cardinality”, which can impose significant challenges to the design of sequential analysis methods in terms of computa-tional efficiency and practical use. Indeed, given the over-whelming scale and the heterogeneous nature of the sequen-tial data, new visions and strategies are needed to face the challenges. To this end, in this paper, we propose a “tempo-ral skeletonization ” approach to proactively reduce the rep-resentation of sequences to uncover significant, hidden tem-poral structures. The key idea is to summarize the temporal correlations in an undirected graph. Then, the “skeleton ” of the graph serves as a higher granularity on which hidden temporal patterns are more likely to be identified. In the meantime, the embedding topology of the graph allows us to translate the rich temporal content into a metric space. This opens up new possibilities to explore, quantify, and visualize sequential data. Our approach has shown to greatly allevi-ate the curse of cardinality in challenging tasks of sequential pattern mining and clustering. Evaluation on a Business-to-Business (B2B) marketing application demonstrates that our approach can effectively discover critical buying paths from noisy customer event data