Clustering processes

Daniil Ryabko 1
1 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
Abstract : The problem of clustering is considered, for the case when each data point is a sample generated by a stationary ergodic process. We propose a very natural asymptotic notion of consistency, and show that simple consistent algorithms exist, under most general non-parametric assumptions. The notion of consistency is as follows: two samples should be put into the same cluster if and only if they were generated by the same distribution. With this notion of consistency, clustering generalizes such classical statistical problems as homogeneity testing and process classification. We show that, for the case of a known number of clusters, consistency can be achieved under the only assumption that the joint distribution of the data is stationary ergodic (no parametric or Markovian assumptions, no assumptions of independence, neither between nor within the samples). If the number of clusters is unknown, consistency can be achieved under appropriate assumptions on the mixing rates of the processes. (again, no parametric or independence assumptions). In both cases we give examples of simple (at most quadratic in each argument) algorithms which are consistent.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.inria.fr/inria-00477238
Contributor : Daniil Ryabko <>
Submitted on : Tuesday, May 4, 2010 - 4:08:18 PM
Last modification on : Thursday, February 21, 2019 - 10:52:49 AM
Long-term archiving on: Thursday, September 30, 2010 - 4:21:21 PM

Files

clust_hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00477238, version 2
  • ARXIV : 1005.0826

Collections

Citation

Daniil Ryabko. Clustering processes. 27th International Conference on Machine Learning, Jun 2010, Haifa, Israel. pp.919-926. ⟨inria-00477238v2⟩

Share

Metrics

Record views

302

Files downloads

315