
Graph sketching-based Space-efficient Data Clustering
Morvan, Anne; Choromanski, Krzysztof; Gouy-Pailler, Cedric; Atif, Jamal (2018), Graph sketching-based Space-efficient Data Clustering, in Ester, Martin; Pedreschi, Dino, Proceedings of the 2018 SIAM International Conference on Data Mining, SIAM - Society for Industrial and Applied Mathematics : Philadelphia, p. 10-18. 10.1137/1.9781611975321.2
View/ Open
Type
Communication / ConférenceDate
2018Conference title
2018 SIAM International Conference on Data MiningConference date
2018-05Conference city
San DiegoConference country
United StatesBook title
Proceedings of the 2018 SIAM International Conference on Data MiningBook author
Ester, Martin; Pedreschi, DinoPublisher
SIAM - Society for Industrial and Applied Mathematics
Published in
Philadelphia
ISBN
978-1-61197-532-1
Number of pages
764Pages
10-18
Publication identifier
Metadata
Show full item recordAuthor(s)
Morvan, AnneChoromanski, Krzysztof
Gouy-Pailler, Cedric

Atif, Jamal
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Abstract (EN)
In this paper, we address the problem of recovering arbitrary-shaped data clusters from datasets while facing high space constraints, as this is for instance the case in many real-world applications when analysis algorithms are directly deployed on resources-limited mobile devices collecting the data. We present DBMSTClu a new space-efficient density-based non-parametric method working on a Minimum Spanning Tree (MST) recovered from a limited number of linear measurements i.e. a sketched version of the dissimilarity graph between the N objects to cluster. Unlike k-means, k-medians or k-medoids algorithms, it does not fail at distinguishing clusters with particular forms thanks to the property of the MST for expressing the underlying structure of a graph. No input parameter is needed contrarily to DBSCAN or the Spectral Clustering method. An approximate MST is retrieved by following the dynamic semi-streaming model in handling the dissimilarity graph as a stream of edge weight updates which is sketched in one pass over the data into a compact structure requiring O(N polylog(N)) space, far better than the theoretical memory cost O(N2) of . The recovered approximate MST as input, DBMSTClu then successfully detects the right number of nonconvex clusters by performing relevant cuts on in a time linear in N. We provide theoretical guarantees on the quality of the clustering partition and also demonstrate its advantage over the existing state-of-the-art on several datasets.Subjects / Keywords
space constraints; resources-limited mobile devices; DBMSTClu; clustering partition; Spectral Clustering method; data clusterRelated items
Showing items related by title and author.
-
Pinot, Rafael; Morvan, Anne; Yger, Florian; Gouy-Pailler, Cédric; Atif, Jamal (2018) Communication / Conférence
-
Bojarski, Mariusz; Choromanska, Anna; Choromanski, Krzysztof; Fagan, Francois; Gouy-Pailler, Cédric; Morvan, Anne; Sakr, Nourhan; Sarlos, Tamas; Atif, Jamal (2017) Communication / Conférence
-
Multi-dimensional signal approximation with sparse structured priors using split Bregman iterations Isaac, Yoann; Barthélemy, Quentin; Gouy-Pailler, Cédric; Sebag, Michèle; Atif, Jamal (2017) Article accepté pour publication ou publié
-
Pinot, Rafaël; Meunier, Laurent; Araújo, Alexandre; Kashima, Hisashi; Yger, Florian; Gouy-Pailler, Cedric; Atif, Jamal (2019) Communication / Conférence
-
Pinot, Rafaël; Yger, Florian; Gouy-Pailler, Cedric; Atif, Jamal (2019) Communication / Conférence