We present a method for finding high density, low-dimensional structures in noisy point clouds. These structures are sets with zero Lebesgue measure with respect to the D-dimensional ambient space and belong to a d < D-dimensional space. We call them “singular features.” Hunting for singular features corresponds to finding unexpected or unknown structures hidden in point clouds belonging to . Our method outputs well-defined sets of dimensions d < D. Unlike spectral clustering, the method works well in the presence of noise. We show how to find singular features by first finding ridges in the estimated density, followed by a filtering step based on the eigenvalues of the Hessian of the density. The code for plotting all the figures, with the corresponding plots, and the data files used in the article, are in the folder SupplementaryDocument.zip that can be find at the http://www.stat.cmu.edu/larry/singular.

Finding Singular Features / Genovese, Christopher R.; Perone Pacifico, Marco; Verdinelli, Isabella; Wasserman, Larry. - In: JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS. - ISSN 1061-8600. - 26:3(2016), pp. 598-609. [10.1080/10618600.2016.1260472]

Finding Singular Features

PERONE PACIFICO, Marco;
2016

Abstract

We present a method for finding high density, low-dimensional structures in noisy point clouds. These structures are sets with zero Lebesgue measure with respect to the D-dimensional ambient space and belong to a d < D-dimensional space. We call them “singular features.” Hunting for singular features corresponds to finding unexpected or unknown structures hidden in point clouds belonging to . Our method outputs well-defined sets of dimensions d < D. Unlike spectral clustering, the method works well in the presence of noise. We show how to find singular features by first finding ridges in the estimated density, followed by a filtering step based on the eigenvalues of the Hessian of the density. The code for plotting all the figures, with the corresponding plots, and the data files used in the article, are in the folder SupplementaryDocument.zip that can be find at the http://www.stat.cmu.edu/larry/singular.
2016
Clustering; Density estimation; Manifolds; Ridges
Finding Singular Features / Genovese, Christopher R.; Perone Pacifico, Marco; Verdinelli, Isabella; Wasserman, Larry. - In: JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS. - ISSN 1061-8600. - 26:3(2016), pp. 598-609. [10.1080/10618600.2016.1260472]
File in questo prodotto:
File Dimensione Formato  
2016_JCGSbis.pdf

Solo gestori archivio

Tipologia: Versione dell'editore
Licenza: DRM (Digital rights management) non definiti
Dimensione 1.49 MB
Formato Adobe PDF
1.49 MB Adobe PDF   Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11385/182622
Citazioni
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 2
social impact