Which analytic methods for Big Data? - Cnam - Conservatoire national des arts et métiers Access content directly
Conference Papers Year :

Which analytic methods for Big Data?

Abstract

Classical inference is not fitted for massive data: statistical tests reject any reasonable model, confidence intervals are reduced to nothing . Model validation should be done through cross validation or split sampling. Explicit, parcimonious generative models are replaced by predictive algorithms. Model choice is driven by statistical learning theory and not by penalized likelihood. The analyst’s toolbox includes revisited classical data analysis techniques (PCA, MCA as particular cases of SVD, clustering) mainly for exploratory purposes as well as machine learning methods (SVM, boosting, ensemble learning) for prediction. In the case of high dimensional data where the number of variables exceeds the number of units, sparse methods based on L1 regularization provide elegant and simple solutions; we will present a sparse generalization of multiple correspondence analysis. Is the data deluge making the scientific method obsolete, as C.Anderson claimed some years ago? We will conclude by some comments on correlation and causality.
ARS15_saporta.pdf (1003.42 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03953110 , version 1 (03-03-2023)

Identifiers

  • HAL Id : hal-03953110 , version 1

Cite

Gilbert Saporta. Which analytic methods for Big Data?. ARS'15. Fifth International Workshop on Social Network Analysis, Università degli Studi di Salerno, Apr 2015, Capri, Italy. ⟨hal-03953110⟩
3 View
1 Download

Share

Gmail Facebook Twitter LinkedIn More