Challenges of big data analysis

Jianqing Fan Fang Han Han Liu

Data Analysis mathscidoc:1912.43251

National science review, 1, (2), 293-314, 2014.6
Big Data bring new opportunities to modern society and challenges to data scientists. On the one hand, Big Data hold great promises for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. On the other hand, the massive sample size and high dimensionality of Big Data introduce unique computational and statistical challenges, including scalability and storage bottleneck, noise accumulation, spurious correlation, incidental endogeneity and measurement errors. These challenges are distinguished and require new computational and statistical paradigm. This paper gives overviews on the salient features of Big Data and how these features impact on paradigm change on statistical and computational methods as well as computing architectures. We also provide various new perspectives on the Big Data analysis and computation. In particular, we emphasize on
No keywords uploaded!
[ Download ] [ 2019-12-21 11:32:21 uploaded by Jianqing_Fan ] [ 947 downloads ] [ 0 comments ]
  title={Challenges of big data analysis},
  author={Jianqing Fan, Fang Han, and Han Liu},
  booktitle={National science review},
Jianqing Fan, Fang Han, and Han Liu. Challenges of big data analysis. 2014. Vol. 1. In National science review. pp.293-314.
Please log in for comment!
Contact us: | Copyright Reserved