Evaluation of Penalized Estimation Methods for Big Data Analysis

Authors

  • Md. Siddikur Rahman Department of Statistics, Begum Rokeya University, Rangpur, Bangladesh
  • Md. Mujibur Rahman Department of Statistics, Jahangirnagar University, Dhaka, Bangladesh
  • M. A. Matin Department of Statistics, Jahangirnagar University, Dhaka, Bangladesh

DOI:

https://doi.org/10.37591/(rrjobi).v2i2.385

Abstract

In this paper we described the sparse Laplacian shrinkage (SLS) method which is a penalized method for variable selection and estimation in big data analysis that uses a combination of the minimax concave penalty (MCP) and Laplacian quadratic as the penalty. The SLS uses the MCP to promote sparsity and Laplacian quadratic penalty to encourage smoothness among coefficients associated with the correlated predictors. An important advantage of the MCP over the        penalty is that it leads to estimators that are nearly unbiased and achieve selection consistency under weaker conditions. In some problems such as genomic data analysis, partial external information may also be available on the graphical structure of some genes used as predictors in the model. It would be interesting to consider approaches for combining external information on the graphical structure with existing data in constructing the Laplacian quadratic penalty. We discussed a comparative study with ridge regression (Ridge), Lasso, MCP and SLS estimator. For different sample and variable size, our simulation studies demonstrate that SLS estimator is the best estimator.

                                   

Keywords: Big data, minimax concave penalty (MCP), sparse Laplacian shrinkage (SLS) estimator

Cite this Article

Rahman MS, Rahman MM, Matin MA. Evaluation of Penalized Estimation Methods for Big Data Analysis. Research & Reviews: A Journal of Bioinformatics. 2015; 2(2): 49–55p.

Downloads

Published

2019-03-18

Issue

Vol. 2 No. 2 (2015)

Section

Review Article

License

Declaration and Copyright Transfer Form

(to be completed by authors)

I/ We, the undersigned author(s) of the submitted manuscript, hereby declare, that the above manuscript which is submitted for publication in the STM Journals(s), is not published already in part or whole (except in the form of abstract) in any journal or magazine for private or public circulation, and, is not under consideration of publication elsewhere.

  • I/We will not withdraw the manuscript after 1 week of submission as I have read the Author Guidelines and will adhere to the guidelines.
  • I/We Author(s ) have niether given nor will give this manuscript elsewhere for publishing after submitting in STM Journal(s).
  • I/ We have read the original version of the manuscript and am/ are responsible for the thought contents embodied in it. The work dealt in the manuscript is my/ our own, and my/ our individual contribution to this work is significant enough to qualify for authorship.
  •  I/We also agree to the authorship of the article in the following order:

Author’s name                                    

 

1. ________________

2. ________________

3. ________________

4. ________________

 

We  Author(s) tick this box and would request you to consider it as our signature as we agree to the terms of this Copyright Notice, which will apply to this submission if and when it is published by this journal.