Cargando…

Modified Liu estimators in the linear regression model: An application to Tobacco data

BACKGROUND: The problem of multicollinearity in multiple linear regression models arises when the predictor variables are correlated among each other. The variance of the ordinary least squared estimator become unstable in such situation. In order to mitigate the problem of multicollinearity, Liu re...

Descripción completa

Detalles Bibliográficos
Autores principales: Babar, Iqra, Ayed, Hamdi, Chand, Sohail, Suhail, Muhammad, Khan, Yousaf Ali, Marzouki, Riadh
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8608338/
https://www.ncbi.nlm.nih.gov/pubmed/34807916
http://dx.doi.org/10.1371/journal.pone.0259991
_version_ 1784602730781736960
author Babar, Iqra
Ayed, Hamdi
Chand, Sohail
Suhail, Muhammad
Khan, Yousaf Ali
Marzouki, Riadh
author_facet Babar, Iqra
Ayed, Hamdi
Chand, Sohail
Suhail, Muhammad
Khan, Yousaf Ali
Marzouki, Riadh
author_sort Babar, Iqra
collection PubMed
description BACKGROUND: The problem of multicollinearity in multiple linear regression models arises when the predictor variables are correlated among each other. The variance of the ordinary least squared estimator become unstable in such situation. In order to mitigate the problem of multicollinearity, Liu regression is widely used as a biased method of estimation with shrinkage parameter ‘d’. The optimal value of shrinkage parameter plays a vital role in bias-variance trade-off. LIMITATION: Several estimators are available in literature for the estimation of shrinkage parameter. But the existing estimators do not perform well in terms of smaller mean squared error when the problem of multicollinearity is high or severe. METHODOLOGY: In this paper, some new estimators for the shrinkage parameter are proposed. The proposed estimators are the class of estimators that are based on quantile of the regression coefficients. The performance of the new estimators is compared with the existing estimators through Monte Carlo simulation. Mean squared error and mean absolute error is considered as evaluation criteria of the estimators. Tobacco dataset is used as an application to illustrate the benefits of the new estimators and support the simulation results. FINDINGS: The new estimators outperform the existing estimators in most of the considered scenarios including high and severe cases of multicollinearity. 95% mean prediction interval of all the estimators is also computed for the Tobacco data. The new estimators give the best mean prediction interval among all other estimators. THE IMPLICATIONS OF THE FINDINGS: We recommend the use of new estimators to practitioners when the problem of high to severe multicollinearity exists among the predictor variables.
format Online
Article
Text
id pubmed-8608338
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-86083382021-11-23 Modified Liu estimators in the linear regression model: An application to Tobacco data Babar, Iqra Ayed, Hamdi Chand, Sohail Suhail, Muhammad Khan, Yousaf Ali Marzouki, Riadh PLoS One Research Article BACKGROUND: The problem of multicollinearity in multiple linear regression models arises when the predictor variables are correlated among each other. The variance of the ordinary least squared estimator become unstable in such situation. In order to mitigate the problem of multicollinearity, Liu regression is widely used as a biased method of estimation with shrinkage parameter ‘d’. The optimal value of shrinkage parameter plays a vital role in bias-variance trade-off. LIMITATION: Several estimators are available in literature for the estimation of shrinkage parameter. But the existing estimators do not perform well in terms of smaller mean squared error when the problem of multicollinearity is high or severe. METHODOLOGY: In this paper, some new estimators for the shrinkage parameter are proposed. The proposed estimators are the class of estimators that are based on quantile of the regression coefficients. The performance of the new estimators is compared with the existing estimators through Monte Carlo simulation. Mean squared error and mean absolute error is considered as evaluation criteria of the estimators. Tobacco dataset is used as an application to illustrate the benefits of the new estimators and support the simulation results. FINDINGS: The new estimators outperform the existing estimators in most of the considered scenarios including high and severe cases of multicollinearity. 95% mean prediction interval of all the estimators is also computed for the Tobacco data. The new estimators give the best mean prediction interval among all other estimators. THE IMPLICATIONS OF THE FINDINGS: We recommend the use of new estimators to practitioners when the problem of high to severe multicollinearity exists among the predictor variables. Public Library of Science 2021-11-22 /pmc/articles/PMC8608338/ /pubmed/34807916 http://dx.doi.org/10.1371/journal.pone.0259991 Text en © 2021 Babar et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Babar, Iqra
Ayed, Hamdi
Chand, Sohail
Suhail, Muhammad
Khan, Yousaf Ali
Marzouki, Riadh
Modified Liu estimators in the linear regression model: An application to Tobacco data
title Modified Liu estimators in the linear regression model: An application to Tobacco data
title_full Modified Liu estimators in the linear regression model: An application to Tobacco data
title_fullStr Modified Liu estimators in the linear regression model: An application to Tobacco data
title_full_unstemmed Modified Liu estimators in the linear regression model: An application to Tobacco data
title_short Modified Liu estimators in the linear regression model: An application to Tobacco data
title_sort modified liu estimators in the linear regression model: an application to tobacco data
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8608338/
https://www.ncbi.nlm.nih.gov/pubmed/34807916
http://dx.doi.org/10.1371/journal.pone.0259991
work_keys_str_mv AT babariqra modifiedliuestimatorsinthelinearregressionmodelanapplicationtotobaccodata
AT ayedhamdi modifiedliuestimatorsinthelinearregressionmodelanapplicationtotobaccodata
AT chandsohail modifiedliuestimatorsinthelinearregressionmodelanapplicationtotobaccodata
AT suhailmuhammad modifiedliuestimatorsinthelinearregressionmodelanapplicationtotobaccodata
AT khanyousafali modifiedliuestimatorsinthelinearregressionmodelanapplicationtotobaccodata
AT marzoukiriadh modifiedliuestimatorsinthelinearregressionmodelanapplicationtotobaccodata