GAMLSS; LASSO; Distributional regression; model selection; fused LASSO
Abstract :
[en] For numerous applications, it is of interest to provide full probabilistic forecasts,
which are able to assign plausibilities to each predicted outcome. Therefore,
attention is shifting constantly from conditional mean models to probabilistic
distributional models capturing location, scale, shape and other aspects of
the response distribution. One of the most established models for distributional
regression is the generalized additive model for location, scale and shape
(GAMLSS). In high-dimensional data set-ups, classical fitting procedures for
GAMLSS often become rather unstable and methods for variable selection are
desirable. Therefore, a regularization approach for high-dimensional data set-ups in the framework of GAMLSS is proposed. It is designed for linear covariate effects and is based on L1-type penalties. The following three penalization options are provided: the conventional least absolute shrinkage and selection operator (LASSO) for metric covariates, and both group and fused LASSO for categorical predictors. The methods are investigated both for simulated data
and for two real data examples, namely Munich rent data and data on extreme
operational losses from the Italian bank UniCredit.
Disciplines :
Quantitative methods in economics & management
Author, co-author :
Groll, Andreas
Hambuckers, Julien ; Université de Liège - ULiège > HEC Liège : UER > Finance de Marché
Kneib, Thomas
Umlauf, Nicholaus
Language :
English
Title :
LASSO-Type Penalization in the Framework of Generalized Additive Models for Location, Scale and Shape
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Basel Committee on Banking Supervision (BCBS), Basel II: International convergence of capital measurement and capital standards. A revised framework., 2004, Bank of International Settlements, Basel, Switzerland.
Bondell, H.D., Reich, B.J., Simultaneous factor selection and collapsing levels in ANOVA. Biometrics 65:1 (2009), 169–177.
Chapelle, A., Crama, Y., Hübner, G., Peters, J.P., Practical methods for measuring and managing operational risk in the financial sector: A clinical study. J. Bank. Financ. 32:6 (2008), 1049–1061.
Chavez-Demoulin, V., Embrechts, P., Hofert, M., An extreme value approach for modeling operational risk losses depending on covariates. J. Risk Insur. 83:3 (2016), 735–776.
Chernobai, A., Jorion, P., Yu, F., The derminants of operational risk in U.S. financial institutions. J. Financ. Quant. Anal. 46:8 (2011), 1683–1725.
Chiquet, J., Gutierrez, P., Rigaill, G., Fast tree inference with weighted fusion penalties. J. Comput. Graph. Statist. 26:1 (2017), 205–216.
Cope, E., Piche, M., Walter, J., Macroenvironmental determinants of operational loss severity. J. Bank. Financ. 36:5 (2012), 1362–1380.
Distinguin, I., Roulet, C., Tarazi, A., Bank regulatory capital and liquidity: Evidence from US and European Publicly traded banks. J. Bank. Financ. 37:9 (2013), 3295–3317.
Embrechts, P., Klupperlberg, C., Mikosch, T., Modelling Extremal Events for Insurance and Finance. 1997, Springer - Verlag, Berlin.
Gertheiss, J., Tutz, G., Sparse modeling of categorial explanatory variables. Ann. Appl. Stat. 4:4 (2010), 2150–2180.
Gertheiss, J., Tutz, G., Regularization and model selection with categorial effect modifiers. Statist. Sinica, 2012, 957–982.
Gneiting, T., Balabdaoui, F., Raftery, A.E., Probabilistic forecasts, calibration and sharpness. J. R. Stat. Soc. Ser. B Stat. Methodol. 69:2 (2007), 243–268.
Hambuckers, J., Groll, A., Kneib, T., Understanding the economic determinants of the severity of operational losses: A regularized generalized pareto regression approach. J. Appl. Econometrics 33:6 (2018), 898–2180.
Hofner, B., Mayr, A., Schmid, M., gamboostLSS: An r package for model building and variable selection in the GAMLSS framework. J. Stat. Softw. 74:1 (2016), 1–31.
Kneib, T., Konrath, S., Fahrmeir, L., High dimensional structured additive regression models: Bayesian regularization, smoothing and predictive performance. J. R. Stat. Soc. Ser. C. Appl. Stat. 60:1 (2011), 51–70.
Mayr, A., Fenske, N., Hofner, B., Kneib, T., Schmid, M., Generalized additive models for location, scale and shape for high-dimensional data - A flexible approach based on boosting. J. R. Stat. Soc. Ser. C. Appl. Stat. 61:3 (2012), 403–427.
Meier, L., Van de Geer, S., Bühlmann, P., The group lasso for logistic regression. J. R. Stat. Soc. Ser. B Stat. Methodol. 70:1 (2008), 53–71.
Oelker, M.R., Tutz, G., A uniform framework for the combination of penalties in generalized structured models. Adv. Data Anal. Classif. 11:1 (2017), 97–120.
Povel, P., Singh, R., Winton, A., Booms, busts, and fraud. Rev. Financ. Stud. 20:4 (2007), 1219–1254.
R Core Team, R: A Language and Environment for Statistical Computing. 2018, R Foundation for Statistical Computing, Vienna, Austria ISBN 3-900051-07-0 https://www.R-project.org/.
Rigby, R.A., Stasinopoulos, D.M., Generalized additive models for location, scale and shape. J. R. Stat. Soc. C (Appl. Stat.) 54:3 (2005), 507–554.
Akaike Information Criterion Statistics. 1986, D. Reidel Publishing Company.
Schwarz, G., Estimating the dimension of a model. Ann. Statist. 6:2 (1978), 461–464, 10.1214/aos/1176344136.
Stasinopoulos, D.M., Rigby, R.A., Generalized additive models for location scale and shape (gamlss) in r. J. Stat. Softw. 23:7 (2007), 1–46.
Thomas, J., Mayr, A., Bischl, B., Schmid, M., Smith, A., Hofner, B., Gradient boosting for distributional regression: Faster tuning and improved variable selection via noncyclical updates. Stat. Comput. 28:3 (2018), 673–687.
Tibshirani, R., Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B Stat. Methodol. 58:1 (1996), 267–288.
Umlauf, N., Klein, N., Zeileis, A., BAMLSS: Bayesian additive models for location, scale and shape (and beyond). J. Comput. Graph. Statist. 27:3 (2018), 612–627.
Umlauf, N., Klein, N., Zeileis, A., Köhler, M., Simon, T., bamlss: Bayesian additive models for location scale and shape (and beyond). 2018 R package version 1.0-1 http://CRAN.R-project.org/package=bamlss.
Valencia, F., Bank capital and uncertainty. J. Bank. Financ. 69:S1 (2016), S1–S9.
Yuan, M., Lin, Y., Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. Ser. B Stat. Methodol. 68:1 (2006), 49–67.
Zou, H., Hastie, T., Tibshirani, R., On the ‘degrees of freedom’ of the lasso. Ann. Statist. 35:5 (2007), 2173–2192.
Zou, H., Li, R., One-step sparse estimates in nonconcave penalized likelihood models. Ann. Statist. 36:4 (2008), 1509–1533.
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.
