Dissertation > Excellent graduate degree dissertation topics show

Likelihood adaptive penalty variable selection method

Author: LiTengFei
Tutor: YingZhiLiang
School: Fudan University
Course: Probability Theory and Mathematical Statistics
Keywords: variable selection penalized likelihood asymptotic stability oracle prop-erty LAMP NAIP shape effect reduction retrospective sampling
CLC: O212.1
Type: PhD thesis
Year: 2012
Downloads: 176
Quote: 0
Read: Download Dissertation

Abstract


The penalized likelihood approach is a widely used statistical method in variable selection. Generally, with a convex penalty which often has an algorithm quick and stable enough, the parsimony in the estimates can’t be easily gained, and the oracle property can’t be achieved:only (suppose not coordinate adaptive) with a nonconvex penalty can we achieve the oracle property, but when the concavity is too large a converging algorithm needs to be constructed and there is often a lack of stability in the solution. It is thus necessary to control the concavity for the non-concave penalties. Using penalties with too large a concavity the aim function will not have a single (global) optimum, not have sparse convexity in high dimensional case, not have a converging algorithm, converge to a stable point but not local optimum, or have a set of local optimums that diverges, which lead to relative unstableness:with too small a concavity (such as LASSO), the solution to the choice may not be sparse enough, or the bias will be relatively too large. So we aim to find a possible penalizing approach, which will weaken the constraint for the largest concavity, while with the oracle property simultaneously, to have the best prediction which uses variables as less as we can.Here we use the stability defined by [7], that is, if small changes in the dataset will cause large changes in the prediction. In practice for penalized likelihood stability is often influenced by the property of the optimizer in some algorithm, including the existence of global convexity, convexity in iterations, or sparse convexity in high dimensional case, continuity of the solution, the asymptotic property of the set of local optimizers, or the strictly local convexity in path. We can put some constraints on the concavity of the penalty to make the optimizer in the algorithm more stable.Inspired by a Bayesian interpretation, we develop the likelihood adaptively mod-ified penalty (LAMP), where the smoothness and shape effect reduction property can balance the parsimony and stability better in some case, and also has an oracle property. This paper mainly studies the theoretical properties and applications of the LAMP in both low dimensional and ultra-high dimensional cases based on either parametric or semiparametric models. In parametric models, we construct the explicit form of LAMP, focusing on gener-alized linear regression, and give the theoretical properties in both the low and ultra-high dimensional cases. That is, consistency, sparsity, oracle property, and the high-dimensional weak oracle property;we introduce the concept of asymptotic stability for low dimensional case and show the conditions for it:we discover the shape effect re-duction property of LAMP from the conditions for strictly local convexity; we combine CD algorithm. LLA algorithm, IRLS, and the design of a "Violate" function to a new algorithm, which is proved to converge under certain conditions; we testify the oracle property and shape effect reduction through low dimensional simulations and compare with other penalties in different schemes such as selection consistency, fitting error, sen-sitivity on perturbation and division of the cross validation;we deal with real data using LAMP and the result turns out satisfying.In semiparametric models, we mainly focus on categorical models with a retrospec-tive sampling in low dimensional case. The form of LAMP we consider the same as sampling prospectively. We display the construction of the penalized likelihood and give the conditions on both the profile likelihood and penalty to obtain an estimate with good properties such as oracle property:we perform simulations on the difference of different sampling schemes and point out that the variable selection of a categorial model with retrospective sampling can use the algorithm in the prospective sampling case only when it is a Logistic-type model; we also refer to another approach to construct the penalized likelihood, which is based on the Taylor expansion of the profile likelihood.LAMP in the paper is a family of penalties mainly based on parametric models, which is nonconvex for most GLM models. They have some Bayesian interpretation and more good properties than other penalties:the efficiency of algorithm, consistency, sparsity, oracle property, low-dimensional asymptotic stability, high-dimensional weak oracle property, shape effect reduction, and infinitely differentiable. Both the results of the simulations and real data turn out good, in low and ultra-high dimensional case respectively. Both the theoretical properties and applications deserve to be explored in depth.

Related Dissertations

  1. Table lamp shape of Art and Design,TS956
  2. Study on the Application Technique of Frequoscillation Pest-Killing Lamp in Vegetables,S436.3
  3. Design and Implementation of LAMP-based Network Office System,TP311.52
  4. Qualitative Study of Almost Periodic Solutions of Some Competition System,O175
  5. Establishment and Application of a Reverse Transcription-loop-mediated Isothermal Amplification Method for Detection of Rubella Virus RNA,R440
  6. The research direction of lamp pumped laser,TN248
  7. Risk Management Research on the Project of Remote Monitoring-controlling and Saving Energy for Changle Street Lamp,U491.53
  8. Dynamical Hehavior of a Class of Competivie Neural Networks with Distrbuted Tiem Delys,TP183
  9. Landscape Light Design Based Regional Traditional Culture,TU113.666
  10. Foreign Exchange Rates Prediction Based on Generalized Exponential Predictor Models with Weighted Loss Function,F832.6
  11. A Note on Asymptotic Behaviors of Stochastic Population Model with the Allee Effect,O242.1
  12. Manufacturing Enterprise Inventory Management System Research and Implementation,TP311.52
  13. Network -based training management platform MOODLE Functional Design and Implementation,TP311.52
  14. Development of LED Street Light Remote Control System Based on Power Line Carrier Technology,TP277
  15. Multiple regression models, variable selection problem,O212.1
  16. Delay differential equations stability,O241.8
  17. Portable spectrophotometer Circuit Design,TH744
  18. High conductivity and wide temperature ferrite material preparation software applications for green lighting,TM277
  19. Metal-halide Lamp Recycling Collection Technology,X705
  20. Life Time Analysis of the LED Lamps,TM923.34
  21. HID electronic ballast Research and Design,TM923.61

CLC: > Mathematical sciences and chemical > Mathematics > Probability Theory and Mathematical Statistics > Mathematical Statistics > General mathematical statistics
© 2012 www.DissertationTopic.Net  Mobile