An alternative pruning based approach to unbiased recursive partitioning

Research output: Contribution to a Journal (Peer & Non Peer)Articlepeer-review

5 Citations (Scopus)

Abstract

Tree-based methods are a non-parametric modelling strategy that can be used in combination with generalized linear models or Cox proportional hazards models, mostly at an exploratory stage. Their popularity is mainly due to the simplicity of the technique along with the ease in which the resulting model can be interpreted. Variable selection bias from variables with many possible splits or missing values has been identified as one of the problems associated with tree-based methods. A number of unbiased recursive partitioning algorithms have been proposed that avoid this bias by using p-values in the splitting procedure of the algorithm. The final tree is obtained using direct stopping rules (pre-pruning strategy) or by growing a large tree first and pruning it afterwards (post-pruning). Some of the drawbacks of pre-pruned trees based on p-values in the presence of interaction effects and a large number of explanatory variables are discussed, and a simple alternative post-pruning solution is presented that allows the identification of such interactions. The proposed method includes a novel pruning algorithm that uses a false discovery rate (FDR) controlling procedure for the determination of splits corresponding to significant tests. The new approach is demonstrated with simulated and real-life examples.

Original languageEnglish
Pages (from-to)90-102
Number of pages13
JournalComputational Statistics and Data Analysis
Volume106
DOIs
Publication statusPublished - 1 Feb 2017

Keywords

  • False discovery rate
  • Interactions
  • Pruning
  • Tree-based methods

Authors (Note for portal: view the doc link for the full list of authors)

  • Authors
  • Alvarez-Iglesias, Alberto and Hinde, John and Ferguson, John and Newell, John

Fingerprint

Dive into the research topics of 'An alternative pruning based approach to unbiased recursive partitioning'. Together they form a unique fingerprint.

Cite this