> ML_ARCHITECTURE // GRADIENT-BOOSTED-DECISION-TREES_v1.0
Gradient Boosted Decision Trees (GBDT / XGBoost / LightGBM / CatBoost)
Ensemble architecture sequentially building shallow decision trees where each successive tree fits the pseudo-residuals (negative gradients) of the loss function, the unrivaled gold standard for tabular data.
Tree Ensemblestabular
Back to All ArchitecturesArchitecture Overview
Ensemble architecture sequentially building shallow decision trees where each successive tree fits the pseudo-residuals (negative gradients) of the loss function, the unrivaled gold standard for tabular data.
Implementing Libraries
Seminal Papers
Greedy Function Approximation: A Gradient Boosting MachineJerome H. Friedman (2001) · The Annals of Statistics
Architectural Limitations & Constraints
- Requires compatible deep learning framework and hardware acceleration for efficient execution.