Skip to main content

> ML_ALGORITHMS_ATLAS_v1.0

Algorithms & Method Families

100 qualified algorithmic method families across 9 disciplines: Classical Supervised, Unsupervised, Time Series, Anomaly Detection, Deep Learning, Recommenders, Causal Inference, Reinforcement Learning, and Specialized Methods.

Showing 18 of 100 Method Families (Page 1 of 6)Mathematically Formulated
Algorithm
O(p) dot productclassical-supervised

Ordinary Least Squares Linear Regression

Directly readable regression coefficients represent marginal impact per unit change.

regressionforecasting
Algorithm
O(p)classical-supervised

Logistic Regression (Logit)

Exponentiated coefficients directly reflect Odds Ratios per unit predictor increase.

binary classificationmulticlass classification
Algorithm
O(p)classical-supervised

Regularized Linear Models (Ridge, Lasso, ElasticNet)

Lasso enforces exact sparsity, setting non-informative feature weights to zero.

regressionbinary classificationfeature extraction
Algorithm
O(tree_depth)classical-supervised

CART Decision Trees

Can be visually inspected as human-executable IF-THEN logic trees.

binary classificationmulticlass classificationregression
Algorithm
O(n_trees * depth)classical-supervised

Random Forests

Aggregated ensemble cannot be read as a single tree; relies on MDI, MDA, and SHAP values.

binary classificationmulticlass classificationregression
Algorithm
O(n_trees * depth)classical-supervised

Extremely Randomized Trees (Extra Trees)

Ensemble evaluated via feature importances and TreeSHAP.

Implementing Tools:
binary classificationmulticlass classificationregression
#extra-treesDetails
Algorithm
O(n_trees * depth)classical-supervised

Gradient Boosted Decision Trees (GBDT)

TreeSHAP provides mathematically rigorous local and global feature attributions.

Implementing Tools:
binary classificationmulticlass classificationregression
#gradient-boostingDetails
Algorithm
Sub-millisecond O(n_trees)classical-supervised

Modern Histogram & Symmetric Boosting (XGBoost / LightGBM / CatBoost)

Fast TreeSHAP algorithms compute exact Shapley values in milliseconds.

Implementing Tools:
binary classificationmulticlass classificationregression
Algorithm
O(n_support_vectors * p)classical-supervised

Support Vector Machines (SVM)

Non-linear kernels (RBF, Polynomial) operate in infinite-dimensional space; weights cannot be directly inspected.

Implementing Tools:
binary classificationmulticlass classificationregression
Algorithm
O(n * p) linear search or O(log n) via KD-Tree/HNSWclassical-supervised

k-Nearest Neighbors (k-NN)

Predictions can be explained by presenting the exact nearest historical neighbor instances.

Implementing Tools:
binary classificationmulticlass classificationregression
Algorithm
O(p)classical-supervised

Naive Bayes Classifiers (Gaussian, Multinomial, Bernoulli)

Individual log-likelihood contributions per word or feature can be summed and inspected.

Implementing Tools:
text classificationbinary classificationmulticlass classification
Algorithm
O(p)classical-supervised

Discriminant Analysis (LDA / QDA)

Linear discriminant projections provide clear orthogonal class separation axes.

Implementing Tools:
multiclass classificationdimensionality reduction
Algorithm
O(k * p)classical-unsupervised

K-Means & K-Means++ Clustering

Centroids directly represent the average feature vector of all members in each cluster.

clusteringvector quantization
Algorithm
O(p * components)classical-unsupervised

Principal Component Analysis (PCA & TruncatedSVD)

Principal axes are linear combinations of features whose loadings indicate exact contribution.

Implementing Tools:
dimensionality reductionfeature extractionanomaly detection
#principal-component-analysisDetails
Algorithm
Non-parametric (no out-of-sample projection)classical-unsupervised

t-Distributed Stochastic Neighbor Embedding (t-SNE)

Provides high-contrast 2D/3D visualizations of clusters, though inter-cluster distances are not calibrated.

Implementing Tools:
dimensionality reductiondata visualization
Algorithm
O(log n) out-of-sample projection supportedclassical-unsupervised

Uniform Manifold Approximation and Projection (UMAP)

Preserves significantly more global topological structure than t-SNE while maintaining tight local clusters.

Implementing Tools:
dimensionality reductiondata visualizationfeature extraction
Algorithm
O(log n) approximate predictionclassical-unsupervised

HDBSCAN & DBSCAN Density-Based Clustering

Explicitly outputs an outlier/noise class (-1) without forcing non-conforming points into spurious clusters.

Implementing Tools:
clusteringanomaly detection
Algorithm
Non-parametric tree traversalclassical-unsupervised

Hierarchical Agglomerative Clustering (Ward / Complete Linkage)

Dendrogram tree visualization reveals the full multi-scale hierarchy of data groupings.

Implementing Tools:
clusteringtaxonomy induction
#hierarchical-agglomerative-clusteringDetails
Showing 1–18 of 100 Method Families