Skip to main content

> ML_ALGORITHMS_ATLAS_v1.0

Algorithms & Method Families

100 qualified algorithmic method families across 9 disciplines: Classical Supervised, Unsupervised, Time Series, Anomaly Detection, Deep Learning, Recommenders, Causal Inference, Reinforcement Learning, and Specialized Methods.

Showing 18 of 100 Method Families (Page 5 of 6)Mathematically Formulated
Algorithm
O(1)evolutionary-search

Simulated Annealing (SA)

Single-agent trajectory with explicit temperature decay mirroring physical metallurgical annealing.

Implementing Tools:
combinatorial optimizationlayout planningchip floorplanning
#simulated-annealing-saDetails
Algorithm
O(trials * acquisition_points)evolutionary-search

Gaussian Process Bayesian Optimization (GP-BO)

GP posterior provides mean prediction and calibrated epistemic uncertainty bounds at all unobserved points.

Implementing Tools:
hyperparameter tuningexpensive blackbox experimentshardware tuning
#gaussian-process-bayesian-optimization-gp-boDetails
Algorithm
O(candidates * kernel_eval)evolutionary-search

Tree-structured Parzen Estimators (TPE)

Directly displays which hyperparameter ranges yield top quantile performance via 1D kernel densities.

Implementing Tools:
hyperparameter tuningmixed discrete continuous hpo
#tree-structured-parzen-estimators-tpeDetails
Algorithm
O(1)evolutionary-search

Hyperband & Successive Halving

Successive halving brackets clearly discard non-promising models early to focus budget on top performers.

Implementing Tools:
hyperparameter tuningdeep learning architecture search
#hyperband-successive-halvingDetails
Algorithm
O(1)evolutionary-search

NSGA-II (Non-dominated Sorting Genetic Algorithm II)

Directly yields the full Pareto frontier of optimal tradeoff solutions for stakeholder selection.

Implementing Tools:
multi objective optimizationmodel compression nastradeoff analysis
#non-dominated-sorting-genetic-algorithm-nsga-iiDetails
Algorithm
O(|V|)evolutionary-search

Ant Colony Optimization (ACO)

Pheromone trail distribution directly highlights high-confidence graph edges and route corridors.

Implementing Tools:
routing optimizationcombinatorial optimizationgraph scheduling
#ant-colony-optimization-acoDetails
Algorithm
O(samples) empirical posterior summariesbayesian-probabilistic

Markov Chain Monte Carlo (MCMC / Metropolis-Hastings)

Generates full empirical posterior probability distributions and credible intervals for every parameter.

Implementing Tools:
bayesian inferenceposterior parameter estimation
#markov-chain-monte-carlo-metropolis-hastingsDetails
Algorithm
O(samples)bayesian-probabilistic

Hamiltonian Monte Carlo & No-U-Turn Sampler (HMC / NUTS)

NUTS automatically calibrates trajectory lengths to eliminate arbitrary tuning parameters.

Implementing Tools:
bayesian inferencehierarchical statistical modeling
#hamiltonian-monte-carlo-nutsDetails
Algorithm
O(1) analytical distribution lookupbayesian-probabilistic

Stochastic Variational Inference (SVI)

Transforms slow integration into fast stochastic optimization, scaling Bayesian inference to massive datasets.

Implementing Tools:
large scale bayesian learningtopic modeling ldadeep bayesian networks
#stochastic-variational-inference-sviDetails
Algorithm
O(n^2) variance per test pointbayesian-probabilistic

Gaussian Process Regression & Classification (GPR / GPC)

Provides exact, analytical closed-form Gaussian predictive mean and variance at all input locations.

Implementing Tools:
regressionuncertainty quantificationspatial kriging
#gaussian-process-regression-classificationDetails
Algorithm
O(mcmc_draws * trees * depth)bayesian-probabilistic

Bayesian Additive Regression Trees (BART)

Generates full posterior distributions for Individual Treatment Effects (ITE) and counterfactuals.

Implementing Tools:
regressioncausal inference iteuncertainty quantification
#bayesian-additive-regression-trees-bartDetails
Algorithm
O(T * |S|^2) via Viterbi decodingbayesian-probabilistic

Hidden Markov Models (HMM / Baum-Welch / Viterbi)

Viterbi algorithm outputs the mathematically optimal global sequence of hidden regime states.

Implementing Tools:
sequence labelingspeech phoneme recognitionfinancial regime detection
#hidden-markov-models-baum-welchDetails
Algorithm
O(state_dim^3) matrix inversion per timestepbayesian-probabilistic

Kalman Filter (Linear, EKF & Unscented UKF)

Kalman Gain explicitly quantifies how measurement surprise balances against prior model uncertainty.

Implementing Tools:
state estimationsensor fusiontarget tracking
#kalman-filter-extended-unscentedDetails
Algorithm
O(particles * state_dim)bayesian-probabilistic

Particle Filtering (Sequential Monte Carlo / SMC)

Particle cloud represents the exact multimodal posterior belief over the agent location in real-time.

Implementing Tools:
state estimationrobot localizationsensor fusion
#particle-filtering-sequential-monte-carloDetails
Algorithm
O(parameter_pass)bayesian-probabilistic

Expectation-Maximization (EM)

E-step estimates soft responsibilities while M-step updates parameter estimators in closed analytical form.

Implementing Tools:
clusteringlatent variable estimationimputation
#expectation-maximization-algorithmDetails
Algorithm
O(draws * timesteps)bayesian-probabilistic

Bayesian Structural Time Series (BSTS)

Spike-and-slab prior outputs explicit posterior inclusion probabilities for synthetic control predictors.

Implementing Tools:
causal impact analysistime series forecastingtrend decomposition
#bayesian-structural-time-series-bstsDetails
Algorithm
O(d)bayesian-probabilistic

Copula Dependence Modeling (Clayton, Gumbel, Frank & Gaussian Copulas)

Decouples marginal feature distributions completely from the underlying dependency structure.

Implementing Tools:
multivariate risk modelingsynthetic data generationtail dependence analysis
#copula-dependence-modelingDetails
Algorithm
O(p + q)time-series-forecasting

ARIMA & SARIMAX (Box-Jenkins)

Autoregressive (AR) and Moving Average (MA) polynomials directly quantify momentum and shock persistence.

Implementing Tools:
time series forecastingunivariate econometrics
Showing 73–90 of 100 Method Families