> ML_LITERATURE // YAO-2023-TREE-OF-THOUGHTS-DELIBERATE-PROBLEM-SOLVING_v1.0
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan · Advances in Neural Information Processing Systems (NeurIPS) (2023)
algorithm2023industry-standardthirdPartyReproduced
Principal Contribution
Generalised chain-of-thought to tree-search exploration over units of thought using breadth-first and depth-first search with lookahead and backtracking.
Operational Relevance
Directly guides architectural decisions, alignment strategy, and serving infrastructure for task-autonomous-agents, task-text-generation.
Assumptions
- Empirical distribution regularity holds and target domain adheres to pretraining linguistic/visual support
Limitations
- Resource scaling, inference memory requirements, and alignment robustness vary with model size and hardware topology
Connected Algorithms, Architectures & Tools
Related Algorithms:
Related Architectures:
Implementing Libraries:
