Skip to main content

> ML_LITERATURE // YAO-2023-TREE-OF-THOUGHTS-DELIBERATE-PROBLEM-SOLVING_v1.0

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan · Advances in Neural Information Processing Systems (NeurIPS) (2023)

algorithm2023industry-standardthirdPartyReproduced

Principal Contribution

Generalised chain-of-thought to tree-search exploration over units of thought using breadth-first and depth-first search with lookahead and backtracking.

Operational Relevance

Directly guides architectural decisions, alignment strategy, and serving infrastructure for task-autonomous-agents, task-text-generation.

Assumptions

  • Empirical distribution regularity holds and target domain adheres to pretraining linguistic/visual support

Limitations

  • Resource scaling, inference memory requirements, and alignment robustness vary with model size and hardware topology

Connected Algorithms, Architectures & Tools

Related Algorithms:
Related Architectures:
Implementing Libraries: