On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜

Articulated critical systemic risks of scaling language models: environmental carbon costs, uncurated internet biases, statistical illusion of meaning, and concentration of power.

Serves as qualified reference for implementing task-text-generation in production systems.

Assumptions

• Underlying computational topology and mathematical bounds adhere to established convexity/smoothness guarantees

Limitations

• Hardware runtime speedups, privacy budgets, and convergence depend on hyperparameters and network communication limits