
It’s time to retire the ‘stochastic parrot’ definition of AI
It’s time to retire the ‘stochastic parrot’ definition of AI. Early generative AI models, circa 2017-2022, were “stochastic parrots.” That is, they generated language by choosing the statistically most likely next word based on patterns in their training data, rather than truly understanding what they were saying. Beginning in 2023, artificial intelligence labs began releasing large language models (LLMs) that had evolved beyond autoregressive next-token prediction, as researchers call it. For many people, the stochastic parrot definition stuck. And lately, the “they’re just stochastic parrots” argument has been used as a way of downplaying the potential risks of huge language.
