High level reasoning and planning about what you are writing about. GPT-3 genera...

		nightski on Oct 27, 2020 \| parent \| context \| favorite \| on: Yann LeCun on GPT-3 High level reasoning and planning about what you are writing about. GPT-3 generates text one word at a time. The results are impressive for what it is. But it will not plan out what it wants to say ahead of time and construct the message to achieve that objective.

But of course it does within its own horizon (e.g. token window).