Fully agree. This is much deeper than many here think. Thanks for bringing it up in this concise manner. There is only one logic in this universe ... but materially implemented differently. And this same one logic of the "becoming of a complex system" has allowed the evolution of the human brain with all the cognitive faculties that some claim cannot possibly be achieved by LLMs. The same logic underlies re pretraining of LLMs.
What most (maybe even including you) do not fully appreciate is that LLMs do not simply recapitulate what knoweldge human "learn" after birth. No, they recapitulate in essence, in a time-condensed manner, the evolution of the human brain AND development, and then, education (postnatal knoweldge acquisition).
During evolution, over millions of years, humans have developed the basic neuronal architecture for learning and communication via a language in the first place, which entails some implicit semantic representation. Only to some extent do LLMs also recapitulate postnatal explicit learning - the facts of the world. All these phases, from evolution to development to postnatal learning are captured by the process of pretraining of LLMs, based on the very same logic. But most people only think of the latter postnatal phase .
I wrote about this at length here (with reference to this excellent piece):
