One thing I actually liked about the Stanford workshop that accompanied this white paper, was the emphasis on, what in physics we often summed up as, “More is different”[1] Basically, it's the principle that drastic qualitative change and stable structures commonly appear as you scale up base units, which would be almost impossible to predict when you just have a unit level understanding. I.e. qualitative structure that emerges, let's say, when a certain system has 100 million units does not do so linearly such that if you see a system as it scales from 1 unit to 1 million units you would have any evidence of the emergent behavior at 100 million.
It is irrelevant when folks point out "but human cognition isn't any different at its base than the machine" because we can very clearly see there is a massive qualitative difference in behaviors, and there is a wide gulf in architectures and development that there is no reason whatsoever to expect a qualitatively unique (so far as we can tell) behavior as conscious language use to ever emerge in a computer model. It's pretty remarkable that the only other cluster of biological systems that can even physiologically mimic it are songbirds/parrots who come from a very very different part of the phylogenetic tree. Who could ever predict that aberrant homology if I just gave you the 4 nucleotides?
More is different. You don't get complex structure by just crudely analogizing and reducing everything to base parts.
[1] Anderson, Philip W. "More is different." Science 177, no. 4047 (1972): 393-396.
It is irrelevant when folks point out "but human cognition isn't any different at its base than the machine" because we can very clearly see there is a massive qualitative difference in behaviors, and there is a wide gulf in architectures and development that there is no reason whatsoever to expect a qualitatively unique (so far as we can tell) behavior as conscious language use to ever emerge in a computer model. It's pretty remarkable that the only other cluster of biological systems that can even physiologically mimic it are songbirds/parrots who come from a very very different part of the phylogenetic tree. Who could ever predict that aberrant homology if I just gave you the 4 nucleotides?
More is different. You don't get complex structure by just crudely analogizing and reducing everything to base parts.
[1] Anderson, Philip W. "More is different." Science 177, no. 4047 (1972): 393-396.