But the general public (myself included) doesn’t really understand how our own reasoning happens.
Does anyone, really? i.e., am I merely a meat computer that takes in massive amounts of input over a lifetime, builds internal models of the world, tests said models through trial-and-error, and outputs novel combinations of data when said combinations are useful for me in a given context in said world?
Is what I do when I “reason” really all that different from what an LLM does, fundamentally? Do I do more than language prediction when I “think”? And if so, what is it?
This is definitely part of the issue, not sure why people are downvoting this. That’s also why tests like this are important, to illustrate that thinking in the way we know it isn’t happening in these models.
We understand reasoning enough to know humans (and other animals with complex brains) reason in a way that LLMs cannot.
While our reasoning also works with pattern matching it incorporates immeasurably more signals than language - language is almost peripheric to it even in humans. And more importantly we experience things, everything we do acts as a small training round not just in language but on every aspect of the task we are performing, and gives us a miriad of patterns to match later.
Until AI can match a fragment of this we are not going to have an AGI. And for the experience aspect there’s no economic incentive under capitalism to achieve, if it happens it will come out of an underfunded university.
But the general public (myself included) doesn’t really understand how our own reasoning happens.
Does anyone, really? i.e., am I merely a meat computer that takes in massive amounts of input over a lifetime, builds internal models of the world, tests said models through trial-and-error, and outputs novel combinations of data when said combinations are useful for me in a given context in said world?
Is what I do when I “reason” really all that different from what an LLM does, fundamentally? Do I do more than language prediction when I “think”? And if so, what is it?
This is definitely part of the issue, not sure why people are downvoting this. That’s also why tests like this are important, to illustrate that thinking in the way we know it isn’t happening in these models.
downvotes are not allowed on beehaw fyi
Downvotes aren’t federated but you still see all the downvotes sent from just your own instance
Interesting. I figured since this post is in a Beehaw community they would be invisible to everyone, but good to know.
We understand reasoning enough to know humans (and other animals with complex brains) reason in a way that LLMs cannot.
While our reasoning also works with pattern matching it incorporates immeasurably more signals than language - language is almost peripheric to it even in humans. And more importantly we experience things, everything we do acts as a small training round not just in language but on every aspect of the task we are performing, and gives us a miriad of patterns to match later.
Until AI can match a fragment of this we are not going to have an AGI. And for the experience aspect there’s no economic incentive under capitalism to achieve, if it happens it will come out of an underfunded university.