Large Language Models don’t reason either. The idea that Artificial General Intelligence will come from LLMs is pure fallacy to drive stock price. When it is eventually announced that some company claims to have achieved AGI via LLMs, it will just be another arbitrary milestone that moves the goalposts more.
This. Any time someone’s tries to tell me that AGI will come in the next 5 years given what we’ve seen, I roll my eyes. I don’t see a pathway where LLMs become what’s needed for AGI. It may be a part of it, but it would be non-critical at best. If you can’t reduce hallucinations down to being virtually indistinguishable from misunderstanding a sentence due to vagueness, it’s useless for AGI.
Our distance from true AGI (not some goalpost moved by corporate interests) has not significantly moved from before LLMs became a thing, in my very harsh opinion, bar the knowledge and research being done by those who are actually working towards AGI. Just like how we’ve always thought AI would come one day, maybe soon, before 2020, it’s no different now. LLMs alone barely closes that gap. It gives us that illusion at best.
Interesting conclusion, LLMs are inherently 1D in nature, and ARC is a 2D task. LLMs are able to emulate 2D reasoning for sufficiently small tasks, but suffer greatly as the size of the task increases. This is like asking humans to solve 4D problems.
This is probably a fundamental limitation in LLM architecture and will need to be solved someday, presumably by something completely different.
I’ve beaten Portal and Portal 2, have I not solved 4D problems?
Not really, portals give you shortcuts in 3D space, they don’t allow you to interact with a whole different dimension. If you have Minecraft there’s a really nice custom map called “The Hypercube” which sorts of emulates a 4th dimension, it felt much more confusing than Portal (2) for me.
Odd does it may sound, not exactly. Again, that’s a perception problem, not a reasoning problem.
If you compare the perception of portal travel from the show Stargate to the game Portal, I think it illustrates the difference.
deleted by creator
