My point here is that models can learn from self-play. If models can become embodied - in a robotic interface - where it can explore the world, try to do things, fail, learn from that and try again - then they could actually begin building meaningful world models.
More broadly, I agree we’re unlikely to see AGI without a breakthrough on continuous learning, and that may not be possible with anything close to current architectures.
