Language models can't spark scientific revolutions, but world models might
Google DeepMind researcher Tom Zahavy argues in a recent position paper that current language models lack the cognitive mechanisms necessary to produce genuine scientific breakthroughs. While these models excel at processing existing information, the paper suggests that achieving transformative discovery will require the development of world models capable of independent reasoning and conceptual innovation.
Covered by 1 source
- TThe Decoder↗Maximilian SchreinerJul 30