Base Models Know How to Reason, Thinking Models Learn When

Researchers have developed an unsupervised method using sparse autoencoders to identify how thinking-oriented language models differ from their base counterparts. By analyzing sentence-level activations, the study suggests that while base models possess inherent reasoning capabilities, specialized training teaches them when to apply these processes during problem-solving.