Metaphor Tracer: A Theory-Informed Analysis of Hidden States

Researchers have introduced Metaphor Tracer, a method for analyzing the hidden states of language models during a single forward pass without additional training. By evaluating two specific properties of each token position, the technique identifies how models consolidate and process thematic information within a given text.