What are They Thinking? Delineation, Probing, and Tracking of Concepts in LLMs

Researchers have developed a new method to track and identify abstract concepts within the internal data representations of large language models. By probing these embeddings, the team aims to improve the transparency of AI decision-making processes, offering a clearer view into how models interpret complex information.