How Do Language Models Represent and Use Phonological Information for Allomorph Selection?
A new research paper investigates how language models manage phonological information during allomorph selection despite being trained on text that lacks explicit sound structures. The study seeks to determine whether models rely on memorizing specific word instances or if they have developed internal rule-like mechanisms to ensure correct phonological usage.
Covered by 1 source
- AarXiv CS.AI↗Sangwoo Kim, Sangah LeeSep 7