Multilingual Knowledge Transfer under Data Constraints via Lexical Interventions

Apple researchers have developed a technique called lexical interventions to improve multilingual language models when training data for certain languages is limited. By strategically linking terms across different languages during the learning process, the method enables models to better apply knowledge from high-resource languages to those with scarce data.