The Blessing of Dimensionality: How Near-Orthogonality in High-Dimensional Spaces Explains Temporal Portability
Researchers have introduced PortLLM, a framework designed to improve temporal portability when fine-tuning large language models. By leveraging the geometric properties of high-dimensional vector spaces, the method aims to enhance how models retain and transfer knowledge across different domain-specific tasks while maintaining computational efficiency.
Covered by 1 source
- AarXiv CS.AI↗Abigail Woodring, Adrian Chan, Rana Muhammad Shahroz Khan, Sukwon Yun, Chau-Wai Wong, Tianlong ChenJul 23