Kavli Affiliate: Zhuo Li | First 5 Authors: Zhisheng Lin, Han Fu, Chenghao Liu, Zhuo Li, Jianling Sun | Summary: Parameter-efficient fine-tuning (PEFT) has emerged as an effective method for adapting pre-trained language models to various tasks efficiently. Recently, there has been a growing interest in transferring knowledge from one or multiple tasks to the […]
Continue.. PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning