Kavli Affiliate: Wei Gao | First 5 Authors: Kai Huang, Hanyun Yin, Heng Huang, Wei Gao, | Summary: Fine-tuning is the most effective way of adapting pre-trained large language models (LLMs) to downstream applications. With the fast growth of LLM-enabled AI applications and democratization of open-souced LLMs, fine-tuning has become possible for non-expert individuals, but […]
Continue.. Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation