Kavli Affiliate: Wei Gao | First 5 Authors: Kai Huang, Boyuan Yang, Wei Gao, , | Summary: Large Language Models (LLMs) are capable of reasoning over diverse input data modalities through pre-trained encoders. However, the growing diversity of input data modalities prevents incorporating all modalities into LLMs, especially when LLMs are deployed on resource-constrained edge […]
Continue.. Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI