Kavli Affiliate: Yi Zhou | First 5 Authors: Xiaohang Tang, Yi Zhou, Danushka Bollegala, , | Summary: Dynamic contextualised word embeddings represent the temporal semantic variations of words. We propose a method for learning dynamic contextualised word embeddings by time-adapting a pretrained Masked Language Model (MLM) using time-sensitive templates. Given two snapshots $C_1$ and $C_2$ […]
Continue.. Learning Dynamic Contextualised Word Embeddings via Template-based Temporal Adaptation