Kavli Affiliate: Cheng Peng | First 5 Authors: Tianwen Wei, Liang Zhao, Lichang Zhang, Bo Zhu, Lijie Wang | Summary: In this technical report, we present Skywork-13B, a family of large language models (LLMs) trained on a corpus of over 3.2 trillion tokens drawn from both English and Chinese texts. This bilingual foundation model is […]
Kavli Affiliate: Yi Zhou | First 5 Authors: Swanand Ravindra Kadhe, Heiko Ludwig, Nathalie Baracaldo, Alan King, Yi Zhou | Summary: The effective detection of evidence of financial anomalies requires collaboration among multiple entities who own a diverse set of data, such as a payment network system (PNS) and its partner banks. Trust among these […]
Kavli Affiliate: Xinan Zhou | First 5 Authors: Junding Chen, Aleix Gimenez-Grau, Xinan Zhou, , | Summary: We consider correlation functions in 6d $(2,0)$ theories of two $frac{1}{2}$-BPS operators inserted away from a $frac{1}{2}$-BPS surface defect. In the large central charge limit the leading connected contribution corresponds to sums of tree-level Witten diagram in AdS$_7times$S$^4$ […]
Kavli Affiliate: Zheng Zhu | First 5 Authors: Yanqing Liu, Jianyang Gu, Kai Wang, Zheng Zhu, Kaipeng Zhang | Summary: Dataset distillation plays a crucial role in creating compact datasets with similar training performance compared with original large-scale ones. This is essential for addressing the challenges of data storage and training costs. Prevalent methods facilitate […]
Kavli Affiliate: Yi Zhou | First 5 Authors: Yi Zhou, Jose Camacho-Collados, Danushka Bollegala, , | Summary: Various types of social biases have been reported with pretrained Masked Language Models (MLMs) in prior work. However, multiple underlying factors are associated with an MLM such as its model size, size of the training data, training objectives, […]
Kavli Affiliate: Yi Zhou | First 5 Authors: Yi Zhou, Jose Camacho-Collados, Danushka Bollegala, , | Summary: Various types of social biases have been reported with pretrained Masked Language Models (MLMs) in prior work. However, multiple underlying factors are associated with an MLM such as its model size, size of the training data, training objectives, […]
Kavli Affiliate: Yi Zhou | First 5 Authors: Yuanyuan Qiao, Yi Zhou, , , | Summary: We investigate the global well-posedness of two-dimensional incompressible viscous and non-resistive MHD system near a non-constant equilibrium. Assuming that the initial data has certain symmetries, we can establish time-weighted lower-order energy estimates and uniform higher-order energy estimates by exploring […]
Kavli Affiliate: Yi Zhou | First 5 Authors: Yuanyuan Qiao, Yi Zhou, , , | Summary: This paper investigates the stabilization effect of a background magnetic vorticity on electrically conducting fluids. By exploring the dissipation nature of the linearized equations, we prove the global existence of smooth solutions to the two-dimensional incompressible viscous and non-resistive […]
Kavli Affiliate: Cheng Peng | First 5 Authors: Tianbao Xie, Fan Zhou, Zhoujun Cheng, Peng Shi, Luoxuan Weng | Summary: Language agents show potential in being capable of utilizing natural language for varied and intricate tasks in diverse environments, particularly when built upon large language models (LLMs). Current language agent frameworks aim to facilitate the […]
Kavli Affiliate: Gang Su | First 5 Authors: Jia-Wen Li, Gang Su, Bo Gu, , | Summary: To realize room temperature ferromagnetic (FM) semiconductors is still a challenge in spintronics. Many antiferromagnetic (AFM) insulators and semiconductors with high Neel temperature $T_N$ are obtained in experiments, such as LaFeO$_3$, BiFeO$_3$, etc. High concentrations of magnetic impurities […]