Kavli Affiliate: Max Tegmark | First 5 Authors: Joshua Engels, Eric J. Michaud, Isaac Liao, Wes Gurnee, Max Tegmark | Summary: Recent work has proposed that language models perform computation by manipulating one-dimensional representations of concepts ("features") in activation space. In contrast, we explore whether some language model representations may be inherently multi-dimensional. We begin […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Joshua Engels, Eric J. Michaud, Isaac Liao, Wes Gurnee, Max Tegmark | Summary: Recent work has proposed that language models perform computation by manipulating one-dimensional representations of concepts ("features") in activation space. In contrast, we explore whether some language model representations may be inherently multi-dimensional. We begin […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Joshua Engels, Isaac Liao, Eric J. Michaud, Wes Gurnee, Max Tegmark | Summary: Recent work has proposed the linear representation hypothesis: that language models perform computation by manipulating one-dimensional representations of concepts ("features") in activation space. In contrast, we explore whether some language model representations may be […]
Kavli Affiliate: Tim H. Taminiau | First 5 Authors: S. Alex Breitweiser, Mathieu Ouellet, Tzu-Yung Huang, Tim H. Taminiau, Lee C. Bassett | Summary: Nuclear quadrupolar resonance (NQR) spectroscopy reveals chemical bonding patterns in materials and molecules through the unique coupling between nuclear spins and local fields. However, traditional NQR techniques require macroscopic ensembles of […]
Kavli Affiliate: Tim H. Taminiau | First 5 Authors: S. Alex Breitweiser, Mathieu Ouellet, Tzu-Yung Huang, Tim H. Taminiau, Lee C. Bassett | Summary: Nuclear quadrupolar resonance (NQR) spectroscopy reveals chemical bonding patterns in materials and molecules through the unique coupling between nuclear spins and local fields. However, traditional NQR techniques require macroscopic ensembles of […]
Kavli Affiliate: Feng Wang | First 5 Authors: Feng Wang, Jiahao Wang, Sucheng Ren, Guoyizhe Wei, Jieru Mei | Summary: Similar to Vision Transformers, this paper identifies artifacts also present within the feature maps of Vision Mamba. These artifacts, corresponding to high-norm tokens emerging in low-information background areas of images, appear much more severe in […]
Kavli Affiliate: Daniel E. Holz | First 5 Authors: Alexandra G. Hanselman, Aditya Vijaykumar, Maya Fishbach, Daniel E. Holz, | Summary: The detection of GW170817 and the measurement of its redshift from the associated electromagnetic counterpart provided the first gravitational wave determination of the Hubble constant ($H_0$), demonstrating the potential power of standard-siren cosmology. In […]
Kavli Affiliate: Daniel E. Holz | First 5 Authors: Alexandra G. Hanselman, Aditya Vijaykumar, Maya Fishbach, Daniel E. Holz, | Summary: The discovery of GW170817 provided the first direct gravitational-wave measurement of the Hubble constant, $H_0$, demonstrating the potential power of standard-siren cosmology. The dark siren approach can be utilized for gravitational-wave sources in the […]
Kavli Affiliate: Jie Shan | First 5 Authors: Yiyu Xia, Zhongdong Han, Kenji Watanabe, Takashi Taniguchi, Jie Shan | Summary: Moir’e materials have enabled the realization of flat electron bands and quantum phases that are driven by strong correlations associated with flat bands. Superconductivity has been observed, but solely, in graphene moir’e materials. The absence […]
Kavli Affiliate: Robert Simcoe | First 5 Authors: Charlotte Myers, Kishalay De, Lin Yan, Jacob E. Jencson, Nicholas Earley | Summary: While core-collapse supernovae (SNe) often show early and consistent signs of circumstellar (CSM) interaction, some exhibit delayed signatures due to interaction with distant material around the progenitor star. Here we present the discovery in […]