Decomposing The Dark Matter of Sparse Autoencoders

Kavli Affiliate: Max Tegmark | First 5 Authors: Joshua Engels, Logan Riggs, Max Tegmark, , | Summary: Sparse autoencoders (SAEs) are a promising technique for decomposing language model activations into interpretable linear features. However, current SAEs fall short of completely explaining model performance, resulting in "dark matter": unexplained variance in activations. This work investigates dark […]


Continue.. Decomposing The Dark Matter of Sparse Autoencoders

Decomposing The Dark Matter of Sparse Autoencoders

Kavli Affiliate: Max Tegmark | First 5 Authors: Joshua Engels, Logan Riggs, Max Tegmark, , | Summary: Sparse autoencoders (SAEs) are a promising technique for decomposing language model activations into interpretable linear features. However, current SAEs fall short of completely explaining model performance, resulting in "dark matter": unexplained variance in activations. This work investigates dark […]


Continue.. Decomposing The Dark Matter of Sparse Autoencoders

A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

Kavli Affiliate: Nathan P. Lourie | First 5 Authors: Geoffrey Mo, Kishalay De, Eli Wiston, Nayana A. J., Raffaella Margutti | Summary: Type Ia supernovae arise from the thermonuclear explosions of white dwarfs in multiple star systems. A rare sub-class of SNe Ia exhibit signatures of interaction with circumstellar material (CSM), allowing for direct constraints […]


Continue.. A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

Kavli Affiliate: Nathan P. Lourie | First 5 Authors: Geoffrey Mo, Kishalay De, Eli Wiston, Nayana A. J., Raffaella Margutti | Summary: Type Ia supernovae arise from the thermonuclear explosions of white dwarfs in multiple star systems. A rare sub-class of SNe Ia exhibit signatures of interaction with circumstellar material (CSM), allowing for direct constraints […]


Continue.. A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

Kavli Affiliate: Nathan P. Lourie | First 5 Authors: Geoffrey Mo, Kishalay De, Eli Wiston, Nayana A. J., Raffaella Margutti | Summary: Type Ia supernovae arise from the thermonuclear explosions of white dwarfs in multiple star systems. A rare sub-class of SNe Ia exhibit signatures of interaction with circumstellar material (CSM), allowing for direct constraints […]


Continue.. A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

Kavli Affiliate: Nathan P. Lourie | First 5 Authors: Geoffrey Mo, Kishalay De, Eli Wiston, Nayana A. J., Raffaella Margutti | Summary: Type Ia supernovae arise from the thermonuclear explosions of white dwarfs in multiple star systems. A rare sub-class of SNe Ia exhibit signatures of interaction with circumstellar material (CSM), allowing for direct constraints […]


Continue.. A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

Kavli Affiliate: Nathan P. Lourie | First 5 Authors: Geoffrey Mo, Kishalay De, Eli Wiston, Nayana A. J., Raffaella Margutti | Summary: Type Ia supernovae arise from the thermonuclear explosions of white dwarfs in multiple star systems. A rare sub-class of SNe Ia exhibit signatures of interaction with circumstellar material (CSM), allowing for direct constraints […]


Continue.. A diverse, overlooked population of Type Ia supernovae exhibiting mid-infrared signatures of delayed circumstellar interaction

Black Holes Inside and Out 2024: visions for the future of black hole physics

Kavli Affiliate: Misao Sasaki | First 5 Authors: Niayesh Afshordi, Abhay Ashtekar, Enrico Barausse, Emanuele Berti, Richard Brito | Summary: The gravitational physics landscape is evolving rapidly, driven by our ability to study strong-field regions, in particular black holes. Black Holes Inside and Out gathered world experts to discuss the status of the field and […]


Continue.. Black Holes Inside and Out 2024: visions for the future of black hole physics

HD 28185 Revisited: An Outer Planet, Instead of a Brown Dwarf, On a Saturn-like Orbit

Kavli Affiliate: Andrew Vanderburg | First 5 Authors: Alexander Venner, Qier An, Chelsea X. Huang, Timothy D. Brandt, Robert A. Wittenmyer | Summary: As exoplanet surveys reach ever-higher sensitivities and durations, planets analogous to the solar system giant planets are increasingly within reach. HD 28185 is a Sun-like star known to host a $msin i=6 […]


Continue.. HD 28185 Revisited: An Outer Planet, Instead of a Brown Dwarf, On a Saturn-like Orbit

Supervised Chain of Thought

Kavli Affiliate: Xiang Zhang | First 5 Authors: Xiang Zhang, Dujian Ding, , , | Summary: Large Language Models (LLMs) have revolutionized natural language processing and hold immense potential for advancing Artificial Intelligence. However, the core architecture of most mainstream LLMs — the Transformer — has inherent limitations in computational depth, rendering them theoretically incapable […]


Continue.. Supervised Chain of Thought