Kavli Affiliate: Dheeraj R. Pasham | First 5 Authors: Eric Burns, Christopher L. Fryer, Ivan Agullo, Jennifer Andrews, Elias Aydi | Summary: Astrophysical observations of the cosmos allow us to probe extreme physics and answer foundational questions on our universe. Modern astronomy is increasingly operating under a holistic approach, probing the same question with multiple […]
Kavli Affiliate: Max Tegmark | First 5 Authors: David D. Baek, Ziming Liu, Riya Tyagi, Max Tegmark, | Summary: In this paper, we introduce **harmonic loss** as an alternative to the standard cross-entropy loss for training neural networks and large language models (LLMs). Harmonic loss enables improved interpretability and faster convergence, owing to its scale […]
Kavli Affiliate: Max Tegmark | First 5 Authors: David D. Baek, David D. Baek, , , | Summary: In this paper, we introduce harmonic loss as an alternative supervisory signal for training neural networks and large language models (LLMs). Harmonic loss differs from standard cross-entropy loss by (a) replacing the usual SoftMax normalization with a […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Subhash Kantamneni, Max Tegmark, , , | Summary: Mathematical reasoning is an increasingly important indicator of large language model (LLM) capabilities, yet we lack understanding of how LLMs process even simple mathematical tasks. To address this, we reverse engineer how three mid-sized LLMs compute addition. We first […]
Kavli Affiliate: Gabor Furesz | First 5 Authors: Christopher Layden, Jill Juneau, Gustav Pettersson, Nathan Lourie, Benjamin Schneider | Summary: The Teledyne COSMOS-66 is a next-generation CMOS camera designed for astronomical imaging, featuring a large-format sensor ($8120 times 8120$ pixels, each $10 mu m$), high quantum efficiency, high frame rates, and a correlated multi-sampling mode […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Matthew Chen, Joshua Engels, Max Tegmark, , | Summary: Sparse autoencoders (SAEs) decompose language model representations into a sparse set of linear latent vectors. Recent works have improved SAEs using language model gradients, but these techniques require many expensive backward passes during training and still cause a […]
Kavli Affiliate: Michael McDonald | First 5 Authors: Alex Thomas, Natalie LeBaron, Luca Angeleri, Phillip Morgan, Varun Iyer | Summary: We discuss our transient search for directed energy systems in local galaxies, with calculations indicating the ability of modest searches to detect optical Search for Extraterrestrial Intelligence (SETI) sources in the closest galaxies. Our analysis […]
Kavli Affiliate: Michael McDonald | First 5 Authors: Alex Thomas, Natalie LeBaron, Luca Angeleri, Phillip Morgan, Varun Iyer | Summary: We discuss our transient search for directed energy systems in local galaxies, with calculations indicating the ability of modest searches to detect optical Search for Extraterrestrial Intelligence (SETI) sources in the closest galaxies. Our analysis […]
Kavli Affiliate: Michael McDonald | First 5 Authors: , , , , | Summary: We discuss our transient search for directed energy systems in local galaxies, with calculations indicating the ability of modest searches to detect optical Search for Extraterrestrial Intelligence (SETI) sources in the closest galaxies. Our analysis follows Lubin (2016) where a messenger […]
Kavli Affiliate: Michael McDonald | First 5 Authors: Alex Thomas, Natalie LeBaron, Luca Angeleri, Samuel Whitebook, Rachel Darlinger | Summary: We present the TRansient Image Processing Pipeline (TRIPP), a transient and variable source detection pipeline that employs both difference imaging and light curve analysis techniques for astronomical data. Additionally, we demonstrate TRIPP’s rapid analysis capability […]