Tackling Intertwined Data and Device Heterogeneities in Federated Learning with Unlimited Staleness

Kavli Affiliate: Wei Gao | First 5 Authors: Haoming Wang, Wei Gao, , , | Summary: Federated Learning (FL) can be affected by data and device heterogeneities, caused by clients’ different local data distributions and latencies in uploading model updates (i.e., staleness). Traditional schemes consider these heterogeneities as two separate and independent aspects, but this […]


Continue.. Tackling Intertwined Data and Device Heterogeneities in Federated Learning with Unlimited Staleness

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Kavli Affiliate: Wei Gao | First 5 Authors: Kai Huang, Hanyun Yin, Heng Huang, Wei Gao, | Summary: Fine-tuning is the most effective way of adapting pre-trained large language models (LLMs) to downstream applications. With the fast growth of LLM-enabled AI applications and democratization of open-souced LLMs, fine-tuning has become possible for non-expert individuals, but […]


Continue.. Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Kavli Affiliate: Wei Gao | First 5 Authors: Kai Huang, Hanyun Yin, Heng Huang, Wei Gao, | Summary: Fine-tuning is the most effective way of adapting pre-trained large language models (LLMs) to downstream applications. With the fast growth of LLM-enabled AI applications and democratization of open-souced LLMs, fine-tuning has become possible for non-expert individuals, but […]


Continue.. Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Deep Learning with Photonic Neural Cellular Automata

Kavli Affiliate: Alireza Marandi | First 5 Authors: Gordon H. Y. Li, Christian R. Leefmans, James Williams, Robert M. Gray, Midya Parto | Summary: Rapid advancements in deep learning over the past decade have fueled an insatiable demand for efficient and scalable hardware. Photonics offers a promising solution by leveraging the unique properties of light. […]


Continue.. Deep Learning with Photonic Neural Cellular Automata

ICM-SHOX. Paper I: Methodology overview and discovery of a gas–dark matter velocity decoupling in the MACS J0018.5+1626 merger

Kavli Affiliate: Sunil Golwala | First 5 Authors: Emily M. Silich, Elena Bellomi, Jack Sayers, John ZuHone, Urmila Chadayammuri | Summary: Galaxy cluster mergers are rich sources of information to test cluster astrophysics and cosmology. However, cluster mergers produce complex projected signals that are difficult to interpret physically from individual observational probes. Multi-probe constraints on […]


Continue.. ICM-SHOX. Paper I: Methodology overview and discovery of a gas–dark matter velocity decoupling in the MACS J0018.5+1626 merger

Taking the Milky Way for a spin: disc formation in the ARTEMIS simulations

Kavli Affiliate: Andrey Kravtsov | First 5 Authors: Adam M. Dillamore, Vasily Belokurov, Andrey Kravtsov, Andreea S. Font, | Summary: We investigate the formation (spin-up) of galactic discs in the ARTEMIS simulations of Milky Way-mass galaxies. In almost all galaxies discs spin up at higher [Fe/H] than the Milky Way (MW). Those that contain an […]


Continue.. Taking the Milky Way for a spin: disc formation in the ARTEMIS simulations

Taking the Milky Way for a spin: disc formation in the ARTEMIS simulations

Kavli Affiliate: Andrey Kravtsov | First 5 Authors: Adam M. Dillamore, Vasily Belokurov, Andrey Kravtsov, Andreea S. Font, | Summary: We investigate the formation (spin-up) of galactic discs in the ARTEMIS simulations of Milky Way-mass galaxies. In almost all galaxies discs spin up at higher [Fe/H] than the Milky Way (MW). Those that contain an […]


Continue.. Taking the Milky Way for a spin: disc formation in the ARTEMIS simulations

Cosmological Implications of Kalb-Ramond-Like-Particles

Kavli Affiliate: Edward W. Kolb | First 5 Authors: Christian Capanelli, Leah Jenks, Edward W. Kolb, Evan McDonough, | Summary: The Kalb-Ramond field is an antisymmetric, rank-two tensor field which most notably appears in the context of string theory, but has largely been unexplored in the context of cosmology. In this work, motivated by the […]


Continue.. Cosmological Implications of Kalb-Ramond-Like-Particles

Cosmological Implications of Kalb-Ramond-Like-Particles

Kavli Affiliate: Edward W. Kolb | First 5 Authors: Christian Capanelli, Leah Jenks, Edward W. Kolb, Evan McDonough, | Summary: The Kalb-Ramond field is an antisymmetric, rank-two tensor field which most notably appears in the context of string theory, but has largely been unexplored in the context of cosmology. In this work, motivated by the […]


Continue.. Cosmological Implications of Kalb-Ramond-Like-Particles