Counting Ability of Large Language Models and Impact of Tokenization

Kavli Affiliate: Xiang Zhang | First 5 Authors: Xiang Zhang, Juntai Cao, Chenyu You, , | Summary: Transformers, the backbone of modern large language models (LLMs), face inherent architectural limitations that impede their reasoning capabilities. Unlike recurrent networks, Transformers lack recurrent connections, confining them to constant-depth computation. This restriction places them in the complexity class […]


Continue.. Counting Ability of Large Language Models and Impact of Tokenization

Counting Ability of Large Language Models and Impact of Tokenization

Kavli Affiliate: Xiang Zhang | First 5 Authors: Xiang Zhang, Juntai Cao, Chenyu You, , | Summary: Transformers, the backbone of modern large language models (LLMs), face inherent architectural limitations that impede their reasoning capabilities. Unlike recurrent networks, Transformers lack recurrent connections, confining them to constant-depth computation. This restriction places them in the complexity class […]


Continue.. Counting Ability of Large Language Models and Impact of Tokenization

Observation of Quantum Criticality Class Crossover at the LaAlO$_3$/KTaO$_3$ (111) Interface

Kavli Affiliate: Jia Liu | First 5 Authors: Jia Liu, Long Cheng, Junkun Zha, Fei Ye, Xiaofang Zhai | Summary: In two-dimensional (2D) limit, the quantum fluctuation is significantly enhanced which could induce a quantum phase transition. Investigating the quantum criticality is an effective approach to elucidate the underlying physics of 2D superconductivity. Here we […]


Continue.. Observation of Quantum Criticality Class Crossover at the LaAlO$_3$/KTaO$_3$ (111) Interface

Modeling the Superlattice Phase Diagram of Transition Metal Intercalation in Bilayer 2H-TaS$_2$

Kavli Affiliate: Kwabena Bediako| Summary:Van der Waals hosts intercalated with transition metal (TM) ions exhibit a range of magnetic properties strongly influenced by the structural order of the intercalants. However, predictive computational models for the intercalant ordering phase diagram are lacking, complicating experimental pursuits to target key structural phases. Here we use Density Functional Theory […]


Continue.. Modeling the Superlattice Phase Diagram of Transition Metal Intercalation in Bilayer 2H-TaS$_2$

Resurgence of $TbarT$-deformed Partition Function

Kavli Affiliate: Huajia Wang | Summary:We study non-perturbative effects of torus partition function of the $TbarT$-deformed 2d CFTs by resurgence. The deformed partition function can be written as an infinite series of the deformation parameter $λ$. We develop highly efficient methods to compute perturbative coefficients in the $λ$ expansion. To exemplify, the first 600 coefficients […]


Continue.. Resurgence of $TbarT$-deformed Partition Function

A Modulo Sampling Hardware Prototype and Reconstruction Algorithm Evaluation

Kavli Affiliate: Zheng Zhu | First 5 Authors: Jiang Zhu, Junnan Ma, Zhenlong Liu, Fengzhong Qu, Zheng Zhu | Summary: Analog-to-digital converters (ADCs) play a vital important role in any devices via manipulating analog signals in a digital manner. Given that the amplitude of the signal exceeds the dynamic range of the ADCs, clipping occurs […]


Continue.. A Modulo Sampling Hardware Prototype and Reconstruction Algorithm Evaluation

Dynamic strain sensing using Doppler-shift-immune phase-sensitive OFDR with ultra-weak reflection array and frequency-tracking

Kavli Affiliate: Li Xin Li | First 5 Authors: Qiang Yang, Weilin Xie, Congfan Wang, Bowen Li, Xin Li | Summary: In distributed fiber-optic sensing based on optical frequency domain reflectometry (OFDR), Doppler frequency shifts due to the changes of disturbances during one sweep period introduce demodulation errors that accumulate along both the distance and […]


Continue.. Dynamic strain sensing using Doppler-shift-immune phase-sensitive OFDR with ultra-weak reflection array and frequency-tracking

Dynamic strain sensing using Doppler-shift-immune phase-sensitive OFDR with ultra-weak reflection array and frequency-tracking

Kavli Affiliate: Li Xin Li | First 5 Authors: Qiang Yang, Weilin Xie, Congfan Wang, Bowen Li, Xin Li | Summary: In distributed fiber-optic sensing based on optical frequency domain reflectometry (OFDR), Doppler frequency shifts due to the changes of disturbances during one sweep period introduce demodulation errors that accumulate along both the distance and […]


Continue.. Dynamic strain sensing using Doppler-shift-immune phase-sensitive OFDR with ultra-weak reflection array and frequency-tracking

Semi-supervised Chinese Poem-to-Painting Generation via Cycle-consistent Adversarial Networks

Kavli Affiliate: Feng Wang | First 5 Authors: Zhengyang Lu, Tianhao Guo, Feng Wang, , | Summary: Classical Chinese poetry and painting represent the epitome of artistic expression, but the abstract and symbolic nature of their relationship poses a significant challenge for computational translation. Most existing methods rely on large-scale paired datasets, which are scarce […]


Continue.. Semi-supervised Chinese Poem-to-Painting Generation via Cycle-consistent Adversarial Networks

Topological Rigidity and Non-Abelian defect junctions in chiral nematic systems with effective biaxial symmetry

Kavli Affiliate: Mark Bowick | Summary:We study topologically stable defect structures in systems where the defect line classification in three dimensions and associated algebra of interactions (the fundamental group) are governed by the non-Abelian 8-element group, the quaternions Q_8. The non-Abelian character of the defect algebra leads to a topological rigidity of bound defect pairs, […]


Continue.. Topological Rigidity and Non-Abelian defect junctions in chiral nematic systems with effective biaxial symmetry