Multimodal Learning with Channel-Mixing and Masked Autoencoder on Facial Action Unit Detection

Kavli Affiliate: Xiang Zhang | First 5 Authors: Xiang Zhang, Huiyuan Yang, Taoyue Wang, Xiaotian Li, Lijun Yin | Summary: Recent studies utilizing multi-modal data aimed at building a robust model for facial Action Unit (AU) detection. However, due to the heterogeneity of multi-modal data, multi-modal representation learning becomes one of the main challenges. On […]


Continue.. Multimodal Learning with Channel-Mixing and Masked Autoencoder on Facial Action Unit Detection

Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection

Kavli Affiliate: Xiang Zhang | First 5 Authors: Xiang Zhang, Huiyuan Yang, Taoyue Wang, Xiaotian Li, Lijun Yin | Summary: Recent studies have focused on utilizing multi-modal data to develop robust models for facial Action Unit (AU) detection. However, the heterogeneity of multi-modal data poses challenges in learning effective representations. One such challenge is extracting […]


Continue.. Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection

Nonequilibrium design strategies for functional colloidal assemblies

Kavli Affiliate: David T. Limmer | First 5 Authors: Avishek Das, David T. Limmer, , , | Summary: We use a nonequilibrium variational principle to optimize the steady-state, shear-induced interconversion of self-assembled nanoclusters of DNA-coated colloids. Employing this principle within a stochastic optimization algorithm allows us to discover design strategies for functional materials. We find […]


Continue.. Nonequilibrium design strategies for functional colloidal assemblies

Nonequilibrium design strategies for functional colloidal assemblies

Kavli Affiliate: David T. Limmer | First 5 Authors: Avishek Das, David T. Limmer, , , | Summary: We use a nonequilibrium variational principle to optimize the steady-state, shear-induced interconversion of self-assembled nanoclusters of DNA-coated colloids. Employing this principle within a stochastic optimization algorithm allows us to discover design strategies for functional materials. We find […]


Continue.. Nonequilibrium design strategies for functional colloidal assemblies

Revealing the order parameter dynamics of 1T-TiSe$_2$ following optical excitation

Kavli Affiliate: Alessandra Lanzara | First 5 Authors: Maximilian Huber, Yi Lin, Nicholas Dale, Renee Sailus, Sefaattin Tongay | Summary: The formation of a charge density wave state is characterized by an order parameter. The way it is established provides unique information on both the role that correlation plays in driving the charge density wave […]


Continue.. Revealing the order parameter dynamics of 1T-TiSe$_2$ following optical excitation

Communication-Efficient and Privacy-Preserving Feature-based Federated Transfer Learning

Kavli Affiliate: Feng Wang | First 5 Authors: Feng Wang, M. Cenk Gursoy, Senem Velipasalar, , | Summary: Federated learning has attracted growing interest as it preserves the clients’ privacy. As a variant of federated learning, federated transfer learning utilizes the knowledge from similar tasks and thus has also been intensively studied. However, due to […]


Continue.. Communication-Efficient and Privacy-Preserving Feature-based Federated Transfer Learning

MetaNetwork: A Task-agnostic Network Parameters Generation Framework for Improving Device Model Generalization

Kavli Affiliate: Feng Wang | First 5 Authors: Zheqi Lv, Feng Wang, Kun Kuang, Yongwei Wang, Zhengyu Chen | Summary: Deploying machine learning models on mobile devices has gained increasing attention. To tackle the model generalization problem with the limitations of hardware resources on the device, the device model needs to be lightweight by techniques […]


Continue.. MetaNetwork: A Task-agnostic Network Parameters Generation Framework for Improving Device Model Generalization

DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization

Kavli Affiliate: Feng Wang | First 5 Authors: Zheqi Lv, Wenqiao Zhang, Shengyu Zhang, Kun Kuang, Feng Wang | Summary: Device Model Generalization (DMG) is a practical yet under-investigated research topic for on-device machine learning applications. It aims to improve the generalization ability of pre-trained models when deployed on resource-constrained devices, such as improving the […]


Continue.. DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization

Platform-agnostic waveguide integration of high-speed photodetectors with evaporated tellurium thin films

Kavli Affiliate: Ali Javey | First 5 Authors: Geun Ho Ahn, Alexander D. White, Hyungjin Kim, Naoki Higashitarumizu, Felix M. Mayor | Summary: Many attractive photonics platforms still lack integrated photodetectors due to inherent material incompatibilities and lack of process scalability, preventing their widespread deployment. Here we address the problem of scalably integrating photodetectors in […]


Continue.. Platform-agnostic waveguide integration of high-speed photodetectors with evaporated tellurium thin films

High-throughput optical absorption spectra for inorganic semiconductors

Kavli Affiliate: Kristin A. Persson | First 5 Authors: Ruo Xi Yang, Matthew K. Horton, Jason Munro, Kristin A. Persson, | Summary: An optical absorption spectrum constitutes one of the most fundamental material characteristics, with relevant applications ranging from material identification to energy harvesting and optoelectronics. However, the database of both experimental and computational spectra […]


Continue.. High-throughput optical absorption spectra for inorganic semiconductors