Kavli Affiliate: Wei Gao | First 5 Authors: Kai Huang, Wei Gao, , , | Summary: With the wide adoption of AI applications, there is a pressing need of enabling real-time neural network (NN) inference on small embedded devices, but deploying NNs and achieving high performance of NN inference on these small devices is challenging […]
Continue.. Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI