Memory-efficient inference with XNNPack weights cache

Posted by Zhi An Ng and Marat Dukhan, Google XNNPack is the default TensorFlow Lite CPU inference engine for floating-point models, and delivers meaningful speedups across mobile, desktop, and...