Fully binarised convolutional neural networks (CNNs) deliver very high inference performance using single-bit weights and activations, together with XNOR type operators for the kernel convolutions. Current research shows that full binarisation results in a degradation of accuracy and different approaches to tackle this issue are being investigated such as using more complex models as accuracy reduces. This paper proposes an alternative based on a multi-precision CNN frame-work that combines a binarised and a floating point CNN in a pipeline configuration deployed on heterogeneous hardware. The binarised CNN is mapped onto an FPGA device and used to perform inference over the whole input set while the floating point network is mapped onto a CPU device and performs re-inference only when the classification confidence level is low. A light-weight confidence mechanism enables a flexible trade-off between accuracy and throughput. To demonstrate the concept, we choose a Zynq 7020 device as the hardware target and show that the multi-precision network is able to increase the BNN accuracy from 78.5% to 82.5% and the CPU inference speed from 29.68 to 90.82 images/sec.
|Title of host publication||Design, Automation & Test in Europe Conference & Exhibition (DATE)|
|Number of pages||6|
|Publication status||Published - Mar 2018|
|Event|| DATE - Design, Automation and Test in Europe Conference - Dresden, Germany|
Duration: 19 Mar 2018 → 23 Mar 2018
|Conference||DATE - Design, Automation and Test in Europe Conference|
|Abbreviated title||DATE 2018|
|Period||19/03/18 → 23/03/18|
Bibliographical note© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
- Convolutional Neural Network
- deep learning
Amiri, S., Hosseinabady, M., McIntosh-Smith, S., & Nunez-Yanez, J. (2018). Multi-precision convolutional neural networks on heterogeneous hardware. In Design, Automation & Test in Europe Conference & Exhibition (DATE) (pp. 419-424). (Date Proceedings ). IEEE. https://doi.org/10.23919/DATE.2018.8342046