Inference speed and quantisation of neural networks with TensorFlow Lite for Microcontrollers framework (CROSBI ID 696041)
Prilog sa skupa u zborniku | izvorni znanstveni rad | međunarodna recenzija
Podaci o odgovornosti
Đokić, Kristian ; Martinović, Marko ; Mandušić, Dubravka
engleski
Inference speed and quantisation of neural networks with TensorFlow Lite for Microcontrollers framework
In the last few years, microcontrollers became more and more powerful, and many authors have started to use them for different machine learning projects. One of the most popular frameworks for machine learning is TensorFlow, and their authors began to develop this framework for microcontrollers. The goal of this paper is to analyses the full connected neural networks inference speed depending on the number of neurons of one popular microcontroller (Arduino Nano 33 BLE Sense) with simple neural networks implementation, as well as the impact of neural network weights quantisation. We expected a reduction in the size of the model with the selected quantization by four times, which was achieved, but with a large number of neurons in the neural network. TensorFlow Lite for Microcontrollers is used with the Arduino Integrated Development Environment. Neural networks with two hidden layers are used with a different number of neurons.
Propagation speed ; Quantisation ; Arduino ; Microcontrollers ; neural network
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
nije evidentirano
Podaci o prilogu
1-6.
2020.
objavljeno
10.1109/SEEDA-CECNSM49515.2020.9221846
Podaci o matičnoj publikaciji
Proceedings of 2020 5th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM)
Lahti: Institute of Electrical and Electronics Engineers (IEEE)
978-1-7281-6445-8
Podaci o skupu
5th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM 2020)
predavanje
25.09.2020-27.09.2020
Krf, Grčka
Povezanost rada
Informacijske i komunikacijske znanosti, Računarstvo