Skip to content
Imagimob tinyML platform supports quantization of LSTM and other TensorFlow layers

News -

Imagimob tinyML platform supports quantization of LSTM and other TensorFlow layers

Imagimob today announced that its tinyML platform Imagimob AI supports quantization of so-called Long Short-Term Memory (LSTM) layers and a number of other Tensorflow layers. LSTM layers are well-suited to classify, process and make predictions based on time series data, and are therefore of great value when building tinyML applications. The Imagimob AI software with quantization was first shipped to a Fortune Global 500 customer in November, and is since then in production. Currently few other machine learning frameworks/platforms support quantization of LSTM.

Imagimob AI takes a Tensorflow/Keras h5-file and converts it to a single quantized, self-contained, C-code source file and its accompanying header file at the click of a button. No external runtime library is needed.

In tinyML applications, the main reason for quantization is that it reduces memory footprint and reduces the performance requirements on the MCU. That also allows tinyML applications to run on MCUs without a FPU (Floating Point Unit), which means that customers can lower the costs for device hardware.

Quantization refers to techniques for performing computations and storing tensors at lower bit widths than floating point precision. A quantized model executes some or all of the operations on tensors with integers rather than floating point values. This allows for a more compact model representation and the use of high performance vectorized operations on many hardware platforms. This technique is particularly useful at the inference time since it saves a lot of inference computation cost without sacrificing too much inference accuracy. In essence, it’s the process of converting the floating unit based models into integer ones and downgrading the unit resolution from 32 to 16 or 8 bits.

Initial benchmarking of an AI model including LSTM layers between a non-quantized and a quantized model running on an MCU without FPU show that the inference time for the quantized model is around 6 times faster as shown below, and that RAM memory requirements is reduced by 50 % for the quantized model when using 16 bit integer representation.

Further, the quantization algorithm is implemented with great care so that the error between the quantized and non-quantized neural network is kept at a minimum, meaning that argmax errors (misclassifications due to the quantization) rarely happen. This involves solving a difficult optimization problem.

Imagimob AI supported TensorFlow layers for quantization

- Batch Normalization (TensorFlow Class BatchNormalization)

- Convolution 1D (TensorFlow Class Conv1D)

- Dense (TensorFlow Class Dense)

- Dropout (TensorFlow Class Dropout)

- Flatten (TensorFlow Class Flatten)

- Stateless Long Short-Term Memory (TensorFlow Class LSTM)

- Max Pooling 1D (TensorFlow Class MaxPool1D)

- Reshape (TensorFlow Class Reshape)

- Time Distributed (TensorFlow Class TimeDistributed)

Imagimob AI supported TensorFlow activation functions (lookup tables)

- ReLU (TensorFlow Class ReLU)

- Tanh

More layers and activation functions are added continuously.

Imagimob AI software with quantization is available for evaluation. Please send an email to info@imagimob.com and we will get back to you.

Topics

Categories

Contacts

Anders Hardebring

Anders Hardebring

Press contact CEO and Co-Founder +46705910614
Clare Mills

Clare Mills

Press contact Head of Marketing +46702751318

Related content

An edge AI/tinyML company

Imagimob is a fast-growing startup driving innovation at the forefront of Edge AI and tiny machine learning (tinyML), enabling the intelligent products of the future. Based in Stockholm, Sweden, the company has been serving global customers within the automotive, manufacturing, healthcare, and lifestyle industries since 2013. In 2020, Imagimob launched their SaaS Imagimob AI for swift and easy end-to-end development of Edge AI applications for devices with constrained resources, and the newly launched off-the-shelf applications/models can be implemented quickly and easily. Imagimob AI guides and empowers users throughout the entire development journey, resulting in game-changing productivity and faster time-to-market. Tirelessly dedicated to staying on top of the latest research, Imagimob is a market leader within AI and embedded technologies.

In May 2023, Imagimob was acquired by Infineon Technologies AG.

Learn more and sign up to use Imagimob AI at imagimob.com

Imagimob
Medborgarplatsen 3
118 26 Stockholm
Sverige