topic How to add custom operators in tensorflow Lite? in eIQ Machine Learning Software

How to add custom operators in tensorflow Lite?

Ramson — Thu, 22 Jul 2021 10:50:47 GMT

Hi, we are trying to deploy the open-source object detection model ( https://www.tensorflow.org/lite/examples/object_detection/overview) on iMX.RT.1176 evk kit. We imported the tensorflow_lite_label_image example from the SDK v2.9.0. We have converted the object detection model .tflite file to c array using xxd. and replaced the model data and model length in the model_data.h file.

The object detection model contains custom operator TFLite_Detection_PostProcess as show below in the image.

How to add the custom operator to the tflite::MutableOpResolver ?

Since its not added, we are getting the following error:

ERROR: Encountered unresolved custom op: TFLite_Detection_PostProcess.

ERROR: Node number 63 (TFLite_Detection_PostProcess) failed to prepare.

Failed to allocate tensors!

Failed initializing model

Please help. Thanks in Advance

Regards,

Ramson

Re: How to add custom operators in tensorflow Lite?

david_piskula — Tue, 10 Aug 2021 09:18:55 GMT

Hello Ramson,

my first suggestion would be to move to SDK 2.10, as it contains all of the latest updates. With 2.10 we moved from TF Lite to TF Lite Micro, which is better optimized for MCUs. The inference engine still supports TF Lite models, it's just the computations and the library that are specifically optimized for ARM MCUs.

Next, switch to the AllOpsResolver first, to make sure the operation is actually supported by TF Lite (Micro). If that works, then you can open the ops cpp file in the source/model folder, register all the required ops and remove all the unnecessary ones.

If that fails, the only option left would be to implement or port an existing implementation of the operation into the tensorflow lite library.

Regards,

David

Re: How to add custom operators in tensorflow Lite?

Ramson — Tue, 24 Aug 2021 13:21:23 GMT

Thanks for your suggestion @david_piskula . Since the operator is not present. As you said i have ported the existing implementation of the operator. Thanks again

Re: How to add custom operators in tensorflow Lite?

MarcinChelminsk — Mon, 04 Oct 2021 12:30:31 GMT

@david_piskula @Ramson