For me it seems that the tensorflow lite example delegated to the NPU is getting slower.
With latest BSP (Kernel 6.1) it takes around 50% longer. Any reason?
There is an update to L6.1.1_1.0.1 - maybe it contains a fix. If you test this, let us know.
Ok, found in Machine Learning User Guide:
"Known issue: Decreased performance on MobilenetV1, MobileNetV2, VGG16, VGG19, and NasNet Mobile"
But why?
Hi @arno_0
Maybe the VX delegate haven't been updated to compatible with the new features.
You can use the L5.15.X and we will fix this known issue in next release.
@Zhiming_Liu : do you have any updates on:
1) the root cause of this performance regression
2) any potential workarounds, if kernel 6.1 needs to be used
3) timeline for a fix of the performance regression
I'm answering the question myself: new release (LF6.1.22_2.0.0) is out which claims to include a fix for the decreased performance (not verified yet if actually true)
@Zhiming_Liu : thanks for the support, and quick response.
Hello,
I will also have to use L6.1.x together with a performance-critical application using the NPU: can you please elaborate what "Maybe the VC delegate haven't been updated" exactly means?
When will the release containing the fix that you mentioned be available?