LLM / VLM Edge Studio - Display Inference Metrics Failure

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

LLM / VLM Edge Studio - Display Inference Metrics Failure

LLM / VLM Edge Studio - Display Inference Metrics Failure

Applies to: LLM / VLM Edge Studio Go Point Demo
Workaround: Update demos via deb package

In the current BSP release, users may encounter a runtime failure when the requesting inference metrics after running an inference in the LLM / VLM Edge Studio demo, as a result, metrics are not displayed at all. This issue is caused by a change in the metrics response format from the AAF Connector, which is not compatible with the current demo version. 

To fix, update the demo by installed the patched Debian package attached to this thread. 

- Download and copy deb packages to target board: 

scp vlm-edge-studio_1.0.1.deb root@10.112.102.87:
scp llm-edge-studio_2.0.1.deb root@10.112.102.87:


- Overwrite the demo installation:

dpkg -i --force-overwrite vlm-edge-studio_1.0.1.deb
dpkg -i --force-overwrite llm-edge-studio_2.0.1.deb


BR,

Labels (2)
Attachments
No ratings
Version history
Last update:
yesterday
Updated by: