Hello @jagadesh
I hope you are doing very well.
This behavior is expected. As you can see on the ethosu_device.c driver, the rproc is loading the ETHOSU_FIRMWARE firmware to the Cortex M33.
Why?
This can be confirmed on the i.MX Machine Learning User's Guide, in figure 2:

The Ethos-U runs in the Cortex M33 of i.MX93.

That is the reason why you are having that issue.
I hope this can helps to you.
Best regards,
Salas.