VPU use in xfreerdp

[shlomz]

Hi,

what plugin/s and changes are required for xfreerdp (2.8.1 or later) to use the VPU

on imx8mp for decoding incoming h.264 video frames?

thanks.

[Bio_TICFSL]

Hello,

Well, that depends on a lot of things:

1. you need to have a session utilizing AVC444 mode (both, client and server! if only the client announces the format support it is not guaranteed that the server will use it)
2. you need FFMPEG as h264 decoder as that one has some versions that utilize some hardware backed decoders (and you need to have one of these versions)

so, in case you have this FFMPEG the answer is: a little bit, otherwise no.
Why? RDP utilizes a non standard stream (2 H264 streams in YUV 4:2:2 mode recombined to one YUV4:4:4 image) so the decoded images must be copied back to system memory and the expensive operations are still done by the Core

so, if you have not enough Core you can ensure you utilize hardware accelerated SSL(that is actually the thing eating most Core with FreeRDP

You can check the note about share screen with freerdp:

https://community.nxp.com/t5/i-MX-Processors-Knowledge-Base/i-MX8DXL-screen-share-to-PC-by-using-Fre...

Regards

[shlomz]

I'm building the imx8mp image from yocto langdale (kernel 6.1) and I have ffmpeg installed (with libs)

Is there a specific way to build ffmpeg for that reason?

What switches other than AVC444 does xfreerdp requires? (gdi:hw ?)

I also updated free rdp to 3.x from the standard 2.8.1

[Bio_TICFSL]

Hello,

You can try the VPE plugin (used with ffmpeg) in following repositories from VeriSilicon, partner of NXP that provides Hantro VC8000D/VC8000E found in i.MX8MP : 

https://github.com/VeriSilicon/vpe

https://github.com/VeriSilicon/ffmpeg

It seems that they tested on iMX8MP.

Regards

[shlomz]

HI,

ffmpeg from the link is not being configured succesfully (pkg-config and other issues).

can you verify the fulle build?

thanks.