imx53qsb combine graphics and video with color key

[mykoladudik]

Hi,

I'am trying to combine graphics from /dev/fb0 (BGRA32) with video output from gstreamer (NV12) using IPU. /dev/fb0 memory is set as "overlay" with color key enabled. video frame accessed via v4l2 API and is set as "input". If i perform overlay combination into BGR/BGRA/RGB/RGBA output format I get correct "output" frame with video and graphics combined. If I perform overlay combination into YUV444/YUV444P I get correct graphics on output but bad video data. Actually YUV444P is required for further processing to jpeg image via VPU and sending over network. I could do combination to RGB and then convert whole frame to YUV444P and it works fine. But it significantly decrease count of frames per second I can get.

Is there an possibility to do combination is single step with YUV444P output? May be color key value is not correct?

Thanks

Nick

[jack_mao · Accepted solution]

As I know our VPU only support YUV4:2:0 for most of video format, only MJPEG can support to 4:2:2 or 4:4:4

[max_tsai]

hi Nick,

Can I have your test code to verify the configuration? Thanks.

-Max

[mykoladudik]

Thanks for reply.

I'm trying to use hw acceleration for tigervnc. He is the patch.

[max_tsai]

Thanks for you response.

Checked your configuration for overlay. YUV444P is not accepted by IPU HAL/driver.  Can YUV444 meet your requirement?

[mykoladudik]

It depends whether VPU can accept YUV444 as input for making JPEG. As far as I know it can't.

[karina_valencia]

hi Nick,

Could you provide the test steps to output YUV overlay? Thanks,

Max