VPU errors when dual-direction video streaming

ripple — Fri, 01 Jun 2012 13:40:51 GMT

I met a dual-direction video streaming question when using camera for video phone application, seems some troubles come from VPU.

I had two i.mx53 board with camera, one's ip is 192.168.0.202, the other's is 192.168.0.210. Used following command line as video streaming receiver:

gst-launch-0.10 -v udpsrc port=5002 ! queue ! capsfilter caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, profile-level-id=(string)420014, payload=(int)96" ! rtph264depay ! mfw_vpudecoder codec-type=std_avc ! queue ! mfw_isink sync=false async=false

Used following command line as video streaming transmitter:

gst-launch-0.10 -v mfw_v4lsrc capture-width=352 capture-height=288 ! queue ! mfw_vpuencoder codec-type=std_avc ! rtph264pay ! queue ! udpsink host=192.168.0.202 port=5002 sync=false async=false

All single direction video communication worked well, but if I used dual direction command line like a video phone, the error came out .

I ran this command line on 192.168.0.102

gst-launch-0.10 -v mfw_v4lsrc capture-width=352 capture-height=288 ! queue ! mfw_vpuencoder codec-type=std_avc ! rtph264pay ! queue ! udpsink host=192.168.0.210 port=5010 sync=false async=false

And ran this command line on 192.168.0.102

gst-launch-0.10 -v udpsrc port=5010 ! queue ! capsfilter caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, profile-level-id=(string)420014, payload=(int)96" ! rtph264depay ! mfw_vpudecoder codec-type=std_avc ! queue ! mfw_isink sync=false async=false &

gst-launch-0.10 -v mfw_v4lsrc capture-width=352 capture-height=288 ! queue ! mfw_vpuencoder codec-type=std_avc ! rtph264pay ! queue ! udpsink host=192.168.0.202 port=5002 sync=false async=false

Both mx53 boards came out such log line text every second:

"[WARN] VPU mutex couldn't be locked before timeout expired"

And the screen freezed and no any video playing.

Can anybody give me some suggestion? Thank you!

Re: VPU errors when dual-direction video streaming

daiane_angolini — Fri, 01 Jun 2012 13:55:14 GMT

Can you, please, see if your vpuencoder / vpudecoder has a loopback property?

gst-inspect mfw_vpudecoder | grep loopback

Re: VPU errors when dual-direction video streaming

ripple — Fri, 01 Jun 2012 14:03:09 GMT

yes, it has, default value is false.

Is it needed to be true? Can you tell me what this property's function is? Some confused by the inspect log line.

Thank you, Daiane!

Re: VPU errors when dual-direction video streaming

daiane_angolini — Fri, 01 Jun 2012 17:26:18 GMT

yes, try it with true (loopback=true)

it will allow gst plugin to create thread properly to configure VPU to have 2 simultaneous instances (one for decoder and one for encoder just like a loopback)

Re: VPU errors when dual-direction video streaming

ripple — Mon, 04 Jun 2012 04:31:35 GMT

Yeah!

The "loopback" parameter worked well in MPEG-4 format streaming.

Still have problem in H.264 streaming. I will trace it in detail.

Lots of thank to Daiane ! :-)

i.MX ProcessorsのトピックRe: VPU errors when dual-direction video streaming

VPU errors when dual-direction video streaming

Re: VPU errors when dual-direction video streaming

Re: VPU errors when dual-direction video streaming

Re: VPU errors when dual-direction video streaming

Re: VPU errors when dual-direction video streaming