Hi, I'm trying to stream two cameras(MIPI camera and a USB camera) at the same time to a single display so as to create a stereoscopic video and of course i have to save the output to a file if necessary. I've been successfully able to do this using the gstreamer pipeline as follows :
gst-launch-0.10 -v \
videomixer name=mix ! mfw_v4lsink sync=false \
v4l2src device=/dev/video0 ! video/x-raw-yuv,width=640,height=480,framerate=30/1 ! ffmpegcolorspace ! videobox fill=2 border-alpha=0 top=0 left=0 bottom=0 right=0 ! mix. \
mfw_v4lsrc device=/dev/video1 capture-mode=0 fps-n=30 fps-d=1 ! ffmpegcolorspace ! videobox fill=1 border-alpha=0 top=0 left=-640 bottom=0 right=0 ! mix.
As you can see from the above pipeline I've used two videoboxes for the two camera streams and using a videomixer element, I've integrated the two streams to a single stream and I'm able to view the output on the display. I can even encode the integrated video stream now using vpuenc and save it to a file of my choice. But the problem is that a lot of frames are being dropped when I use the videobox and videomixer elements to do this. Previously I had obtained the same output by creating two overlays using mfw_isink. But I could only view the stream on the display and not encode to a file or do a network stream. The pipeline I used is as follows :
gst-launch-0.10 -v \
v4l2src device=/dev/video0 ! video/x-raw-yuv,width=640,height=480,framerate=30/1 ! mfw_isink axis-left=0 axis-top=0 disp-width=800 disp-height=900 \
mfw_v4lsrc device=/dev/video1 capture-mode=0 fps-n=30 fps-d=1 ! mfw_isink axis-top=0 axis-left=800 disp-width=800 disp-height=900
Now to my actual problem :
Note :
Any comments or suggestions would be very much helpful. Thank you.
P.S :
It would be really great if the guys at freescale released an update to the package gst-fsl-plugins with an IPU based videobox and videomixer just like the IPU based video sink (mfw_isink) FranciscoCarrillo LeonardoSandovalGonzalez xiaoli.zhang
Dilip Kumar,
Did you ever get any answer to this? I have a similar request from a user who wants to take advantage of the IMX6 hardware (VPU/IPU/GPU) to composite multiple sources into a single stream. I'm curious if any of the elements provided by the gstreamer-imx project (Freescale/gstreamer-imx · GitHub) help with this?
Tim
Did any of you guys ever figure out a solution to this?
I too have this exact problem, would love any insight or direction. Ideally, a VPU/IPU-based videobox element would solve this (and many other) problems.
bump. Similar application from me. FranciscoCarrillo LeonardoSandovalGonzalez xiaoli.zhang