Yocto and OpenCV for I.MX

[ssinfod]

I'm planning to use OpenCV in a Yocto distribution for a I.MX 5 or I.MX 6 board. (I have the following: I.MX 53 QSB or I.MX6 sabrelite (BD-SL-i.MX6) or Wandboard)

Do you know if that is supported ? What image should I use ?

If not what is the package to use ?

In short, I want to create a software that is recording image from a webcam or CSI camera. (and possibly doing some processing with OpenCV)

Can I do this task with Yocto and the I.MX hardware ?

Thanks

ssinfod

[ashab]

Hi,

I tried building yocto (core-image-minimal) for imx6 with opencv in it. But I have encountered "unzip-native / unzip_6.0 do_compile failed" error. can any one suggest on how to overcome this problem?

Awaiting reply, Thanks in advance!

[daiane_angolini]

I don't know this error. Do you have the complete log?

[alper]

Thank you for reply.

Then i should do copy-paste after we should use bitbake opencv right?

Regards.

Alper

[LuisCasado]

Hi,

Add the two lines in your conf

MACHINE ??= 'imx6qsabresd'

DISTRO ?= 'poky'

PACKAGE_CLASSES ?= "package_rpm"

EXTRA_IMAGE_FEATURES = "debug-tweaks dev-pkgs"

CORE_IMAGE_EXTRA_INSTALL += "gpu-viv-bin-mx6q gpu-viv-bin-mx6q-dev"

CORE_IMAGE_EXTRA_INSTALL += "libopencv-core-dev libopencv-highgui-dev libopencv-imgproc-dev libopencv-objdetect-dev libopencv-ml-dev"

USER_CLASSES ?= "buildstats image-mklibs image-prelink"

PATCHRESOLVE = "noop"

BB_DISKMON_DIRS = "\

STOPTASKS,${TMPDIR},1G,100K \

STOPTASKS,${DL_DIR},1G,100K \

STOPTASKS,${SSTATE_DIR},1G,100K \

ABORT,${TMPDIR},100M,1K \

ABORT,${DL_DIR},100M,1K \

ABORT,${SSTATE_DIR},100M,1K"

PACKAGECONFIG_pn-qemu-native = "sdl"

ASSUME_PROVIDED += "libsdl-native"

CONF_VERSION = "1"

BB_NUMBER_THREADS = '4'

PARALLEL_MAKE = '-j 4'

DL_DIR ?= "${BSPDIR}/downloads/"

ACCEPT_FSL_EULA = ""

LICENSE_FLAGS_WHITELIST = "commercial"

Build your image (bitbake <image>

And your rootfs will include all the need libraries to Run OpenCV applications.

Luis

[alper]

Thank you.

Alright. I want to use SDK for opencv.. Which SDK do you advice me?

Alper

[LuisCasado]

Hi,

You should generate and install your SDK for your image.

bitbake -c populate_sdk <image_name>

Luis

[alper]

Hi,

How can i enable opencv? I did bitbake opencv but i didnt see like:

  MACHINE ??= 'imx6qsabresd'

    DISTRO ?= 'poky'

    PACKAGE_CLASSES ?= "package_rpm"

    EXTRA_IMAGE_FEATURES = "debug-tweaks dev-pkgs"

    USER_CLASSES ?= "buildstats image-mklibs image-prelink"

    PATCHRESOLVE = "noop"

    BB_DISKMON_DIRS = "\

    STOPTASKS,${TMPDIR},1G,100K \

    STOPTASKS,${DL_DIR},1G,100K \

    STOPTASKS,${SSTATE_DIR},1G,100K \

    ABORT,${TMPDIR},100M,1K \

    ABORT,${DL_DIR},100M,1K \

    ABORT,${SSTATE_DIR},100M,1K"

    PACKAGECONFIG_pn-qemu-native = "sdl"

    ASSUME_PROVIDED += "libsdl-native"

    CONF_VERSION = "1"

    BB_NUMBER_THREADS = '4'

    PARALLEL_MAKE = '-j 4'

    DL_DIR ?= "${BSPDIR}/downloads/"

    ACCEPT_FSL_EULA = ""

    CORE_IMAGE_EXTRA_INSTALL += "gpu-viv-bin-mx6q gpu-viv-bin-mx6q-dev"

    CORE_IMAGE_EXTRA_INSTALL += "libopencv-core-dev libopencv-highgui-dev

libopencv-imgproc-dev libopencv-objdetect-dev libopencv-ml-dev"

    LICENSE_FLAGS_WHITELIST = "commercial"

What should i do?

Regards.

Alper Kağıtcı

[LuisCasado]

Hello,

You can add in local.conf:

CORE_IMAGE_EXTRA_INSTALL += "libopencv-core-dev libopencv-highgui-dev libopencv-imgproc-dev libopencv-objdetect-dev libopencv-ml-dev"

CORE_IMAGE_EXTRA_INSTALL += "opencv-apps opencv-dev python-opencv python-modules”

And bitbake the image.

Luis

[andre_silva]

you can use this tutorial to go through it step by step:

http://imxcv.blogspot.com.br/2014/02/building-opencv-24x-for-freescales-imx6.html

regards,

Andre

[gonewithwind]

hi Andre,

Hi, I am using imx6dlsabresd development board, not usb camera. I want to use gstreamer in opencv like that:

=======================code

int main(int, char**)
{

VideoCapture cap("gst-launch-1.0 imxv4l2src ! autovideosink ! appsink");
if(!cap.isOpened()) { // check if we succeeded
return -1;
}
for(;;)
{
Mat frame;

cap >> frame; // get a new frame from camera
imshow("original", frame);
waitKey(1);
}
// the camera will be deinitialized automatically in VideoCapture destructor
cap.release();

}

======================= code end.

but It only show a static image. not video streaming data. what happened?

and then I used code here: v4l_opencv_wrapper/camera_test.c at master · andreluizeng/v4l_opencv_wrapper · GitHub  it's working,but it's slow!

so I still want to try to use gstreamer in opencv. how can I do? why not video streaming data?

Thank you very much for your reply very soon

[andre_silva]

Hi Peter,

I never capture directly using Gstreamer into a cv Mat yet (since the cv capture does it for us). But you will need to capture in the correct format using gstreamer (RGB/BGR,YUV), then you will create a cv Mat and point its data pointer to the gst buffer. I recommend you creating a very small app using gstreamer first, deal with the gst buffer and just then you add cv and try to work on this data.

cheers,

Andre

[gonewithwind]

Hi Andre,

Thank you very much. now I directly use VPU and IPU code in mxc_vpu_test and your display code I mentioned before.

peter

[frank_zhang]

Hi, Andre,

     We are working on a demo project on i.MX6qsabresd platform. We planned to use OpenCV(2.4.6) recipe in Yocto release(1.5.2 and 1.6.1) and followed the link" Computer Vision on i.MX Processors: Building OpenCV-2.4.X for Freescale's i.MX6 BSP (Yocto) "step by step. Unfortunately ,we got errors in the last step "$DISPLAY=: ./camera_test", the error is

root@imx6qsabresd:/media/sda1# ./camera_test
HIGHGUI ERROR: libv4l unable to ioctl S_FMT
HIGHGUI ERROR: libv4l unable to ioctl VIDIOCSPICT

Error creating capture

Do you ever have this problem or have some suggestions to us?

Many thanks!

Yao

[andre_silva]

Hi Yao,

answered by email.

regards,

Andre

[manjunathjoshi]

Hello ssinfod,

i really hope you got what you were looking for.

Because, OpenCV can be installed with addition of packages to the image you are already building. Which is the image you want to build? As Leo said you must check for the particular layer which can give you OpenCV related bitbake file. Only then you will be able to add and build.

you may find in meta-openembedded/meta-oe/recipes-support/opencv/

Regards,

Manju

[ssinfod]

I found this webpage: http://packages.yoctoproject.org/

Is it the "official" list of package for the I.MX processor ?

Also, What is the package manager in Yocto ?

Finally, I don't see OpenCV in this list..

Does it mean I will have to compile OpenCV from the source on the I.MX ?

Did anybody was able to use OpenCV in Yocto ?

Thanks

ssinfod

[LeonardoSandova]

If you are looking for packages from a browser, I think this is the page OpenEmbedded metadata index - recipes

For the package manager, you mean the package manager inside a Linux Image produced by Yocto? otherwise it is bitbake :smileyhappy:

No idea about the OpenCV stuff...

Leo

[ssinfod]

Yes, I mean the package manager inside the Linux image.

For example, in debian or ubuntu, I would type:

sudo apt-get install opencv

Then, the OS package manager (apt) would install the package OpenCV.

So, is there something equivalent in Yocto?

What is the package manager in Yocto and what are the package availables ?

ssinfod

[varsmolta · Accepted solution]

bitbake opencv - for building opencv

bitbake opencv-samples for building the samples.

then use gstreamer to get the frames from the camera and operate on them using opencv functions

[bennygato]

Hi varsmolta,

your answer seems to be the simplest one! I really hope I can follow your advice and install opencv, but the truth is I'm really a newbie to Yocto and linux. So please bear with me for a moment. thanks in advance!

So  I wonder where I should run "bitbake opencv", on host machine or on board （with Yocto)?

I've already build an Yocto image (fsl-image-multimedia) and can boot it on my wandboard. But I don't know what to do...

thanks!

Best,

Zoe