Hello yoramshacham,
You will find the following packaged which you can add with IMAGE_INSTALL_APPEND on the local.conf file. Alternatively you can bake them separatedly.
However, these are for OpenCV 2.4 on the L4.1.15 BSP.
You can find OpenCV 3.1 on the krogoth branch of the Community BSP.
opencv - for building opencv
opencv-samples for building the samples.
Regards,