Here is an interesting tutorial, from André Silva, teaching how to run OpenCV on i.MX51EVK:
http://www.imxdev.org/wiki/index.php?title=I.MX51_EVK_Board_OpenCV
Have fun!