I am looking at your u-boot config, and I might be mistaken, but I don’t see your driver specified in the environment attributes. For instance mine is:
setenv bootargs console=ttymxc0,115200 video=mxcdi0fb:RGB666,XGA di0_primary ldb=di0 video=mxcdi1fb:GBR24,XGA tve=di1
Hope it helps.