Looks to me like you have it hooked up properly (especially since you said you can access it from linux).
The one gotcha that I had in my case (using ECSPI5) was that I had to remove a connection to the accelerometer because it was using the pin in a different muxed mode. After doing that my boot-off-spi on the SabreSDB board worked just fine. It is true that the default board does not support this; however, as you have stated, you hooked up your own device.
Anyway, it appears that there are no conflicting devices on these pins, so you're good-to-go there (assuming you don't have an LCD plugged in of course).
So, the only thing I can think of is that your data is not formatted correctly on the SPI-NOR device.
What image are you putting on there and how are you doing it?
Two possibilities come to mind...
1. Does your image have the 1024-byte offset at the base?
2. If you're burning the image with linux are you sure it is a "raw" burn?
For #1, try this...
1.create a 1024-byte file of zeroes called "prefix" (or whatever)
2. prepend that file to the u-boot.imx file... cat prefix u-boot.imx > u-boot_with_prefix.imx
3. burn that to your SPI flash.
4. try to boot.
For #2, try this...
Use uboot's 'sf' command to read the data out of SPI flash to memory, then use the 'tftpput'
command (you may have to run menuconfig in uboot to pull this in) to upload it to your host.
Then compare it to your original file. If these files don't match, the use uboot's 'sf' command
to burn the image into spi.
Hope this helps,
Ed