Probably fman ucode is broken, please deploy the attached fman ucode to your target board in u-boot with the following commands.
=>tftp 0x1000000 fsl_fman_ucode_t1040_r1.1_106_4_18.bin
=>erase 0xEFF00000 +$filesize
=>cp.b 0x1000000 0xEFF00000 $filesize