I had similar problems with MCF5329 and SDRAM, detailed here:
https://community.freescale.com/message/66524#66524
Long story short. The MCF5319 defaults the bus pins to a high drive strength that was probably generating bad undershoots and overshoots on the bus. That caused memory corruption under high load. Reprogramming to a lower drive strength fixed the problem. Changing the BRAND of the chip also made the problem go away.
Unless you've got a long bus (which should then have bus terminators all over the place) you should be using the 2mA drive strength instead of the 10mA drive strength.
"Table 2-1. Pin Functions by Primary and Alternate Purpose" lists which bits in the PDSR, PDSRH and PDSRL registers control what pins.
You should also work through the detailed timing specifications of the port and the SRAM in case there's a problem with a setup or hold timing somewhere.
Tom