Majid,
There are a number of things to consider here.
First make sure that you have enough RAM to allocate everything you are trying to allocate. The fXLC95000 only has 16K RAM. The amount required by ISF is documented in the release notes.
Second make sure, if you are using floating point math in your FFT routines, that you have enabled Software Floating emulation in the compiler settings- this is not enabled by default in our example projects.
Also make sure that the stack size for the task that is calling the FFT is large enough to handle all the local variable stack allocations.
Again, this might need to grow if you are calling math library functions.
-Jim