Never mind, I found the problem. PTA4 (NMI) was being used as an input from another IC, and the pin was low on power up, causing an NMI interrupt. I set last word in the CFM PROT to 0xfffff9fe to disable NMI and EZPORT, it was 0xfffffffe.
The board now boots on power up.