Hi Ryan,
You should do a "Erase Whole Device" from Flash Programmer in CW. (Not sure what IDE are you using). to get the IFR area also erased.
Other option could be to use the J-Link command line to full erase the device.
If that doesn't work for you, you can also set the right partion value in advanced programming options in Debugger Settings.

In Keil uvision + ulink, I think that IFR is not erased. You could run a new project for your device, with an asm file .s with a code like this (that code is for K70, check the IFR location for your device) , to set the partition:
nDATA0 EQU 0x21
nDATA1 EQU 0x05
DATA0 EQU nDATA0:AND:0x3F
DATA1 EQU nDATA1:AND:0x0F
AREA |.ARM.__AT_0x13FFFFF8|, CODE, READONLY
DCB 0xFF, 0xFF, DATA0, DATA1, 0xFF, 0xFF, 0xFF, 0xFF
END
I hope this helps.
Luis