I had this problem on an MPC860 a very long time ago (when the MPC860 was a new chip :-).
When the debugger was connected, some of the debug registers changed from being read/write to read-only, and I detected that. The Debug controller in the ColdFire chips doesn't have that feature (or a lot of other useful ones the MPC860 had). The MPC860 Data Sheet was at Revision 5 in 2001, so that's a long time ago.
Make that "RAM Location" a named global in your program. That should be in the symbol table, so you should be able to set that variable by name to something other than the default value it is loaded with from the debugger. If the Debugger is scriptable, you should be able to "hook the load" so it writes to this variable after downloading the code. Don't use uninitialised static RAM for this, as it could initialise with any value.
Tom