Here's what I found:
There is a bit USBRESMEN in the USB0_USBTRC0 that will wake the processor from VLPW mode enabled (and other modes where the USB subsystem is still powered). The manual isn't clear on how to use this bit: It says it should only be used when the Transceiver is suspended. It also does not seem to be supported by the Freescale USB stack PEx components I'm using.
I tried enabling it through the debugger, and it seems to wake the processor when a data connection is detected, but not when a wall wart charger is detected. Currently, the best solution I can find is to route the +5v USB rail through some adjustments to a ExtInt enabled pin. This will wake the system whenever power is detected (either from the computer or from the wall wart) and wake the system.