In order to use shared by gpio4[19:22] pins as GPIO RCW fields QE_TDMA and QE_TDMB can be 000/001/010/011. I can see in your RCW[416:447]=0x5004b340 i.e. your RCW has QE_TDMA=001, QE_TDMB=001. It is suitable values.
In the SCFG_QEIOCLKCR we has to set
CLK09=01 for GPIO4_19
CLK10=01 for GPIO4_20
CLK11= 01 for GPIO4_21
CLK12 =01 for GPIO4_22
Hence we must set SCFG_QEIOCLKCR to 0x55000000