one use case is to use QSPI nor to simulate NOR flash to do XIP.
That is the case in i.MXSoloX M4 core XIP running in QSPI nor.
In the i.MX6UL, it should be a normal use by accessing as SPI nor flash.
In this case, you can ingore the memory map, cause it is use the register to access the device by serial interface.
Then memory space is for simulate a linear device space as mentioned before.
You can check the i.MX6SoloX to get some idea about the QSPI.