This is because the kernel schedules the lowest bus frequency change to 3000000 usec after the request and there is no high bus frequency request in between. To improve the responsiveness of bus frequency change, you may go to set_low_bus_freq() at the file arch/arm/mach-mx6/bus_freq.c and change the schedule_delayed_work to a much shorter period.
