From a general point of view USB hub is more complex device that Ethernet hub.
It has buffers for date and it can "convert" the flow from one USB version to another.
So I suppese it may slow the flow if the hup has weak processor or memory.
Also I can surmise that i.MX6Q polls USB hub less often than USB device.
But it is just an assumption.