Hi Tyler,
If you're using a Nitrogen6X or Nitrogen6X-SOM carrier board with a Solo processor, there's an SMSC USB2513B USB hub connected to the host port, so the i.MX6 should always see the connection.
The Nitrogen6_Lite board doesn't have the hub (and only has a single USB port).