Hello Pratyush Tomar,
Were you able to find the root cause of this behavior? Is the USB OTG circuity the same as in the i.MX6UL EVK? I would recommend reviewing the voltages on the processor without the USB OTG connected as perhaps it is somehow affecting the voltages the processor receives and thus affects the system clock.
Please let us know of your findings!
Regards,