Hi Benjamin,
sorry for the late reply, but are currently finishing our design (succfessully, yeah!).
When we investigated the problem we saw a remark in the i.MX8 documentation (electrical specs?), which pointed out the a crystal using the internal oscillator will be regulated to have a 180-300mV swing, so the internal oscillator adapts its amplification factor. That's what made us reduce the swing of the external oscillator from 1.8V to (I guess) 300mV with a resistive divider (to GND) and, after that divider, a decoupling capacitor (100nF is ok) to the input pin of the i.MX8.
This let our prototypes reliable boot up.
Actually this problem cost us 10 days, so the first thing we changed was replacing the oscillator with a crystal in the next revision.
BTW: another problem we hit: The oscillators we used had a rather long startup time (>30ms). This interfered with the i.MX8 powerup sequence, so we had to delay a certain step in this sequence.
Sorry for being so unspecific on actual values. I just typed this in out of my mind. Next monday when I am back in the office I may have forgotten you're waiting for some ideas...
Kind reqards and good luck!
Thomas.