I have solved this problem, the LCDIF driver is buggy as it pulls the settings for the screen after it sets them, so any screen not using default clock values does not function correctly.
My solution was to move the call to mxsfb_dispdrv_init out of the probe function and into the mxsfb_init_fbinfo function. The MIPI display drivers are pretty poorly written in general, most things are hardcoded in instead of taking them from the settings structure.