SOLUTION
This link has a series of patches the timing may be wrong for your display hardware you. However you will need most of them. Below is my modified xorg.conf
Section "Device"
Identifier "i.MX Accelerated Framebuffer Device-0"
Driver "vivante"
Option "fbdev" "/dev/fb0"
Option "vivante_fbdev" "/dev/fb0"
Option "HWcursor" "false"
EndSection
Section "Device"
Identifier "i.MX Accelerated Framebuffer Device-1"
Driver "vivante"
Option "fbdev" "/dev/fb2"
Option "vivante_fbdev" "/dev/fb2"
Option "HWcursor" "false"
Option "NoAccel" "True"
EndSection
Section "Monitor"
Identifier "Monitor0"
EndSection
Section "Monitor"
Identifier "Monitor1"
EndSection
Section "Screen"
Identifier "Scr0"
Monitor "Monitor0"
Device "i.MX Accelerated Framebuffer Device-0"
EndSection
Section "Screen"
Identifier "Scr1"
Monitor "Monitor1"
Device "i.MX Accelerated Framebuffer Device-1"
EndSection
Section "ServerFlags"
Option "Xinerama" "true"
EndSection
Section "ServerLayout"
Identifier "Default Layout"
Screen "Scr0" 0 0
Screen "Scr1" RightOf "Scr0"
EndSection
You will also need to calibrate your touch displays.
export DISPLAY=:0.1
xinput set-prop 8 --type=float "Coordinate Transformation Matrix" 0.5 0 0.5 0 1 0 0 0 1
xinput_calibrate
export DISPLAY=:0.0
xinput set-prop 7 --type=float "Coordinate Transformation Matrix" 0.5 0 0 0 1 0 0 0 1
xinput_calibrate
The calibration values need to be set as "Evdev Axis Calibration" (examples below).
You need the transformation matrix to keep the scaling proper.
export DISPLAY=:0.1
xinput set-prop 8 --type=float "Coordinate Transformation Matrix" 0.5 0 0.5 0 1 0 0 0 1
xinput set-prop 8 "Evdev Axis Calibration" 15 4011 101 3968
export DISPLAY=:0.0
xinput set-prop 7 --type=float "Coordinate Transformation Matrix" 0.5 0 0 0 1 0 0 0 1
xinput set-prop 7 "Evdev Axis Calibration" 28 3980 -109 3867
Finally I'd like to say a big thank you to conga tech support for all their help. I posted this solution so that no one else needs to go through the trouble I had.