I think there is a misunderstand.
I don't want to configure a GPIO as an AUART instead of SSP (for example), what we do in the dts.
But I would like to multiplex AUART 1 (so /dev/ttyAPP1) with GSM 0710 MUX protocol in order to have 2 virtual COM port (/dev/ttyAPP1a and /dev/ttyAPP1b).
It is often used with GSM which has only one serial interface. You can multiplex this serial port following the GSM 0710 MUX protocol to have, together, a data connection (ppp) and a command connection (AT command).
I found "GSM MUX line discipline support" option in kernel menuconfig but I didn't find how to use it.
I work with an IMX283 and I use Yocto + bitbake with kernel 3.12.
Many thanks for your help