Found problem, had to add I2C3 and I2C4 to xRDC peripherals for A53.
Now Im faced with new issue, M7 core running fine, but linux gets stuck here:
[ 4.036637] Waiting for root device /dev/mmcblk0p2...
[ 11.067250] mmc0: Timeout waiting for hardware cmd interrupt.
[ 11.067258] mmc0: sdhci: ============ SDHCI REGISTER DUMP ===========
[ 11.067264] mmc0: sdhci: Sys addr: 0x00000000 | Version: 0x00000002
[ 11.067270] mmc0: sdhci: Blk size: 0x00000200 | Blk cnt: 0x00000001
[ 11.067276] mmc0: sdhci: Argument: 0x00000c00 | Trn mode: 0x00000000
[ 11.067282] mmc0: sdhci: Present: 0x01fd8009 | Host ctl: 0x00000001
[ 11.067287] mmc0: sdhci: Power: 0x00000000 | Blk gap: 0x00000080
[ 11.067292] mmc0: sdhci: Wake-up: 0x00000008 | Clock: 0x000020ff
[ 11.067298] mmc0: sdhci: Timeout: 0x0000008c | Int stat: 0x00018000
[ 11.067303] mmc0: sdhci: Int enab: 0x007f1003 | Sig enab: 0x007f1003
[ 11.067308] mmc0: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000502
[ 11.067314] mmc0: sdhci: Caps: 0x07eb0000 | Caps_1: 0x8000b407
[ 11.067319] mmc0: sdhci: Cmd: 0x0000341a | Max curr: 0x00ffffff
[ 11.067325] mmc0: sdhci: Resp[0]: 0x00000b00 | Resp[1]: 0x0073677f
[ 11.067330] mmc0: sdhci: Resp[2]: 0x325b5900 | Resp[3]: 0x00400e00
[ 11.067336] mmc0: sdhci: Host ctl2: 0x00000000
[ 11.067340] mmc0: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000
[ 11.067345] mmc0: sdhci-esdhc-imx: ========= ESDHC IMX DEBUG STATUS DUMP =========
[ 11.067350] mmc0: sdhci-esdhc-imx: cmd debug status: 0x2100
[ 11.067355] mmc0: sdhci-esdhc-imx: data debug status: 0x2200
[ 11.067360] mmc0: sdhci-esdhc-imx: trans debug status: 0x2300
[ 11.067366] mmc0: sdhci-esdhc-imx: dma debug status: 0x2400
[ 11.067372] mmc0: sdhci-esdhc-imx: adma debug status: 0x2500
[ 11.067379] mmc0: sdhci-esdhc-imx: fifo debug status: 0x2680
[ 11.067385] mmc0: sdhci-esdhc-imx: async fifo debug status: 0x2750
[ 11.067391] mmc0: sdhci: ============================================
Any idea what could be problem? This does not happen when M7 application is not running.