Linux kernel boot hangs after VGEN2: disabling

[ugur_acikgoz]

Hi everyone,

We have developed our custom board by taking iMX6QPSABRESD as reference. The board has just arrived at our hands and we're trying to boot the kernel.

First of all, we did the DDR Calibration by following various guides found in this community. We ran the stress tool as well, which succeeded. We modified the corresponding locations on U-Boot source and re-generated an image with correct DDR Calibration parameters. Then, we wrote the image on an SD card and tried to boot the device.

This is what we get:

U-Boot 2016.03-imx_v2016.03_4.1.15_2.0.0_ga+ga57b13b (Sep 14 2018 - 15:46:50 +0300)

CPU: Freescale i.MX6QP rev1.0 996 MHz (running at 792 MHz)
CPU: Automotive temperature grade (-40C to 125C) at 26C
Reset cause: POR
Board: MX6-SabreSD
I2C: ready
DRAM: 1 GiB
PMIC: PFUZE100 ID=0x10
MMC: FSL_SDHC: 0, FSL_SDHC: 1, FSL_SDHC: 2
*** Warning - bad CRC, using default environment

No panel detected: default to Hannstar-XGA
Display: Hannstar-XGA (1024x768)
In: serial
Out: serial
Err: serial
switch to partitions #0, OK
mmc1 is current device
Net: FEC [PRIME]
Error: FEC address not set.

Normal Boot
Hit any key to stop autoboot: 0
switch to partitions #0, OK
mmc1 is current device
reading boot.scr
** Unable to read file boot.scr **
reading zImage
6577312 bytes read in 319 ms (19.7 MiB/s)
Booting from mmc ...
reading imx6qp-sabresd.dtb
47672 bytes read in 19 ms (2.4 MiB/s)
Kernel image @ 0x12000000 [ 0x000000 - 0x645ca0 ]
## Flattened Device Tree blob at 18000000
Booting using the fdt blob at 0x18000000
Using Device Tree in place at 18000000, end 1800ea37
switch to ldo_bypass mode!

Starting kernel ...

[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 4.1.15-2.1.0+g30278ab (kuartis@kuartis-VirtualBox) (gcc version 5.3.0 (GCC) ) #1 SMP PREEMPT Fri Sep 14 19:26:35 +03 2018
[ 0.000000] CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7), cr=10c53c7d
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
[ 0.000000] Machine model: Freescale i.MX6 Quad Plus SABRE Smart Device Board
[ 0.000000] Reserved memory: created CMA memory pool at 0x3c000000, size 320 MiB
[ 0.000000] Reserved memory: initialized node linux,cma, compatible id shared-dma-pool
[ 0.000000] Memory policy: Data cache writealloc
[ 0.000000] PERCPU: Embedded 12 pages/cpu @ab703000 s16908 r8192 d24052 u49152
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 260096
[ 0.000000] Kernel command line: console=ttymxc0,115200 root=/dev/mmcblk2p2 rootwait rw
[ 0.000000] PID hash table entries: 4096 (order: 2, 16384 bytes)
[ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
[ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
[ 0.000000] Memory: 698300K/1048576K available (8252K kernel code, 442K rwdata, 2948K rodata, 444K init, 449K bss, 22596K reserved, 327680K cma-reserved, 0K highmem)
[ 0.000000] Virtual kernel memory layout:
[ 0.000000] vector : 0xffff0000 - 0xffff1000 ( 4 kB)
[ 0.000000] fixmap : 0xffc00000 - 0xfff00000 (3072 kB)
[ 0.000000] vmalloc : 0xc0800000 - 0xff000000 (1000 MB)
[ 0.000000] lowmem : 0x80000000 - 0xc0000000 (1024 MB)
[ 0.000000] pkmap : 0x7fe00000 - 0x80000000 ( 2 MB)
[ 0.000000] modules : 0x7f000000 - 0x7fe00000 ( 14 MB)
[ 0.000000] .text : 0x80008000 - 0x80af84d0 (11202 kB)
[ 0.000000] .init : 0x80af9000 - 0x80b68000 ( 444 kB)
[ 0.000000] .data : 0x80b68000 - 0x80bd68a0 ( 443 kB)
[ 0.000000] .bss : 0x80bd9000 - 0x80c49740 ( 450 kB)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[ 0.000000] Preemptible hierarchical RCU implementation.
[ 0.000000] Additional per-CPU info printed with stalls.
[ 0.000000] NR_IRQS:16 nr_irqs:16 16
[ 0.000000] L2C-310 erratum 769419 enabled
[ 0.000000] L2C-310 enabling early BRESP for Cortex-A9
[ 0.000000] L2C-310 full line of zeros enabled for Cortex-A9
[ 0.000000] L2C-310 ID prefetch enabled, offset 16 lines
[ 0.000000] L2C-310 dynamic clock gating enabled, standby mode enabled
[ 0.000000] L2C-310 cache controller enabled, 16 ways, 1024 kB
[ 0.000000] L2C-310: CACHE_ID 0x410000c8, AUX_CTRL 0x76470001
[ 0.000000] mxc_clocksource_init 3000000
[ 0.000000] Switching to timer-based delay loop, resolution 333ns
[ 0.000006] sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps every 715827882841ns
[ 0.000026] clocksource mxc_timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 637086815595 ns
[ 0.001187] Console: colour dummy device 80x30
[ 0.001204] Calibrating delay loop (skipped), value calculated using timer frequency.. 6.00 BogoMIPS (lpj=30000)
[ 0.001220] pid_max: default: 32768 minimum: 301
[ 0.001331] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes)
[ 0.001344] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes)
[ 0.001953] CPU: Testing write buffer coherency: ok
[ 0.002240] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[ 0.002337] Setting up static identity map for 0x10008280 - 0x100082d8
[ 0.060120] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
[ 0.080135] CPU2: thread -1, cpu 2, socket 0, mpidr 80000002
[ 0.100119] CPU3: thread -1, cpu 3, socket 0, mpidr 80000003
[ 0.100182] Brought up 4 CPUs
[ 0.100209] SMP: Total of 4 processors activated (24.00 BogoMIPS).
[ 0.100218] CPU: All CPU(s) started in SVC mode.
[ 0.100711] devtmpfs: initialized
[ 0.111657] VFP support v0.3: implementor 41 architecture 3 part 30 variant 9 rev 4
[ 0.112019] clocksource jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.128378] pinctrl core: initialized pinctrl subsystem
[ 0.129437] NET: Registered protocol family 16
[ 0.137719] DMA: preallocated 256 KiB pool for atomic coherent allocations
[ 0.159661] cpuidle: using governor ladder
[ 0.189659] cpuidle: using governor menu
[ 0.189784] CPU identified as i.MX6QP, silicon rev 1.0
[ 0.200948] anatop_regulator 20c8000.anatop:regulator-vddcore@140: Failed to read a valid default voltage selector.
[ 0.200973] anatop_regulator: probe of 20c8000.anatop:regulator-vddcore@140 failed with error -22
[ 0.201658] anatop_regulator 20c8000.anatop:regulator-vddsoc@140: Failed to read a valid default voltage selector.
[ 0.201681] anatop_regulator: probe of 20c8000.anatop:regulator-vddsoc@140 failed with error -22
[ 0.216146] hw-breakpoint: found 5 (+1 reserved) breakpoint and 1 watchpoint registers.
[ 0.216157] hw-breakpoint: maximum watchpoint size is 4 bytes.
[ 0.217354] imx6q-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver
[ 0.262364] mxs-dma 110000.dma-apbh: initialized
[ 0.266401] SCSI subsystem initialized
[ 0.266892] usbcore: registered new interface driver usbfs
[ 0.266963] usbcore: registered new interface driver hub
[ 0.267053] usbcore: registered new device driver usb
[ 0.267242] 2000000.aips-bus:usbphy_nop1 supply vcc not found, using dummy regulator
[ 0.267365] 2000000.aips-bus:usbphy_nop2 supply vcc not found, using dummy regulator
[ 0.268711] i2c i2c-0: IMX I2C adapter registered
[ 0.268729] i2c i2c-0: can't use DMA
[ 0.269748] i2c i2c-1: IMX I2C adapter registered
[ 0.269765] i2c i2c-1: can't use DMA
[ 0.270494] i2c i2c-2: IMX I2C adapter registered
[ 0.270511] i2c i2c-2: can't use DMA
[ 0.270684] Linux video capture interface: v2.00
[ 0.270777] pps_core: LinuxPPS API ver. 1 registered
[ 0.270787] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 0.270819] PTP clock support registered
[ 0.289704] imx-ipuv3 2400000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
[ 0.309702] imx-ipuv3 2800000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
[ 0.310621] imx-prg 21cc000.prg: driver probed
[ 0.310717] imx-prg 21cd000.prg: driver probed
[ 0.311184] imx-pre 21c8000.pre: driver probed
[ 0.311378] imx-pre 21c9000.pre: driver probed
[ 0.311566] imx-pre 21ca000.pre: driver probed
[ 0.311751] imx-pre 21cb000.pre: driver probed
[ 0.312120] mxc_mipi_csi2 21dc000.mipi_csi: i.MX MIPI CSI2 driver probed
[ 0.312134] mxc_mipi_csi2 21dc000.mipi_csi: i.MX MIPI CSI2 dphy version is 0x3130302a
[ 0.312248] MIPI CSI2 driver module loaded
[ 0.312547] Advanced Linux Sound Architecture Driver Initialized.
[ 0.313741] Bluetooth: Core ver 2.20
[ 0.313788] NET: Registered protocol family 31
[ 0.313797] Bluetooth: HCI device and connection manager initialized
[ 0.313813] Bluetooth: HCI socket layer initialized
[ 0.313827] Bluetooth: L2CAP socket layer initialized
[ 0.313862] Bluetooth: SCO socket layer initialized
[ 0.314719] Switched to clocksource mxc_timer1
[ 0.326029] NET: Registered protocol family 2
[ 0.326684] TCP established hash table entries: 8192 (order: 3, 32768 bytes)
[ 0.326770] TCP bind hash table entries: 8192 (order: 4, 65536 bytes)
[ 0.326902] TCP: Hash tables configured (established 8192 bind 8192)
[ 0.327045] UDP hash table entries: 512 (order: 2, 16384 bytes)
[ 0.327082] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[ 0.327291] NET: Registered protocol family 1
[ 0.327628] RPC: Registered named UNIX socket transport module.
[ 0.327639] RPC: Registered udp transport module.
[ 0.327648] RPC: Registered tcp transport module.
[ 0.327655] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.328202] CPU PMU: Failed to parse /soc/pmu/interrupt-affinity[0]
[ 0.328249] hw perfevents: enabled with armv7_cortex_a9 PMU driver, 7 counters available
[ 0.329552] imx rpmsg driver is registered.
[ 0.330561] Bus freq driver module loaded
[ 0.331669] futex hash table entries: 1024 (order: 4, 65536 bytes)
[ 0.338080] VFS: Disk quotas dquot_6.6.0
[ 0.338273] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[ 0.340354] NFS: Registering the id_resolver key type
[ 0.340397] Key type id_resolver registered
[ 0.340407] Key type id_legacy registered
[ 0.340490] jffs2: version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
[ 0.341194] fuse init (API version 7.23)
[ 0.345422] io scheduler noop registered
[ 0.345443] io scheduler deadline registered
[ 0.345611] io scheduler cfq registered (default)
[ 0.346154] imx-weim 21b8000.weim: Driver registered.
[ 0.347895] backlight supply power not found, using dummy regulator
[ 0.349728] mxc_mipi_dsi 21e0000.mipi: i.MX MIPI DSI driver probed
[ 0.349856] MIPI DSI driver module loaded
[ 0.350123] MIPI DSI driver module loaded
[ 0.352864] mxc_sdc_fb fb@0: registered mxc display driver ldb
[ 0.374865] imx-ipuv3 2800000.ipu: IPU DMFC DP HIGH RESOLUTION: 1(0,1), 5B(2~5), 5F(6,7)
[ 0.435188] Console: switching to colour frame buffer device 128x48
[ 0.445839] mxc_hdmi 20e0000.hdmi_video: Detected HDMI controller 0x13:0xa:0xa0:0xc1
[ 0.445868] fbcvt: 1920x1080@60: CVT Name - 2.073M9
[ 0.445992] mxc_sdc_fb fb@1: registered mxc display driver hdmi
[ 0.477461] mxc_sdc_fb fb@2: registered mxc display driver lcd
[ 0.477478] mxc_sdc_fb fb@2: ipu0-di0 already in use
[ 0.477500] mxc_sdc_fb: probe of fb@2 failed with error -16
[ 0.477567] mxc_sdc_fb fb@3: registered mxc display driver ldb
[ 0.487357] imx-sdma 20ec000.sdma: no iram assigned, using external mem
[ 0.488054] imx-sdma 20ec000.sdma: no event needs to be remapped
[ 0.488468] imx-sdma 20ec000.sdma: loaded firmware 3.3
[ 0.491263] imx-sdma 20ec000.sdma: initialized
[ 0.493028] pfuze100-regulator 1-0008: Full layer: 2, Metal layer: 1
[ 0.493646] pfuze100-regulator 1-0008: FAB: 0, FIN: 0
[ 0.493661] pfuze100-regulator 1-0008: pfuze100 found.
[ 0.508700] 2020000.serial: ttymxc0 at MMIO 0x2020000 (irq = 25, base_baud = 5000000) is a IMX
[ 1.425623] console [ttymxc0] enabled
[ 1.432161] imx sema4 driver is registered.
[ 1.436480] [drm] Initialized drm 1.1.0 20060810
[ 1.441593] [drm] Initialized vivante 1.0.0 20120216 on minor 0
[ 1.456972] brd: module loaded
[ 1.465998] loop: module loaded
[ 1.470615] ahci-imx 2200000.sata: fsl,transmit-level-mV not specified, using 00000024
[ 1.478586] ahci-imx 2200000.sata: fsl,transmit-boost-mdB not specified, using 00000480
[ 1.486623] ahci-imx 2200000.sata: fsl,transmit-atten-16ths not specified, using 00002000
[ 1.494840] ahci-imx 2200000.sata: fsl,receive-eq-mdB not specified, using 05000000
[ 1.505697] ahci-imx 2200000.sata: SSS flag set, parallel bus scan disabled
[ 1.512698] ahci-imx 2200000.sata: AHCI 0001.0300 32 slots 1 ports 3 Gbps 0x1 impl platform mode
[ 1.521527] ahci-imx 2200000.sata: flags: ncq sntf stag pm led clo only pmp pio slum part ccc apst
[ 1.532175] scsi host0: ahci-imx
[ 1.535765] ata1: SATA max UDMA/133 mmio [mem 0x02200000-0x02203fff] port 0x100 irq 313
[ 1.547756] m25p80 spi0.0: unrecognized JEDEC id bytes: 01, 60, 18
[ 1.553980] spi_imx 2008000.ecspi: probed
[ 1.559016] CAN device driver interface
[ 1.564338] 2188000.ethernet supply phy not found, using dummy regulator
[ 1.585212] pps pps0: new PPS source ptp0
[ 1.590450] fec 2188000.ethernet (unnamed net_device) (uninitialized): Invalid MAC address: 00:00:00:00:00:00
[ 1.600430] fec 2188000.ethernet (unnamed net_device) (uninitialized): Using random MAC address: e2:61:28:5c:3e:b7
[ 1.615239] libphy: fec_enet_mii_bus: probed
[ 1.620168] fec 2188000.ethernet eth0: registered PHC device 0
[ 1.627051] usbcore: registered new interface driver asix
[ 1.632536] usbcore: registered new interface driver ax88179_178a
[ 1.638730] usbcore: registered new interface driver cdc_ether
[ 1.644633] usbcore: registered new interface driver net1080
[ 1.650394] usbcore: registered new interface driver cdc_subset
[ 1.656405] usbcore: registered new interface driver zaurus
[ 1.662086] usbcore: registered new interface driver cdc_ncm
[ 1.667789] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 1.674332] ehci-mxc: Freescale On-Chip EHCI Host driver
[ 1.679886] usbcore: registered new interface driver usb-storage
[ 1.685992] usbcore: registered new interface driver usb_ehset_test
[ 1.693602] 2184800.usbmisc supply vbus-wakeup not found, using dummy regulator
[ 1.701939] usb_otg_vbus: supplied by SWBST
[ 1.711803] usb_h1_vbus: supplied by SWBST
[ 1.719256] ci_hdrc ci_hdrc.1: EHCI Host Controller
[ 1.724171] ci_hdrc ci_hdrc.1: new USB bus registered, assigned bus number 1
[ 1.744759] ci_hdrc ci_hdrc.1: USB 2.0 started, EHCI 1.00
[ 1.751083] hub 1-0:1.0: USB hub found
[ 1.754919] hub 1-0:1.0: 1 port detected
[ 1.759982] mousedev: PS/2 mouse device common for all mice
[ 1.766662] egalax_ts 1-0004: Failed to read firmware version
[ 1.772451] egalax_ts: probe of 1-0004 failed with error -5
[ 1.778438] egalax_ts 2-0004: Failed to read firmware version
[ 1.784224] egalax_ts: probe of 2-0004 failed with error -5
[ 1.792258] input: max11801_ts as /devices/soc0/soc/2100000.aips-bus/21a4000.i2c/i2c-1/1-0048/input/input2
[ 1.805021] snvs_rtc 20cc000.snvs:snvs-rtc-lp: rtc core: registered 20cc000.snvs:snvs-r as rtc0
[ 1.813894] i2c /dev entries driver
[ 1.818705] IR NEC protocol handler initialized
[ 1.823254] IR RC5(x/sz) protocol handler initialized
[ 1.828341] IR RC6 protocol handler initialized
[ 1.832887] IR JVC protocol handler initialized
[ 1.837455] IR Sony protocol handler initialized
[ 1.842086] IR SANYO protocol handler initialized
[ 1.846826] IR Sharp protocol handler initialized
[ 1.851550] IR MCE Keyboard/mouse protocol handler initialized
[ 1.857412] IR XMP protocol handler initialized
[ 1.863283] mxc_v4l2_output v4l2_out: V4L2 device registered as video16
[ 1.870107] mxc_v4l2_output v4l2_out: V4L2 device registered as video17
[ 1.876926] mxc_v4l2_output v4l2_out: V4L2 device registered as video18
[ 1.883731] mxc_v4l2_output v4l2_out: V4L2 device registered as video19
[ 1.884760] ata1: SATA link down (SStatus 0 SControl 300)
[ 1.884801] ahci-imx 2200000.sata: no device found, disabling link.
[ 1.884809] ahci-imx 2200000.sata: pass ahci_imx..hotplug=1 to enable hotplug
[ 1.909409] mxc_v4l2_output v4l2_out: V4L2 device registered as video20
[ 1.922671] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.933885] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.939449] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.950272] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.955833] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.961268] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.966689] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.972100] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.983245] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 1.994183] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 2.005117] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 2.016030] max11801_ts 1-0048: FIFO_RD_AUX_MSB read fails
[ 2.022487] mag3110 2-000e: check mag3110 chip ID
[ 2.027454] mag3110 2-000e: read chip ID 0xfffffffb is not equal to 0xc4!
[ 2.034350] mag3110: probe of 2-000e failed with error -22
[ 2.040344] mma8451 0-001c: read chip ID 0x1 is not equal to 0x1a or 0x2a!
[ 2.047382] mma8451: probe of 0-001c failed with error -22
[ 2.053816] imx2-wdt 20c0000.wdog: use WDOG_B to reboot.
[ 2.059525] imx2-wdt 20c0000.wdog: timeout 60 sec (nowayout=0)
[ 2.065576] Bluetooth: HCI UART driver ver 2.3
[ 2.070032] Bluetooth: HCI UART protocol H4 registered
[ 2.075204] Bluetooth: HCI UART protocol BCSP registered
[ 2.080524] Bluetooth: HCI UART protocol ATH3K registered
[ 2.086052] usbcore: registered new interface driver bcm203x
[ 2.091806] usbcore: registered new interface driver btusb
[ 2.097404] usbcore: registered new interface driver ath3k
[ 2.103346] sdhci: Secure Digital Host Controller Interface driver
[ 2.109557] sdhci: Copyright(c) Pierre Ossman
[ 2.113932] sdhci-pltfm: SDHCI platform and OF driver helper
[ 2.120520] /soc/aips-bus@02100000/usdhc@02194000: voltage-ranges unspecified
[ 2.127716] sdhci-esdhc-imx 2194000.usdhc: Got CD GPIO
[ 2.132878] sdhci-esdhc-imx 2194000.usdhc: Got WP GPIO
[ 2.139544] sdhci-esdhc-imx 2194000.usdhc: No vmmc regulator found
[ 2.145767] sdhci-esdhc-imx 2194000.usdhc: No vqmmc regulator found
[ 2.196921] mmc1: SDHCI controller on 2194000.usdhc [2194000.usdhc] using ADMA
[ 2.204670] /soc/aips-bus@02100000/usdhc@02198000: voltage-ranges unspecified
[ 2.211862] sdhci-esdhc-imx 2198000.usdhc: Got CD GPIO
[ 2.217046] sdhci-esdhc-imx 2198000.usdhc: Got WP GPIO
[ 2.222625] sdhci-esdhc-imx 2198000.usdhc: No vmmc regulator found
[ 2.228846] sdhci-esdhc-imx 2198000.usdhc: No vqmmc regulator found
[ 2.275914] mmc2: SDHCI controller on 2198000.usdhc [2198000.usdhc] using ADMA
[ 2.283715] /soc/aips-bus@02100000/usdhc@0219c000: voltage-ranges unspecified
[ 2.297542] sdhci-esdhc-imx 219c000.usdhc: No vmmc regulator found
[ 2.303760] sdhci-esdhc-imx 219c000.usdhc: No vqmmc regulator found
[ 2.353797] mmc2: new high speed SDHC card at address aaaa
[ 2.359338] mmc3: SDHCI controller on 219c000.usdhc [219c000.usdhc] using ADMA
[ 2.366979] mmcblk2: mmc2:aaaa SB16G 14.8 GiB (ro)
[ 2.373715] mxc_vpu 2040000.vpu_fsl: VPU initialized
[ 2.377457] mmcblk2: p1 p2
[ 2.382245] mxc_vdoa 21e4000.vdoa: i.MX Video Data Order Adapter(VDOA) driver probed
[ 2.390537] mxc_hdmi_cec soc:hdmi_cec@00120000: HDMI CEC initialized
[ 2.399348] caam 2100000.caam: Entropy delay = 3200
[ 2.465030] caam 2100000.caam: Instantiated RNG4 SH0
[ 2.470010] mmc3: MAN_BKOPS_EN bit is not set
[ 2.494750] mmc3: new DDR MMC card at address 0001
[ 2.500000] mmcblk3: mmc3:0001 SEM08G 7.28 GiB
[ 2.504700] mmcblk3boot0: mmc3:0001 SEM08G partition 1 4.00 MiB
[ 2.510788] mmcblk3boot1: mmc3:0001 SEM08G partition 2 4.00 MiB
[ 2.516878] mmcblk3rpmb: mmc3:0001 SEM08G partition 3 4.00 MiB
[ 2.525792] caam 2100000.caam: Instantiated RNG4 SH1
[ 2.530778] caam 2100000.caam: device ID = 0x0a16010000000000 (Era -524)
[ 2.537512] caam 2100000.caam: job rings = 2, qi = 0
[ 2.600469] caam algorithms registered in /proc/crypto
[ 2.609655] caam_jr 2101000.jr0: registering rng-caam
[ 2.615516] platform caam_sm: blkkey_ex: 4 keystore units available
[ 2.621991] platform caam_sm: 64-bit clear key:
[ 2.626561] platform caam_sm: [0000] 00 01 02 03 04 0f 06 07
[ 2.632231] platform caam_sm: 64-bit black key:
[ 2.636791] platform caam_sm: [0000] 51 f7 be 0b b8 13 5b 62
[ 2.642469] platform caam_sm: [0008] 84 b8 99 cf 60 ac 88 16
[ 2.648154] platform caam_sm: 128-bit clear key:
[ 2.652786] platform caam_sm: [0000] 00 01 02 03 04 0f 06 07
[ 2.658476] platform caam_sm: [0008] 08 09 0a 0b 0c 0d 0e 0f
[ 2.664146] platform caam_sm: 128-bit black key:
[ 2.668789] platform caam_sm: [0000] 40 2d 28 d8 2a 4b e7 f1
[ 2.674467] platform caam_sm: [0008] 47 d8 b3 cd e4 57 f1 a2
[ 2.680147] platform caam_sm: 192-bit clear key:
[ 2.684790] platform caam_sm: [0000] 00 01 02 03 04 0f 06 07
[ 2.690466] platform caam_sm: [0008] 08 09 0a 0b 0c 0d 0e 0f
[ 2.696151] platform caam_sm: [0016] 10 11 12 13 14 15 16 17
[ 2.701819] platform caam_sm: 192-bit black key:
[ 2.706465] platform caam_sm: [0000] 95 d8 3e 2f be 20 39 a9
[ 2.712137] platform caam_sm: [0008] 5b 65 9a 65 f5 5f 26 82
[ 2.717822] platform caam_sm: [0016] f9 f8 a9 e1 41 79 65 a0
[ 2.723500] platform caam_sm: [0024] 0c 74 7a 10 18 f5 b7 f0
[ 2.729188] platform caam_sm: 256-bit clear key:
[ 2.733820] platform caam_sm: [0000] 00 01 02 03 04 0f 06 07
[ 2.739510] platform caam_sm: [0008] 08 09 0a 0b 0c 0d 0e 0f
[ 2.745197] platform caam_sm: [0016] 10 11 12 13 14 15 16 17
[ 2.750871] platform caam_sm: [0024] 18 19 1a 1b 1c 1d 1e 1f
[ 2.756558] platform caam_sm: 256-bit black key:
[ 2.761188] platform caam_sm: [0000] 85 c0 6c 02 3b 02 e2 32
[ 2.766875] platform caam_sm: [0008] f2 e4 c8 f5 a6 a7 e5 48
[ 2.772547] platform caam_sm: [0016] ba b6 4a 9c 6f 7d f4 02
[ 2.778274] platform caam_sm: [0024] 0b 54 d1 8f 9d 4d 94 86
[ 2.783946] platform caam_sm: 64-bit unwritten blob:
[ 2.788942] platform caam_sm: [0000] 00 00 00 00 00 00 00 00
[ 2.794621] platform caam_sm: [0008] 00 00 00 00 00 00 00 00
[ 2.800308] platform caam_sm: [0016] 00 00 00 00 00 00 00 00
[ 2.805995] platform caam_sm: [0024] 00 00 00 00 00 00 00 00
[ 2.811671] platform caam_sm: [0032] 00 00 00 00 00 00 00 00
[ 2.817357] platform caam_sm: [0040] 00 00 00 00 00 00 00 00
[ 2.823033] platform caam_sm: [0048] 00 00 00 00 00 00 00 00
[ 2.828719] platform caam_sm: [0056] 00 00 00 00 00 00 00 00
[ 2.834391] platform caam_sm: [0064] 00 00 00 00 00 00 00 00
[ 2.840080] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 2.845774] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 2.851446] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 2.857135] platform caam_sm: 128-bit unwritten blob:
[ 2.862200] platform caam_sm: [0000] 00 00 00 00 00 00 00 00
[ 2.867886] platform caam_sm: [0008] 00 00 00 00 00 00 00 00
[ 2.873562] platform caam_sm: [0016] 00 00 00 00 00 00 00 00
[ 2.879248] platform caam_sm: [0024] 00 00 00 00 00 00 00 00
[ 2.884934] platform caam_sm: [0032] 00 00 00 00 00 00 00 00
[ 2.890610] platform caam_sm: [0040] 00 00 00 00 00 00 00 00
[ 2.896296] platform caam_sm: [0048] 00 00 00 00 00 00 00 00
[ 2.901968] platform caam_sm: [0056] 00 00 00 00 00 00 00 00
[ 2.907657] platform caam_sm: [0064] 00 00 00 00 00 00 00 00
[ 2.913329] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 2.919015] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 2.924692] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 2.930375] platform caam_sm: 196-bit unwritten blob:
[ 2.935454] platform caam_sm: [0000] 00 00 00 00 00 00 00 00
[ 2.941130] platform caam_sm: [0008] 00 00 00 00 00 00 00 00
[ 2.946816] platform caam_sm: [0016] 00 00 00 00 00 00 00 00
[ 2.952488] platform caam_sm: [0024] 00 00 00 00 00 00 00 00
[ 2.958176] platform caam_sm: [0032] 00 00 00 00 00 00 00 00
[ 2.963848] platform caam_sm: [0040] 00 00 00 00 00 00 00 00
[ 2.969533] platform caam_sm: [0048] 00 00 00 00 00 00 00 00
[ 2.975249] platform caam_sm: [0056] 00 00 00 00 00 00 00 00
[ 2.980922] platform caam_sm: [0064] 00 00 00 00 00 00 00 00
[ 2.986609] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 2.992285] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 2.997973] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 3.003642] platform caam_sm: 256-bit unwritten blob:
[ 3.008725] platform caam_sm: [0000] 00 00 00 00 00 00 00 00
[ 3.014397] platform caam_sm: [0008] 00 00 00 00 00 00 00 00
[ 3.020079] platform caam_sm: [0016] 00 00 00 00 00 00 00 00
[ 3.025769] platform caam_sm: [0024] 00 00 00 00 00 00 00 00
[ 3.031442] platform caam_sm: [0032] 00 00 00 00 00 00 00 00
[ 3.037127] platform caam_sm: [0040] 00 00 00 00 00 00 00 00
[ 3.042803] platform caam_sm: [0048] 00 00 00 00 00 00 00 00
[ 3.048522] platform caam_sm: [0056] 00 00 00 00 00 00 00 00
[ 3.054197] platform caam_sm: [0064] 00 00 00 00 00 00 00 00
[ 3.059892] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 3.065582] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 3.071254] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 3.077168] platform caam_sm: 64-bit black key in blob:
[ 3.082410] platform caam_sm: [0000] 44 24 60 bf bd 01 dc 1e
[ 3.088103] platform caam_sm: [0008] d0 f3 7a c3 83 39 72 06
[ 3.093781] platform caam_sm: [0016] 42 5e c6 d5 f0 cb d2 e7
[ 3.099469] platform caam_sm: [0024] 6b a9 2d d5 b6 35 e4 c2
[ 3.105163] platform caam_sm: [0032] d0 01 69 27 be 0e 39 3a
[ 3.110842] platform caam_sm: [0040] d8 c3 11 96 59 a3 98 02
[ 3.116530] platform caam_sm: [0048] 7b a0 1b aa 9d f5 e2 ba
[ 3.122202] platform caam_sm: [0056] 00 00 00 00 00 00 00 00
[ 3.127892] platform caam_sm: [0064] 00 00 00 00 00 00 00 00
[ 3.133565] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 3.139251] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 3.144941] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 3.150610] platform caam_sm: 128-bit black key in blob:
[ 3.155950] platform caam_sm: [0000] 28 c3 07 7a 99 72 7b 13
[ 3.161627] platform caam_sm: [0008] b7 86 2c 45 f0 55 a6 d9
[ 3.167314] platform caam_sm: [0016] 39 71 eb cc 34 98 be 1f
[ 3.172987] platform caam_sm: [0024] cc 0d 7b b5 d8 96 c5 f2
[ 3.178705] platform caam_sm: [0032] b6 cf ca 3d 31 b5 88 b2
[ 3.184378] platform caam_sm: [0040] 72 87 44 a6 d2 65 28 76
[ 3.190068] platform caam_sm: [0048] ca 31 20 ce e2 fd e1 8c
[ 3.195759] platform caam_sm: [0056] 55 1c ef 16 86 71 58 5d
[ 3.201432] platform caam_sm: [0064] 00 00 00 00 00 00 00 00
[ 3.207119] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 3.212795] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 3.218483] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 3.224153] platform caam_sm: 192-bit black key in blob:
[ 3.229499] platform caam_sm: [0000] 3b 57 3d 27 10 80 65 7f
[ 3.235188] platform caam_sm: [0008] 6a 4a 0e 48 80 ab 7a d3
[ 3.240861] platform caam_sm: [0016] 0f 6e cd e3 ef 4e da b4
[ 3.246551] platform caam_sm: [0024] 52 fd f7 92 ea 64 9a 8e
[ 3.252223] platform caam_sm: [0032] 52 5a 79 b7 27 ba 56 ee
[ 3.257909] platform caam_sm: [0040] e1 ae 5c a9 a8 8b fe 11
[ 3.263586] platform caam_sm: [0048] bf bb 02 72 3e 45 46 66
[ 3.269272] platform caam_sm: [0056] 32 10 c9 3c 62 54 cf 04
[ 3.274959] platform caam_sm: [0064] 88 ca 66 fd f1 57 1d 1e
[ 3.280635] platform caam_sm: [0072] 00 00 00 00 00 00 00 00
[ 3.286321] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 3.291997] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 3.297679] platform caam_sm: 256-bit black key in blob:
[ 3.303006] platform caam_sm: [0000] 86 20 cc 23 90 b7 9d 93
[ 3.308692] platform caam_sm: [0008] 1d fd e2 6d 12 53 de 21
[ 3.314369] platform caam_sm: [0016] 8f 28 f1 92 e1 ab fe 71
[ 3.320056] platform caam_sm: [0024] eb ff 98 3b be b7 b8 31
[ 3.325746] platform caam_sm: [0032] f7 97 92 e1 9c 8a fb 8c
[ 3.331419] platform caam_sm: [0040] ae 54 d6 7b 16 a2 2e 92
[ 3.337105] platform caam_sm: [0048] a3 4b 2a 34 eb 7d 16 01
[ 3.342782] platform caam_sm: [0056] aa 47 8e af 08 0a 2b ad
[ 3.348469] platform caam_sm: [0064] c8 10 c8 64 6a 8f f0 ed
[ 3.354141] platform caam_sm: [0072] 22 19 93 41 64 96 c7 14
[ 3.359830] platform caam_sm: [0080] 00 00 00 00 00 00 00 00
[ 3.365522] platform caam_sm: [0088] 00 00 00 00 00 00 00 00
[ 3.371390] platform caam_sm: restored 64-bit black key:
[ 3.376764] platform caam_sm: [0000] 1e 81 f6 bd 2f 31 dd 50
[ 3.382438] platform caam_sm: [0008] 96 c2 c7 a6 1c c4 fe 66
[ 3.388125] platform caam_sm: restored 128-bit black key:
[ 3.393541] platform caam_sm: [0000] 40 2d 28 d8 2a 4b e7 f1
[ 3.399230] platform caam_sm: [0008] 47 d8 b3 cd e4 57 f1 a2
[ 3.404913] platform caam_sm: restored 192-bit black key:
[ 3.410330] platform caam_sm: [0000] 95 d8 3e 2f be 20 39 a9
[ 3.416018] platform caam_sm: [0008] 5b 65 9a 65 f5 5f 26 82
[ 3.421691] platform caam_sm: [0016] de af d8 e2 7d c7 82 54
[ 3.427381] platform caam_sm: [0024] 44 20 35 65 b3 56 b9 fd
[ 3.433051] platform caam_sm: restored 256-bit black key:
[ 3.438478] platform caam_sm: [0000] 85 c0 6c 02 3b 02 e2 32
[ 3.444154] platform caam_sm: [0008] f2 e4 c8 f5 a6 a7 e5 48
[ 3.449841] platform caam_sm: [0016] ba b6 4a 9c 6f 7d f4 02
[ 3.455528] platform caam_sm: [0024] 0b 54 d1 8f 9d 4d 94 86
[ 3.461488] snvs-secvio 20cc000.caam-snvs: can't get snvs clock
[ 3.467554] snvs-secvio 20cc000.caam-snvs: violation handlers armed - non-secure state
[ 3.476364] usbcore: registered new interface driver usbhid
[ 3.481949] usbhid: USB HID core driver
[ 3.491185] wm8962 0-001a: customer id 0 revision F
[ 3.513284] fsl-asrc 2034000.asrc: driver registered
[ 3.524555] input: WM8962 Beep Generator as /devices/soc0/soc/2100000.aips-bus/21a0000.i2c/i2c-0/0-001a/input/input3
[ 3.537073] imx-wm8962 sound: wm8962 <-> 202c000.ssi mapping ok
[ 3.546368] imx-wm8962 sound: snd-soc-dummy-dai <-> 2034000.asrc mapping ok
[ 3.553442] imx-wm8962 sound: wm8962 <-> 202c000.ssi mapping ok
[ 3.566361] imx-audio-hdmi sound-hdmi: hdmi-hifi <-> soc:hdmi_audio@00120000 mapping ok
[ 3.575285] NET: Registered protocol family 26
[ 3.580580] NET: Registered protocol family 10
[ 3.586117] sit: IPv6 over IPv4 tunneling driver
[ 3.591420] NET: Registered protocol family 17
[ 3.595942] can: controller area network core (rev 20120528 abi 9)
[ 3.602212] NET: Registered protocol family 29
[ 3.606703] can: raw protocol (rev 20120528)
[ 3.610999] can: broadcast manager protocol (rev 20120528 t)
[ 3.616701] can: netlink gateway (rev 20130117) max_hops=1
[ 3.622454] Bluetooth: RFCOMM TTY layer initialized
[ 3.627387] Bluetooth: RFCOMM socket layer initialized
[ 3.632552] Bluetooth: RFCOMM ver 1.11
[ 3.636353] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[ 3.641676] Bluetooth: BNEP filters: protocol multicast
[ 3.646941] Bluetooth: BNEP socket layer initialized
[ 3.651923] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[ 3.657875] Bluetooth: HIDP socket layer initialized
[ 3.662925] 8021q: 802.1Q VLAN Support v1.8
[ 3.667188] Key type dns_resolver registered
[ 3.678667] input: gpio-keys as /devices/soc0/gpio-keys/input/input6
[ 3.685368] snvs_rtc 20cc000.snvs:snvs-rtc-lp: setting system clock to 1970-01-01 00:00:01 UTC (1)
[ 3.704792] VGEN3: disabling
[ 3.708154] VGEN2: disabling

The kernel hanged after this line. It did not reboot, it just hanged.

One thing to consider: We have made some modifications to some peripheral pins, added or removed some interfaces but did not generate a new device tree. However, I do not believe this would cause the device to hang because these interfaces are simple non-essential interfaces such as UART, I2S, etc. Most of the peripherals are the same as the reference design.

I don't even know what VGEN2 is, and can't see a fatal error message in this log. Does any body see something that we're missing here?

[ugur_acikgoz]

We have just found the solution and it is very specific to our board design. It turns out, in our board VGEN2 is connected to a system voltage monitor TPS3808. When this regulator is disabled, the system monitor shutsdown the system altogether. In order to solve this, we have added "regulator-always-on" option to the vgen2 configuration in the device tree.

[igorpadykov]

Hi Uğur

one can try to debug hanging issue using AN4553 Using Open Source Debugging Tools for

Linux on i.MX Processors
https://www.nxp.com/docs/en/application-note/AN4553.pdf

and try with minimal linux configuration. This may be case that linux loads unpowered device

driver and waits answer from it.

Best regards
igor
-----------------------------------------------------------------------------------------------------------------------
Note: If this post answers your question, please click the Correct Answer button. Thank you!
-----------------------------------------------------------------------------------------------------------------------