kernel is hung for custom board based on IMX8QXPMEK

[krunaldhonde]

we are having custom board. We built a wic image and we are able to flash it. but kernel gets hung.

please refer below logs. any suggestions ?

Starting kernel ...

[ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd042]
[ 0.000000] Linux version 5.10.52-lts-5.10.y+ga11753a89ec6 (oe-user@oe-host) (aarch64-poky-linux-gcc (GCC) 10.2.0, GNU ld (GNU Binutils) 2.36.1.20210209) #1 SMP PREEMPT Wed Sep 8 10:41:11 UTC 2021
[ 0.000000] Machine model: Freescale i.MX8QXP MEK
[ 0.000000] efi: UEFI not found.
[ 0.000000] OF: fdt: Reserved memory: failed to reserve memory for node 'm4@0x88000000': base 0x0000000088000000, size 128 MiB
[ 0.000000] Reserved memory: created CMA memory pool at 0x00000000c0000000, size 960 MiB
[ 0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[ 0.000000] Reserved memory: created DMA memory pool at 0x0000000090400000, size 1 MiB
[ 0.000000] OF: reserved mem: initialized node vdevbuffer, compatible id shared-dma-pool
[ 0.000000] Reserved memory: created DMA memory pool at 0x0000000094300000, size 1 MiB
[ 0.000000] OF: reserved mem: initialized node vdev0buffer@94300000, compatible id shared-dma-pool
[ 0.000000] earlycon: lpuart32 at MMIO32 0x000000005a060000 (options '')
[ 0.000000] printk: bootconsole [lpuart32] enabled
[ 0.000000] NUMA: No NUMA configuration found
[ 0.000000] NUMA: Faking a node at [mem 0x0000000080200000-0x00000008bfffffff]
[ 0.000000] NUMA: NODE_DATA [mem 0x8bfa04700-0x8bfa06fff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000080200000-0x00000000ffffffff]
[ 0.000000] DMA32 empty
[ 0.000000] Normal [mem 0x0000000100000000-0x00000008bfffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000080200000-0x0000000083ffffff]
[ 0.000000] node 0: [mem 0x0000000084000000-0x00000000861fffff]
[ 0.000000] node 0: [mem 0x0000000086200000-0x0000000087ffffff]
[ 0.000000] node 0: [mem 0x0000000092000000-0x0000000094bfffff]
[ 0.000000] node 0: [mem 0x0000000094c00000-0x00000000ffffffff]
[ 0.000000] node 0: [mem 0x0000000880000000-0x00000008bfffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000080200000-0x00000008bfffffff]
[ 0.000000] psci: probing for conduit method from DT.
[ 0.000000] psci: PSCIv1.1 detected in firmware.
[ 0.000000] psci: Using standard PSCI v0.2 function IDs
[ 0.000000] psci: MIGRATE_INFO_TYPE not supported.
[ 0.000000] psci: SMC Calling Convention v1.2
[ 0.000000] percpu: Embedded 23 pages/cpu s56128 r8192 d29888 u94208
[ 0.000000] Detected VIPT I-cache on CPU0
[ 0.000000] CPU features: detected: GIC system register CPU interface
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 733320
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: console=ttyLP0,115200 earlycon root=/dev/mmcblk1p2 rootwait rw
[ 0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] software IO TLB: mapped [mem 0x00000000bc000000-0x00000000c0000000] (64MB)
[ 0.000000] Memory: 1764856K/2979840K available (14272K kernel code, 1330K rwdata, 5572K rodata, 2432K init, 471K bss, 231944K reserved, 983040K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[ 0.000000] rcu: Preemptible hierarchical RCU implementation.
[ 0.000000] rcu: RCU event tracing is enabled.
[ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[ 0.000000] Trampoline variant of Tasks RCU enabled.
[ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[ 0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[ 0.000000] GICv3: 512 SPIs implemented
[ 0.000000] GICv3: 0 Extended SPIs implemented
[ 0.000000] GICv3: Distributor has no Range Selector support
[ 0.000000] GICv3: 16 PPIs implemented
[ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000051b00000
[ 0.000000] random: get_random_bytes called from start_kernel+0x320/0x4e4 with crng_init=0
[ 0.000000] arch_timer: cp15 timer(s) running at 8.00MHz (phys).
[ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x1d854df40, max_idle_ns: 440795202120 ns
[ 0.000005] sched_clock: 56 bits at 8MHz, resolution 125ns, wraps every 2199023255500ns
[ 0.008677] Console: colour dummy device 80x25
[ 0.012870] Calibrating delay loop (skipped), value calculated using timer frequency.. 16.00 BogoMIPS (lpj=32000)
[ 0.023041] pid_max: default: 32768 minimum: 301
[ 0.027726] LSM: Security Framework initializing
[ 0.032319] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[ 0.039647] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[ 0.049064] rcu: Hierarchical SRCU implementation.
[ 0.056023] EFI services will not be available.
[ 0.060537] smp: Bringing up secondary CPUs ...
[ 0.065585] Detected VIPT I-cache on CPU1
[ 0.065618] GICv3: CPU1: found redistributor 1 region 0:0x0000000051b20000
[ 0.065672] CPU1: Booted secondary processor 0x0000000001 [0x410fd042]
[ 0.066561] Detected VIPT I-cache on CPU2
[ 0.066586] GICv3: CPU2: found redistributor 2 region 0:0x0000000051b40000
[ 0.066617] CPU2: Booted secondary processor 0x0000000002 [0x410fd042]
[ 0.067460] Detected VIPT I-cache on CPU3
[ 0.067483] GICv3: CPU3: found redistributor 3 region 0:0x0000000051b60000
[ 0.067510] CPU3: Booted secondary processor 0x0000000003 [0x410fd042]
[ 0.067593] smp: Brought up 1 node, 4 CPUs
[ 0.123498] SMP: Total of 4 processors activated.
[ 0.128178] CPU features: detected: 32-bit EL0 Support
[ 0.133323] CPU features: detected: CRC32 instructions
[ 0.138431] CPU features: detected: 32-bit EL1 Support
[ 0.150143] CPU: All CPU(s) started at EL2
[ 0.153968] alternatives: patching kernel code
[ 0.159497] devtmpfs: initialized
[ 0.178603] KASLR disabled due to lack of seed
[ 0.182930] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.192465] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[ 0.233266] pinctrl core: initialized pinctrl subsystem
[ 0.238909] DMI not present or invalid.
[ 0.242714] NET: Registered protocol family 16
[ 0.255986] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
[ 0.264038] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[ 0.272919] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[ 0.280587] audit: initializing netlink subsys (disabled)
[ 0.286144] audit: type=2000 audit(0.196:1): state=initialized audit_enabled=0 res=1
[ 0.286907] thermal_sys: Registered thermal governor 'step_wise'
[ 0.293629] thermal_sys: Registered thermal governor 'power_allocator'
[ 0.300134] cpuidle: using governor menu
[ 0.310545] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[ 0.317100] ASID allocator initialised with 65536 entries
[ 0.324483] Serial: AMBA PL011 UART driver
[ 0.328330] imx mu driver is registered.
[ 0.332171] imx rpmsg driver is registered.
[ 0.431460] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[ 0.437842] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[ 0.444521] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 0.451210] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[ 0.459093] cryptd: max_cpu_qlen set to 1000
[ 0.468011] ACPI: Interpreter disabled.
[ 0.473217] iommu: Default domain type: Translated
[ 0.477990] vgaarb: loaded
[ 0.480817] SCSI subsystem initialized
[ 0.484674] usbcore: registered new interface driver usbfs
[ 0.489879] usbcore: registered new interface driver hub
[ 0.495155] usbcore: registered new device driver usb
[ 0.502891] pps_core: LinuxPPS API ver. 1 registered
[ 0.507531] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 0.516656] PTP clock support registered
[ 0.520970] EDAC MC: Ver: 3.0.0
[ 0.526445] FPGA manager framework
[ 0.531839] imx-scu scu: NXP i.MX SCU Initialized
[ 0.573107] random: fast init done
[ 0.639615] imx8qxp-pinctrl scu:pinctrl: Invalid fsl,pins or pins property in node /scu/pinctrl/wifi_initgrp
[ 0.649242] imx8qxp-pinctrl scu:pinctrl: initialized IMX pinctrl driver
[ 0.674890] clocksource: Switched to clocksource arch_sys_counter
[ 0.680904] VFS: Disk quotas dquot_6.6.0
[ 0.684630] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 0.691639] pnp: PnP ACPI: disabled
[ 0.714101] PCI: CLS 0 bytes, default 64
[ 0.718452] hw perfevents: enabled with armv8_pmuv3 PMU driver, 7 counters available
[ 0.728118] kvm [1]: IPA Size Limit: 40 bits
[ 0.733521] kvm [1]: GICv3: no GICV resource entry
[ 0.737986] kvm [1]: disabling GICv2 emulation
[ 0.742421] kvm [1]: GIC system register CPU interface enabled
[ 0.748320] kvm [1]: vgic interrupt IRQ9
[ 0.752277] kvm [1]: Hyp mode initialized successfully
[ 0.761560] Initialise system trusted keyrings
[ 0.765845] workingset: timestamp_bits=42 max_order=20 bucket_order=0
[ 0.778830] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 0.784498] jffs2: version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
[ 0.838187] Key type asymmetric registered
[ 0.841954] Asymmetric key parser 'x509' registered
[ 0.846848] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[ 0.854198] io scheduler mq-deadline registered
[ 0.858715] io scheduler kyber registered
[ 0.890383] pwm-backlight lvds_backlight@0: supply power not found, using dummy regulator
[ 0.898748] pwm-backlight lvds_backlight@1: supply power not found, using dummy regulator
[ 0.907966] EINJ: ACPI disabled.
[ 1.011168] mxs-dma 5b810000.dma-apbh: initialized
[ 1.021959] Bus freq driver module loaded
[ 1.034936] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 1.047050] 5a060000.serial: ttyLP0 at MMIO 0x5a060010 (irq = 58, base_baud = 5000000) is a FSL_LPUAR[ 1.056230] printk: console [ttyLP0] enabled
[ 1.056230] printk: console [ttyLP0] enabled
[ 1.064645] printk: bootconsole [lpuart32] disabled
[ 1.064645] printk: bootconsole [lpuart32] disabled
[ 1.075719] 5a070000.serial: ttyLP1 at MMIO 0x5a070010 (irq = 59, base_baud = 5000000) is a FSL_LPUART
[ 1.086350] 5a080000.serial: ttyLP2 at MMIO 0x5a080010 (irq = 60, base_baud = 5000000) is a FSL_LPUART
[ 1.152792] nwl-dsi 56228000.dsi_host: [drm:nwl_dsi_probe] *ERROR* Failed to get device IRQ: -517
[ 1.162439] nwl-dsi 56248000.dsi_host: [drm:nwl_dsi_probe] *ERROR* Failed to get device IRQ: -517
[ 1.180489] loop: module loaded
[ 1.186310] megasas: 07.714.04.00-rc1
[ 1.194035] imx ahci driver is registered.
[ 1.210642] libphy: Fixed MDIO Bus: probed
[ 1.219312] thunder_xcv, ver 1.0
[ 1.222608] thunder_bgx, ver 1.0
[ 1.225891] nicpf, ver 1.0
[ 1.230906] pps pps0: new PPS source ptp0
[ 1.248286] hclge is initializing
[ 1.251660] e1000: Intel(R) PRO/1000 Network Driver
[ 1.256548] e1000: Copyright (c) 1999-2006 Intel Corporation.
[ 1.262379] e1000e: Intel(R) PRO/1000 Network Driver
[ 1.267382] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[ 1.273369] igb: Intel(R) Gigabit Ethernet Network Driver
[ 1.278785] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 1.284414] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[ 1.290687] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[ 1.297237] sky2: driver version 1.30
[ 1.302439] usbcore: registered new interface driver r8152
[ 1.308039] usbcore: registered new interface driver asix
[ 1.313496] usbcore: registered new interface driver ax88179_178a
[ 1.319633] usbcore: registered new interface driver cdc_ether
[ 1.325503] usbcore: registered new interface driver net1080
[ 1.331209] usbcore: registered new interface driver cdc_subset
[ 1.337178] usbcore: registered new interface driver zaurus
[ 1.342807] usbcore: registered new interface driver cdc_ncm
[ 1.348822] VFIO - User Level meta-driver version: 0.3
[ 1.366543] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 1.373117] ehci-pci: EHCI PCI platform driver
[ 1.377652] ehci-platform: EHCI generic platform driver
[ 1.383754] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 1.389981] ohci-pci: OHCI PCI platform driver
[ 1.394497] ohci-platform: OHCI generic platform driver
[ 1.402477] usbcore: registered new interface driver uas
[ 1.407877] usbcore: registered new interface driver usb-storage
[ 1.413992] usbcore: registered new interface driver usbserial_generic
[ 1.420557] usbserial: USB Serial support registered for generic
[ 1.426708] usbcore: registered new interface driver ftdi_sio
[ 1.432489] usbserial: USB Serial support registered for FTDI USB Serial Device
[ 1.439846] usbcore: registered new interface driver usb_serial_simple
[ 1.446406] usbserial: USB Serial support registered for carelink
[ 1.452531] usbserial: USB Serial support registered for zio
[ 1.458224] usbserial: USB Serial support registered for funsoft
[ 1.464259] usbserial: USB Serial support registered for flashloader
[ 1.470642] usbserial: USB Serial support registered for google
[ 1.476595] usbserial: USB Serial support registered for libtransistor
[ 1.483154] usbserial: USB Serial support registered for vivopay
[ 1.489195] usbserial: USB Serial support registered for moto_modem
[ 1.495491] usbserial: USB Serial support registered for motorola_tetra
[ 1.502137] usbserial: USB Serial support registered for novatel_gps
[ 1.508532] usbserial: USB Serial support registered for hp4x
[ 1.514308] usbserial: USB Serial support registered for suunto
[ 1.520259] usbserial: USB Serial support registered for siemens_mpi
[ 1.526658] usbcore: registered new interface driver usb_ehset_test
[ 1.542640] input: sc-powerkey as /devices/platform/sc-powerkey/input/input0
[ 1.553820] imx-sc-rtc scu:rtc: registered as rtc0
[ 1.558912] imx-sc-rtc scu:rtc: setting system clock to 1970-01-01T00:02:01 UTC (121)
[ 1.568337] i2c /dev entries driver
[ 1.585782] sdhci: Secure Digital Host Controller Interface driver
[ 1.592023] sdhci: Copyright(c) Pierre Ossman
[ 1.597608] Synopsys Designware Multimedia Card Interface Driver
[ 1.605822] sdhci-pltfm: SDHCI platform and OF driver helper
[ 1.614700] mmc0: CQHCI version 5.10
[ 1.614913] mmc1: CQHCI version 5.10
[ 1.618333] sdhci-esdhc-imx 5b010000.mmc: voltage-ranges unspecified
[ 1.621931] sdhci-esdhc-imx 5b020000.mmc: voltage-ranges unspecified
[ 1.628262] ledtrig-cpu: registered to indicate activity on CPUs
[ 1.643541] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[ 1.650601] usbcore: registered new interface driver usbhid
[ 1.656197] usbhid: USB HID core driver
[ 1.659875] mmc0: SDHCI controller on 5b010000.mmc [5b010000.mmc] using ADMA
[ 1.676612] Galcore version 6.4.3.p2.336687
[ 1.791267] [drm] Initialized vivante 1.0.0 20170808 for 80000000.imx8_gpu0_ss on minor 0
[ 1.802239] 8021q: 802.1Q VLAN Support v1.8
[ 1.806486] lib80211: common routines for IEEE802.11 drivers
[ 1.812345] 9pnet: Installing 9P2000 support
[ 1.817027] registered taskstats version 1
[ 1.821148] Loading compiled-in X.509 certificates
[ 1.853599] mxs_phy 5b100000.usbphy: supply phy-3p0 not found, using dummy regulator
[ 1.880566] imx-lpi2c 58226000.i2c: can't get the TX DMA channel, error -19!
[ 1.887652] imx-lpi2c 58226000.i2c: error -ENODEV: dma setup error -19, use pio
[ 1.898401] i2c i2c-16: LPI2C adapter registered
[ 1.913547] pwm-backlight lvds_backlight@0: supply power not found, using dummy regulator
[ 1.926393] pwm-backlight lvds_backlight@1: supply power not found, using dummy regulator
[ 1.945028] dpu-core 56180000.dpu: driver probed
[ 1.954645] pps pps0: new PPS source ptp0
[ 1.966301] fec 5b040000.ethernet: Invalid MAC address: 00:00:00:00:00:00
[ 1.973169] fec 5b040000.ethernet: Using random MAC address: 5e:d0:09:6f:fd:4a
[ 1.984277] libphy: fec_enet_mii_bus: probed
[ 1.992534] fec 5b040000.ethernet eth0: registered PHC device 0
[ 2.067565] mmc1: CQHCI version 5.10
[ 2.071200] sdhci-esdhc-imx 5b020000.mmc: voltage-ranges unspecified
[ 2.073972] imx-lpi2c 56226000.i2c: can't get the TX DMA channel, error -19!
[ 2.077633] sdhci-esdhc-imx 5b020000.mmc: Got CD GPIO
[ 2.084692] imx-lpi2c 56226000.i2c: error -ENODEV: dma setup error -19, use pio
[ 2.103585] adv7511 17-003d: supply avdd not found, using dummy regulator
[ 2.110528] adv7511 17-003d: supply dvdd not found, using dummy regulator
[ 2.117378] adv7511 17-003d: supply pvdd not found, using dummy regulator
[ 2.121657] mmc1: SDHCI controller on 5b020000.mmc [5b020000.mmc] using ADMA
[ 2.124329] adv7511 17-003d: supply a2vdd not found, using dummy regulator
[ 2.138312] adv7511 17-003d: supply v3p3 not found, using dummy regulator
[ 2.145180] adv7511 17-003d: supply v1p2 not found, using dummy regulator
[ 2.152595] adv7511 17-003d: Probe failed. Remote port 'dsi_host@56228000' disabled
[ 2.160459] i2c i2c-17: LPI2C adapter registered
[ 2.166461] imx-lpi2c 56246000.i2c: can't get the TX DMA channel, error -19!
[ 2.173565] imx-lpi2c 56246000.i2c: error -ENODEV: dma setup error -19, use pio
[ 2.187215] adv7511 18-003d: supply avdd not found, using dummy regulator
[ 2.194178] adv7511 18-003d: supply dvdd not found, using dummy regulator
[ 2.201048] adv7511 18-003d: supply pvdd not found, using dummy regulator
[ 2.207906] adv7511 18-003d: supply a2vdd not found, using dummy regulator
[ 2.214853] adv7511 18-003d: supply v3p3 not found, using dummy regulator
[ 2.221745] adv7511 18-003d: supply v1p2 not found, using dummy regulator
[ 2.229145] adv7511 18-003d: Probe failed. Remote port 'dsi_host@56248000' disabled
[ 2.236971] i2c i2c-18: LPI2C adapter registered
[ 2.400626] mmc1: new ultra high speed SDR104 SDHC card at address aaaa
[ 2.407994] mmcblk1: mmc1:aaaa SA16G 14.8 GiB
[ 2.415048] mmcblk1: p1 p2
[ 10.150292] random: crng init don

[igorpadykov]

Hi Krunal

form log there are no errors. How many boards are affected by this issue, if this is one

board, reason may be poor soldering, one can try to resolder chip.

Best regards
igor