IMX6 project device can't boot up after run a long time with a ubifs error

[zhuang18]

My imx6 board uses the MT29F4G08ABADA 4GB nandflash. The operating system is linux(Linux imx6qsabreauto 4.1.15 #1 SMP PREEMPT Fri Aug 3 02:23:14 EDT 2018 armv7l GNU/Linux
) and the file system is ubifs.
we receive after sale problem in succession that the system can't boot up.The boot log seems that is a ubifs error problem,
there are two types of error log
1.UBIFS error (ubi0:0 pid 1): ubifs_replay_journal: no UBIFS nodes found at the log head LEB 6:0, possibly corrupted
2.UBIFS error (ubi0:0 pid 1): ubifs_recover_master_node: failed to recover master node

How to fix that?

Thank you for your help.

------------------------------------------------------------------------------------------------------------------------------------------

U-Boot 2016.03 (Mar 08 2018 - 21:21:16 +0800)

I2C:   ready
DRAM:  512 MiB
NAND:  512 MiB
Using default environment

In:    serial
Out:   serial
Err:   serial
Normal Boot
Autoboot in 0 seconds

NAND read: device 0 offset 0x200000, size 0x300000
 3145728 bytes read: OK

NAND read: device 0 offset 0x500000, size 0x20000
 131072 bytes read: OK
Kernel image @ 0x12000000 [ 0x000000 - 0x26d3f0 ]
## Flattened Device Tree blob at 18000000
   Booting using the fdt blob at 0x18000000
   Using Device Tree in place at 18000000, end 1800e3e7

Starting kernel ...

Booting Linux on physical CPU 0x0
Linux version 4.1.15-00158-g30278ab-dirty (neu@ubuntu) (gcc version 6.2.0 (GCC)                                              ) #43 SMP PREEMPT Mon Jan 14 14:32:16 CST 2019
CPU: ARMv7 Processor [412fc09a] revision 10 (ARMv7), cr=10c53c7d
CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
Machine model: Freescale i.MX6 Quad SABRE Automotive Board
Reserved memory: created CMA memory pool at 0x1c000000, size 320 MiB
Reserved memory: initialized node linux,cma, compatible id shared-dma-pool
Memory policy: Data cache writealloc
PERCPU: Embedded 10 pages/cpu @8bb23000 s12048 r8192 d20720 u40960
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 130048
Kernel command line: console=ttymxc1,115200 ubi.mtd=4 ubi.fm_autoconvert=1 init=                                             /sbin/init root=ubi0:rootfs rootfstype=ubifs mtdparts=gpmi-nand:2m(boot),3m(kern                                             el),1m(dtb),1m(bbt),-(rootfs)
PID hash table entries: 2048 (order: 1, 8192 bytes)
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Memory: 186188K/524288K available (3496K kernel code, 252K rwdata, 828K rodata,                                              184K init, 212K bss, 10420K reserved, 327680K cma-reserved)
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
    vmalloc : 0xa0800000 - 0xff000000   (1512 MB)
    lowmem  : 0x80000000 - 0xa0000000   ( 512 MB)
    modules : 0x7f000000 - 0x80000000   (  16 MB)
      .text : 0x80008000 - 0x80441438   (4326 kB)
      .init : 0x80442000 - 0x80470000   ( 184 kB)
      .data : 0x80470000 - 0x804af240   ( 253 kB)
       .bss : 0x804b2000 - 0x804e70d0   ( 213 kB)
SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
Preemptible hierarchical RCU implementation.
        Additional per-CPU info printed with stalls.
        RCU restricting CPUs from NR_CPUS=4 to nr_cpu_ids=2.
RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
NR_IRQS:16 nr_irqs:16 16
L2C-310 erratum 769419 enabled
L2C-310 enabling early BRESP for Cortex-A9
L2C-310 full line of zeros enabled for Cortex-A9
L2C-310 ID prefetch enabled, offset 16 lines
L2C-310 dynamic clock gating enabled, standby mode enabled
L2C-310 cache controller enabled, 16 ways, 1024 kB
L2C-310: CACHE_ID 0x410000c7, AUX_CTRL 0x76470001
clk: failed to reparent ldb_di0_sel to pll3_usb_otg: -38
clk: failed to reparent ldb_di1_sel to pll3_usb_otg: -38
clk: failed to reparent ldb_di0_sel to pll3_usb_otg: -38
clk: failed to reparent ldb_di1_sel to pll3_usb_otg: -38
mxc_clocksource_init 3000000
Switching to timer-based delay loop, resolution 333ns
sched_clock: 32 bits at 3000kHz, resolution 333ns, wraps every 715827882841ns
clocksource mxc_timer1: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 63                                             7086815595 ns
Console: colour dummy device 80x30
Calibrating delay loop (skipped), value calculated using timer frequency.. 6.00                                              BogoMIPS (lpj=30000)
pid_max: default: 32768 minimum: 301
Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
CPU: Testing write buffer coherency: ok
CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
Setting up static identity map for 0x10008280 - 0x100082d8
CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
Brought up 2 CPUs
SMP: Total of 2 processors activated (12.00 BogoMIPS).
CPU: All CPU(s) started in SVC mode.
devtmpfs: initialized
VFP support v0.3: implementor 41 architecture 3 part 30 variant 9 rev 4
clocksource jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112                                             604462750000 ns
pinctrl core: initialized pinctrl subsystem
DMA: preallocated 256 KiB pool for atomic coherent allocations
cpuidle: using governor ladder
cpuidle: using governor menu
CPU identified as i.MX6Q, silicon rev 1.5
hw-breakpoint: found 5 (+1 reserved) breakpoint and 1 watchpoint registers.
hw-breakpoint: maximum watchpoint size is 4 bytes.
imx6q-pinctrl 20e0000.iomuxc: Invalid fsl,pins property in node /soc/aips-bus@02                                             000000/iomuxc@020e0000/imx6qdl-sabreauto/enetirqgrp
imx6q-pinctrl 20e0000.iomuxc: initialized IMX pinctrl driver
imx-gpc 20dc000.gpc: no fsl,ldo-bypass found!
mxs-dma 110000.dma-apbh: initialized
2000000.aips-bus:usbphy_nop1 supply vcc not found, using dummy regulator
2000000.aips-bus:usbphy_nop2 supply vcc not found, using dummy regulator
i2c i2c-0: IMX I2C adapter registered
i2c i2c-0: can't use DMA
i2c i2c-1: IMX I2C adapter registered
i2c i2c-1: can't use DMA
pca953x 2-0030: failed reading register
pca953x: probe of 2-0030 failed with error -5
pca953x 2-0032: failed reading register
pca953x: probe of 2-0032 failed with error -5
pca953x 2-0034: failed reading register
pca953x: probe of 2-0034 failed with error -5
i2c i2c-2: IMX I2C adapter registered
i2c i2c-2: can't use DMA
Linux video capture interface: v2.00
imx-ipuv3 2400000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
imx-ipuv3 2800000.ipu: IPU DMFC NORMAL mode: 1(0~1), 5B(4,5), 5F(6,7)
mxc_mipi_csi2 21dc000.mipi_csi: i.MX MIPI CSI2 driver probed
mxc_mipi_csi2 21dc000.mipi_csi: i.MX MIPI CSI2 dphy version is 0x3130302a
MIPI CSI2 driver module loaded
Advanced Linux Sound Architecture Driver Initialized.
Switched to clocksource mxc_timer1
CPU PMU: Failed to parse /soc/pmu/interrupt-affinity[0]
hw perfevents: enabled with armv7_cortex_a9 PMU driver, 7 counters available
Bus freq driver module loaded
futex hash table entries: 512 (order: 3, 32768 bytes)
alg: No test for stdrng (krng)
Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
MIPI DSI driver module loaded
MIPI DSI driver module loaded
ldb 2000000.aips-bus:ldb@020e0008: split mode
ldb 2000000.aips-bus:ldb@020e0008: split mode or dual mode, ignoring second outp                                             ut
20e0000.hdmi_video supply HDMI not found, using dummy regulator
ldb 2000000.aips-bus:ldb@020e0008: ldb_init primary_chno=0
mxc_sdc_fb fb@0: registered mxc display driver ldb
imx-ipuv3 2800000.ipu: IPU DMFC DP HIGH RESOLUTION: 1(0,1), 5B(2~5), 5F(6,7)
imx-sdma 20ec000.sdma: no iram assigned, using external mem
imx-sdma 20ec000.sdma: no event needs to be remapped
imx-sdma 20ec000.sdma: loaded firmware 3.3
imx-sdma 20ec000.sdma: initialized
pfuze100-regulator 1-0008: unrecognized pfuze chip ID!
pfuze100-regulator: probe of 1-0008 failed with error -11
2020000.serial: ttymxc0 at MMIO 0x2020000 (irq = 26, base_baud = 5000000) is a I                                             MX
21e8000.serial: ttymxc1 at MMIO 0x21e8000 (irq = 299, base_baud = 5000000) is a                                              IMX
console [ttymxc1] enabled
[drm] Initialized drm 1.1.0 20060810
[drm] Initialized vivante 1.0.0 20120216 on minor 0
si476x-core 1-0063: Using default platform data.
si476x-core 1-0063: No IRQ number specified, will use polling
si476x-core 1-0063: Error while sending command 0x11
si476x-core 1-0063: The device in inconsistent power state
nand: device found, Manufacturer ID: 0x2c, Chip ID: 0xdc
nand: Micron MT29F4G08ABADAWP
nand: 512 MiB, SLC, erase size: 128 KiB, page size: 2048, OOB size: 64
gpmi-nand 112000.gpmi-nand: enable the asynchronous EDO mode 5
Bad block table found at page 262080, version 0x01
Bad block table found at page 262016, version 0x01
5 cmdlinepart partitions found on MTD device gpmi-nand
Creating 5 MTD partitions on "gpmi-nand":
0x000000000000-0x000000200000 : "boot"
0x000000200000-0x000000500000 : "kernel"
0x000000500000-0x000000600000 : "dtb"
0x000000600000-0x000000700000 : "bbt"
0x000000700000-0x000020000000 : "rootfs"
gpmi-nand 112000.gpmi-nand: driver registered.
2184800.usbmisc supply vbus-wakeup not found, using dummy regulator
snvs_rtc 20cc000.snvs:snvs-rtc-lp: rtc core: registered 20cc000.snvs:snvs-r as r                                             tc0
i2c /dev entries driver
End of mxc_v4l2_master_attach: v2f pix widthxheight 288 x 352
End of mxc_v4l2_master_attach: crop_bounds widthxheight 1024 x 600
End of mxc_v4l2_master_attach: crop_defrect widthxheight 1024 x 600
End of mxc_v4l2_master_attach: crop_current widthxheight 1024 x 600
imx2-wdt 20bc000.wdog: timeout 60 sec (nowayout=0)
218c000.mlb supply reg_nvcc not found, using dummy regulator
mxc_mlb150 218c000.mlb: enalbe regulator
mxc_vdoa 21e4000.vdoa: i.MX Video Data Order Adapter(VDOA) driver probed
Galcore version 5.0.11.41671
tas2505: tas2505_probe, client->flags=0x0,client->addr=0x18,id->name=tas2505
Joe: asoc_simple_card_probe
fsl-asrc 2034000.asrc: driver registered
Joe: asoc_simple_card_probe
tas2505: tas2505_codec_probe
asoc-simple-card sound-tas2505: tas2505-amplifier <-> 202c000.ssi mapping ok
Joe: asoc_simple_card_probe: devm_snd_soc_register_card: ret=0
ubi0: attaching mtd4
random: nonblocking pool is initialized
ubi0: scanning is finished
ubi0: attached mtd4 (name "rootfs", size 505 MiB)
ubi0: PEB size: 131072 bytes (128 KiB), LEB size: 126976 bytes
ubi0: min./max. I/O unit sizes: 2048/2048, sub-page size 2048
ubi0: VID header offset: 2048 (aligned 2048), data offset: 4096
ubi0: good PEBs: 4036, bad PEBs: 4, corrupted PEBs: 0
ubi0: user volume: 1, internal volumes: 1, max. volumes count: 128
ubi0: max/mean erase counter: 3/0, WL threshold: 4096, image sequence number: 153353654
ubi0: available PEBs: 0, total reserved PEBs: 4036, PEBs reserved for bad PEB handling: 76
ubi0: background thread "ubi_bgt0d" started, PID 55
snvs_rtc 20cc000.snvs:snvs-rtc-lp: setting system clock to 1970-01-01 00:00:02 UTC (2)
ALSA device list:
  #0: tas2505
UBIFS (ubi0:0): recovery needed
UBIFS error (ubi0:0 pid 1): ubifs_replay_journal: no UBIFS nodes found at the log head LEB 9:0, possibly corrupted
List of all partitions:
No filesystem could mount root, tried:  ubifs
Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-block(0,0)
CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.1.15-00158-g30278ab-dirty #43
Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
Function entered at [<80014928>] from [<80011840>]
Function entered at [<80011840>] from [<80351454>]
Function entered at [<80351454>] from [<803509d8>]
Function entered at [<803509d8>] from [<804430a8>]
Function entered at [<804430a8>] from [<80443230>]
Function entered at [<80443230>] from [<80442cc0>]
Function entered at [<80442cc0>] from [<8034fdd8>]
Function entered at [<8034fdd8>] from [<8000e908>]
CPU1: stopping
CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.1.15-00158-g30278ab-dirty #43
Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
Function entered at [<80014928>] from [<80011840>]
Function entered at [<80011840>] from [<80351454>]
Function entered at [<80351454>] from [<800138d4>]
Function entered at [<800138d4>] from [<800093cc>]
Function entered at [<800093cc>] from [<80012280>]
Exception stack(0x8607ff70 to 0x8607ffb8)
ff60:                                     00000000 804d71ac 00000001 00000000
ff80: bd21e32a 00000000 00000001 8bb2ee48 b9775ec0 00000000 00000004 8046e640
ffa0: 00000000 8607ffb8 80355474 802d1530 60000113 ffffffff
Function entered at [<80012280>] from [<802d1530>]
Function entered at [<802d1530>] from [<800535c8>]
Function entered at [<800535c8>] from [<1000946c>]
---[ end Kernel panic - not syncing: VFS: Unable to mount root fs on unknown-blo                                             ck(0,0)
------------[ cut here ]------------
WARNING: CPU: 0 PID: 1 at kernel/time/tick-broadcast.c:621 0x800743ec()
Modules linked in:
CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.1.15-00158-g30278ab-dirty #43
Hardware name: Freescale i.MX6 Quad/DualLite (Device Tree)
Function entered at [<80014928>] from [<80011840>]
Function entered at [<80011840>] from [<80351454>]
Function entered at [<80351454>] from [<80028c64>]
Function entered at [<80028c64>] from [<80028d20>]
Function entered at [<80028d20>] from [<800743ec>]
Function entered at [<800743ec>] from [<8001db2c>]
Function entered at [<8001db2c>] from [<8005ad74>]
Function entered at [<8005ad74>] from [<8005aea8>]
Function entered at [<8005aea8>] from [<8005dbf8>]
Function entered at [<8005dbf8>] from [<8005a550>]
Function entered at [<8005a550>] from [<8005a844>]
Function entered at [<8005a844>] from [<800093b4>]
Function entered at [<800093b4>] from [<80012280>]
Exception stack(0x8605dde0 to 0x8605de28)
dde0: 00000000 803c7601 8605c000 00000000 80472100 8605c000 00000202 804b3080
de00: 86008000 00000001 8605dea8 803aacf1 00000001 8605de28 8002b7e8 8002b7f4
de20: 20000113 ffffffff
Function entered at [<80012280>] from [<8002b7f4>]
Function entered at [<8002b7f4>] from [<8002bbe4>]
Function entered at [<8002bbe4>] from [<8005a814>]
Function entered at [<8005a814>] from [<800093b4>]
Function entered at [<800093b4>] from [<80012280>]
Exception stack(0x8605dea8 to 0x8605def0)
dea0:                   00000057 00000002 00000001 8605c000 804b2be8 00000000
dec0: 00008001 00000000 80466028 ffffffea 80466018 803aacf1 804d4478 8605def0
dee0: 80350a6c 80350a70 20000113 ffffffff
Function entered at [<80012280>] from [<80350a70>]
Function entered at [<80350a70>] from [<804430a8>]
Function entered at [<804430a8>] from [<80443230>]
Function entered at [<80443230>] from [<80442cc0>]
Function entered at [<80442cc0>] from [<8034fdd8>]
Function entered at [<8034fdd8>] from [<8000e908>]
---[ end trace 1c9713066db0978c ]---