MX6D hangs randomly on back-to-back reboot test with Android JB4.3_1.1.0 BSP

[YongJunChang]

Hi all,

We are developing a system using MX6D (silicon rev 1.2) with Android JB4.3_1.1.0 BSP.

The system uses an 8bit eMMC as a boot source.

It has been looked working fine so far. But when we do a back-to-back reboot testing ( around 1sec term ), it hangs with the following message.

===============================================================================================================

CPU: Freescale i.MX6 family TO1.2 at 792 MHz
Thermal sensor with ratio = 179
Temperature:   36 C, calibration data 0x56d4c67d
mx6q pll1: 792MHz
mx6q pll2: 528MHz
mx6q pll3: 480MHz
mx6q pll8: 50MHz
ipg clock     : 66000000Hz
ipg per clock : 66000000Hz
uart clock    : 80000000Hz
cspi clock    : 60000000Hz
ahb clock     : 132000000Hz
axi clock   : 264000000Hz
emi_slow clock: 132000000Hz
ddr clock     : 528000000Hz
usdhc1 clock  : 198000000Hz
usdhc2 clock  : 198000000Hz
usdhc3 clock  : 198000000Hz
usdhc4 clock  : 198000000Hz
nfc clock     : 24000000Hz
DRAM:   1 GB
MMC:   FSL_USDHC: 0,FSL_USDHC: 1,FSL_USDHC: 2,FSL_USDHC: 3
csd is 0xd04f0132, 0xf5913ff, 0xffffffe7, 0x8a400000
*** Warning - bad CRC or MMC, using default environment

In:    serial
Out:   serial
Err:   serial
board_late_init : MMC_BOOT

kernel   @ 10808000 (3386112)
ramdisk  @ 11800000 (238506)
kernel cmdline:
        use uboot command line:
        arm_freq=800 console=ttymxc0,115200n8 init=/init video=mxcfb0:dev=ldb,SVGA,if=RGB24,ldb=sin0,fbpix=RGB32,bpp=32 video=mxcfb1:off video=mxcfb2:off fbmem=10M fb0base=0x27b00000 vmalloc=400M androidboot.console=ttymxc0 androidboot.hardware=freescale ldo_active=on

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.0.35 (ychang@ubuntu) (gcc version 4.6.x-google 20120106 (prerelease) (GCC) ) #111 SMP Sun Jun 1 14:52:08 KST 2014
[    0.000000] Ignoring unrecognised tag 0x54410008
[    0.000000] Kernel command line: arm_freq=800 console=ttymxc0,115200n8 init=/init video=mxcfb0:dev=ldb,SVGA,if=RGB24,ldb=sin0,fbpix=RGB32,bpp=32 video=mxcfb1:off video=mxcfb2:off fbmem=10M fb0base=0x27b00000 vmalloc=400M androidboot.console=ttymxc0 androidboot.hardware=freescale ldo_active=on
[    0.000000] PID hash table entries: 4096 (order: 2, 16384 bytes)
[    0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
[    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Memory: 379MB 427MB = 806MB total
[    0.000000] Memory: 808552k/808552k available, 240024k reserved, 0K highmem
[    0.000000] Virtual kernel memory layout:
[    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
[    0.000000]     fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
[    0.000000]     DMA     : 0xfbe00000 - 0xffe00000   (  64 MB)
[    0.000000]     vmalloc : 0xc0800000 - 0xf2000000   ( 792 MB)
[    0.000000]     lowmem  : 0x80000000 - 0xc0000000   (1024 MB)
[    0.000000]     pkmap   : 0x7fe00000 - 0x80000000   (   2 MB)
[    0.000000]     modules : 0x7f000000 - 0x7fe00000   (  14 MB)
[    0.000000]       .init : 0x80008000 - 0x80039000   ( 196 kB)
[    0.000000]       .text : 0x80039000 - 0x805adf20   (5588 kB)
[    0.000000]       .data : 0x805ae000 - 0x805fd240   ( 317 kB)
[    0.000000]        .bss : 0x805fd264 - 0x8074f20c   (1352 kB)
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS:624
[    0.000000] MXC GPIO hardware
[    0.000000] arm_max_freq=800MHz
[    0.000000] MXC_Early serial console at MMIO 0x2020000 (options '115200n8')
[    0.000000] bootconsole [ttymxc0] enabled
[    0.260351] Mount-cache hash table entries: 512
[    0.265685] Initializing cgroup subsys debug
[    0.269977] Initializing cgroup subsys cpuacct
[    0.274531] Initializing cgroup subsys freezer
[    0.279023] CPU: Testing write buffer coherency: ok
[    0.285057] Internal error: Oops - undefined instruction: 0 [#1] SMP
[    0.291435] Modules linked in:
[    0.294516] CPU: 0    Not tainted  (3.0.35 #111)
[    0.299156] PC is at search_extable+0x0/0x3c
[    0.303453] LR is at search_exception_tables+0x18/0x34
[    0.308611] pc : [<801c2b88>]    lr : [<80084a00>]    psr: 20000113
[    0.308617] sp : b0031d40  ip : b0031e68  fp : 00000009
[    0.320135] r10: 00000805  r9 : 20000113  r8 : 00000000
[    0.325377] r7 : b0024780  r6 : 00000000  r5 : b0031e68  r4 : 801c2534
[    0.331924] r3 : 00000001  r2 : 801c2534  r1 : 805ca870  r0 : 805c9ae0
[    0.338473] Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment kernel
[    0.345804] Control: 10c53c7d  Table: 1000404a  DAC: 00000015
[    0.351568]
[    0.351570] PC: 0x801c2b08:
[    0.355860] 2b08  e92d4010 e59030b4 e3530000 0a00000c e59020b8 e590c0c0 e5921000 e15c0001
[    0.364176] 2b28  8a000007 e59040c8 e08cc004 e151000c 32822008 32433001 358020b8 358030b4
[    0.372501] 2b48  3affffef e59030b4 e3530000 08bd8010 e59020b8 e2433001 e59010c0 e7922183
[    0.380815] 2b68  e1510002 88bd8010 e590c0c8 e081100c e1520001 28bd8010 ffff30b4 eafffff0
[    0.389128] 2b88  fdf73000 ea000008 7fb7c001 e1a0c24c ff7b018c e793c18c e15c0002 32803008
[    0.397444] 2ba8  3a000001 912fff1e e2401008 e1530001 9afffff4 e3a00000 e12fff1e e92d4010
[    0.405759] 2bc8  e3a02001 e5903000 e201401f ea000004 e5b03004 e3530000 08bd8010 e1a012c1
[    0.414075] 2be8  e201401f e593c000 e18cc412 e583c000 e5933000 e3730001 0afffff4 e8bd8010
[    0.422392]
[    0.422395] LR: 0x80084980:
[    0.426685] 4980  e5930140 eaffffda e1a0200d e3c23d7f e3c3303f e593300c e5933294 e5931010
[    0.435002] 49a0  eaffffd3 e92d4070 e1a04000 e1a05001 e1a00004 e1a01005 ebfffdd3 e2506000
[    0.443314] 49c0  1a000004 e1a01004 e1a00005 ebfffe4c e2504000 cafffff5 e1a00006 e8bd8070
[    0.451628] 49e0  e2800008 eaff72ee e92d4010 e1a04000 e59f101c e1a02004 e59f0018 eb04f861
[    0.459941] 4a00  e3500000 18bd8010 e1a00004 e8bd4010 ea0063ce 805ca870 805c9ae0 e59f3050
[    0.468254] 4a20  e1500003 3a000003 e59f3048 e1500003 93a00001 912fff1e e59f303c e5933000
[    0.476564] 4a40  e3530000 13a00000 112fff1e e59f202c e1500002 3a000004 e59f3024 e1530000
[    0.484874] 4a60  33a00000 23a00001 e12fff1e e1a00003 e12fff1e 80008000 805adf20 805c3a20
[    0.493190]
[    0.493193] SP: 0xb0031cc0:
[    0.497484] 1cc0  59ffbefd 9fec9fd7 dbabc4ff fffffffd fcdeaffe 7fdcfedd daafd6ff fff7bf7d
[    0.505800] 1ce0  0000ffdf ffffffff b0031d2c b0030050 00000001 8003e184 805c9ae0 805ca870
[    0.514116] 1d00  801c2534 00000001 801c2534 b0031e68 00000000 b0024780 00000000 20000113
[    0.522430] 1d20  00000805 00000009 b0031e68 b0031d40 80084a00 801c2b88 20000113 ffffffff
[    0.530742] 1d40  b0031e68 80047d6c 00000805 80048124 0000fd7e fe6efeff 0000f97c d26ceb2f
[    0.539055] 1d60  b7fdfbfd de7cfffa f9cbfddd 00008000 00000000 900bdcb0 00000041 0003148e
[    0.547367] 1d80  805fc520 805fc520 00000000 00000000 80d50b78 00000000 00000000 800bdcb0
[    0.555678] 1da0  00000041 0003151c 00000805 805cbde4 00000000 b0031e68 805d78d8 20000113
[    0.563990]
[    0.563992] IP: 0xb0031de8:
[    0.568283] 1de8  40000013 805fc540 00000001 80d50c00 805fc520 800bf3b8 00000041 805fcfa0
[    0.576601] 1e08  00000000 00000002 000200d0 800bfb08 805fcfa4 00000000 805fc520 00000000
[    0.584917] 1e28  00000000 00000001 80d508a0 fffffffe 00000001 805fc520 00000000 000000d0
[    0.593229] 1e48  00000001 00000000 00004780 ffffffff b0031e9c 805d78d8 00000000 8003e06c
[    0.601542] 1e68  00000009 b000f000 0000ffff 00000000 805d78dc 00000008 805d78d8 00000000
[    0.609854] 1e88  805d78d8 00000009 00000000 00000009 00000000 b0031eb0 800845ac 801c2534
[    0.618165] 1ea8  20000013 ffffffff b0060000 b0061fb0 b00282e0 b00282fc 00000001 00000000
[    0.626479] 1ec8  b0060000 b0045b60 00800711 00000000 00000000 00000000 00000000 b0030000
[    0.634793]
[    0.634795] R0: 0x805c9a60:
[    0.639086] 9a60  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[    0.647398] 9a80  000001b8 00000000 00000000 00000000 00000000 00000000 00000000 5f4e4143
[    0.655710] 9aa0  004d4342 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[    0.664021] 9ac0  00000000 8042da94 00000000 00000000 00000000 00000000 00000000 00000000
[    0.672332] 9ae0  8003e380 80442da0 8003e388 80442da0 8003e398 80442da0 80040aa4 80442da4
[    0.680642] 9b00  80040ac0 80442dac 80040b40 80442db4 80040b4c 80442dbc 80040b58 80442dc4
[    0.688958] 9b20  80040b64 80442dcc 80040b70 80442dd4 80040b7c 80442ddc 80040b88 80442de4
[    0.697274] 9b40  80040b94 80442dec 80040ba0 80442df4 80040bac 80442dfc 80040bb8 80442e04
[    0.705591]
[    0.705593] R1: 0x805ca7f0:
[    0.709883] a7f0  801c1fe8 801c1ff8 801c1fec 801c1ff8 801c2408 804435b0 801c2444 804435c0
[    0.718197] a810  801ccb70 804435c8 801cd214 804435d4 80213214 804435e0 80213224 804435e8
[    0.726521] a830  8031f884 804435f0 8031f954 804435f8 8031fb58 80443600 8031fc80 80443608
[    0.734834] a850  8031fd50 80443610 8031ff78 80443618 803366cc 80443620 8033681c 80443628
[    0.743147] a870  8033683c 80443630 00000001 00000000 00000000 805ae000 00000002 00200000
[    0.751460] a890  00000000 00000000 00000000 00000000 00000078 00000078 00000078 00000000
[    0.759771] a8b0  80444338 00000000 00000400 00400000 00000000 00000000 00000000 805ca8cc
[    0.768082] a8d0  805ca8cc 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[    0.776395]
[    0.776398] R2: 0x801c24b4:
[    0.780689] 24b4  e0811100 e1a03312 f57ff05f e1912f9f e0120003 e0222003 e181cf92 e35c0000
[    0.789001] 24d4  1afffff9 f57ff05f e3500000 13a00001 e12fff1e e211c003 15cc1000 e3a02001
[    0.797315] 24f4  e200301f e1a002a0 e0811100 e1a03312 f57ff05f e1912f9f e0120003 11c22003
[    0.805627] 2514  e181cf92 e35c0000 1afffff9 f57ff05f e3500000 13a00001 e12fff1e e211c003
[    0.813939] 2534  15cc1000 e3a02001 e200301f e1a002a0 e0811100 e1a03312 f57ff05f e1912f9f
[    0.822251] 2554  e0120003 01822003 e181cf92 e35c0000 1afffff9 f57ff05f e3500000 13a00001
[    0.830564] 2574  e12fff1e e1510003 01500002 33a00000 03a00001 83a00002 e1a0f00e e1510003
[    0.838877] 2594  01500002 33e00000 03a00000 83a00001 e1a0f00e e92d4038 e1a04000 e1a05000
[    0.847189]
[    0.847192] R4: 0x801c24b4:
[    0.851482] 24b4  e0811100 e1a03312 f57ff05f e1912f9f e0120003 e0222003 e181cf92 e35c0000
[    0.859796] 24d4  1afffff9 f57ff05f e3500000 13a00001 e12fff1e e211c003 15cc1000 e3a02001
[    0.868109] 24f4  e200301f e1a002a0 e0811100 e1a03312 f57ff05f e1912f9f e0120003 11c22003
[    0.876421] 2514  e181cf92 e35c0000 1afffff9 f57ff05f e3500000 13a00001 e12fff1e e211c003
[    0.884731] 2534  15cc1000 e3a02001 e200301f e1a002a0 e0811100 e1a03312 f57ff05f e1912f9f
[    0.893044] 2554  e0120003 01822003 e181cf92 e35c0000 1afffff9 f57ff05f e3500000 13a00001
[    0.901358] 2574  e12fff1e e1510003 01500002 33a00000 03a00001 83a00002 e1a0f00e e1510003
[    0.909670] 2594  01500002 33e00000 03a00000 83a00001 e1a0f00e e92d4038 e1a04000 e1a05000
[    0.917983]
[    0.917986] R5: 0xb0031de8:
[    0.922276] 1de8  40000013 805fc540 00000001 80d50c00 805fc520 800bf3b8 00000041 805fcfa0
[    0.930589] 1e08  00000000 00000002 000200d0 800bfb08 805fcfa4 00000000 805fc520 00000000
[    0.938901] 1e28  00000000 00000001 80d508a0 fffffffe 00000001 805fc520 00000000 000000d0
[    0.947212] 1e48  00000001 00000000 00004780 ffffffff b0031e9c 805d78d8 00000000 8003e06c
[    0.955524] 1e68  00000009 b000f000 0000ffff 00000000 805d78dc 00000008 805d78d8 00000000
[    0.963836] 1e88  805d78d8 00000009 00000000 00000009 00000000 b0031eb0 800845ac 801c2534
[    0.972149] 1ea8  20000013 ffffffff b0060000 b0061fb0 b00282e0 b00282fc 00000001 00000000
[    0.980459] 1ec8  b0060000 b0045b60 00800711 00000000 00000000 00000000 00000000 b0030000
[    0.988770]
[    0.988773] R7: 0xb0024700:
[    0.993064] 4700  8060233c b0024704 b0024704 00000000 b0024710 b0024710 00000000 00000000
[    1.001376] 4720  00000000 00000001 00000000 b002472c b002472c 00000000 b0024738 b0024738
[    1.009688] 4740  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[    1.017998] 4760  0000c350 0000c350 00000000 00000001 ffffff7e efffffdf ffbddffe fb7f9ffe
[    1.026311] 4780  00000000 b0030000 00000002 80208040 00000000 00000000 00000001 00000001
[    1.034621] 47a0  00000078 00000078 00000078 00000000 80444278 00000000 00000400 00400000
[    1.042932] 47c0  00000001 00000000 00000000 80f570b8 80f570b8 00000001 10fd3288 00000000
[    1.051244] 47e0  0004f1a1 00000000 00ef3e6f 00000000 0004967b 00000000 00000000 00000000
[    1.059560] Process kthreadd (pid: 2, stack limit = 0xb00302f0)
[    1.065498] Stack: (0xb0031d40 to 0xb0032000)
[    1.069875] 1d40: b0031e68 80047d6c 00000805 80048124 0000fd7e fe6efeff 0000f97c d26ceb2f
[    1.078093] 1d60: b7fdfbfd de7cfffa f9cbfddd 00008000 00000000 900bdcb0 00000041 0003148e
[    1.086299] 1d80: 805fc520 805fc520 00000000 00000000 80d50b78 00000000 00000000 800bdcb0
[    1.094506] 1da0: 00000041 0003151c 00000805 805cbde4 00000000 b0031e68 805d78d8 20000113
[    1.102711] 1dc0: 00000000 800393d8 0000cfa4 00000000 0000c520 805fc520 00000000 00000001
[    1.110918] 1de0: 00000001 805fc520 40000013 805fc540 00000001 80d50c00 805fc520 800bf3b8
[    1.119123] 1e00: 00000041 805fcfa0 00000000 00000002 000200d0 800bfb08 805fcfa4 00000000
[    1.127329] 1e20: 805fc520 00000000 00000000 00000001 80d508a0 fffffffe 00000001 805fc520
[    1.135535] 1e40: 00000000 000000d0 00000001 00000000 00004780 ffffffff b0031e9c 805d78d8
[    1.143741] 1e60: 00000000 8003e06c 00000009 b000f000 0000ffff 00000000 805d78dc 00000008
[    1.151946] 1e80: 805d78d8 00000000 805d78d8 00000009 00000000 00000009 00000000 b0031eb0
[    1.160153] 1ea0: 800845ac 801c2534 20000013 ffffffff b0060000 b0061fb0 b00282e0 b00282fc
[    1.168358] 1ec0: 00000001 00000000 b0060000 b0045b60 00800711 00000000 00000000 00000000
[    1.176564] 1ee0: 00000000 b0030000 b0045c7c 8006d2b4 b0031f80 b002b068 80f57088 00000000
[    1.184769] 1f00: b0031f80 00000000 80f57040 00000000 b002b060 00000000 00800711 b0031f80
[    1.192974] 1f20: 00000000 00000000 00000000 00000000 00000000 8006d9f0 00000000 00000000
[    1.201180] 1f40: 00000000 bff7ffbf fbf7dfad dbebfffa 800871bc 800371b4 80038040 80086ef8
[    1.209386] 1f60: b002ff30 00000611 b002ff30 00000000 8060114c 8003f100 00000000 00000000
[    1.217591] 1f80: 00000000 00000000 00000000 00000000 b002ff30 80086ef8 8003f034 00000013
[    1.225796] 1fa0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 8003f024
[    1.234002] 1fc0: 00000093 00000000 b002ff50 805d79fc b0030000 80087210 00000000 00000000
[    1.242208] 1fe0: 80087150 8003f034 00000013 00000000 00000000 8003f034 febfff7c fff9fbb7
[    1.250430] [<801c2b88>] (search_extable+0x0/0x3c) from [<80084a00>] (search_exception_tables+0x18/0x34)
[    1.259962] [<80084a00>] (search_exception_tables+0x18/0x34) from [<80047d6c>] (fixup_exception+0x10/0x28)
[    1.269657] [<80047d6c>] (fixup_exception+0x10/0x28) from [<80048124>] (do_page_fault+0x254/0x28c)
[    1.278655] [<80048124>] (do_page_fault+0x254/0x28c) from [<800393d8>] (do_DataAbort+0x34/0x98)
[    1.287394] [<800393d8>] (do_DataAbort+0x34/0x98) from [<8003e06c>] (__dabt_svc+0x4c/0x60)
[    1.295683] Exception stack(0xb0031e68 to 0xb0031eb0)
[    1.300754] 1e60:                   00000009 b000f000 0000ffff 00000000 805d78dc 00000008
[    1.308960] 1e80: 805d78d8 00000000 805d78d8 00000009 00000000 00000009 00000000 b0031eb0
[    1.317163] 1ea0: 800845ac 801c2534 20000013 ffffffff
[    1.322253] [<8003e06c>] (__dabt_svc+0x4c/0x60) from [<801c2534>] (_test_and_set_bit+0x4/0x48)
[    1.330896] Code: e1520001 28bd8010 e58030b4 eafffff0 (e1a03000)
[    1.337054] ---[ end trace 1b75b31a2719ed1c ]---

===============================================================================================================

It happens at very different locations and with different oops messages whenever the system hangs.

Do you guys have any suspicicous things on it?

Thanks in advance so much!

[igorpadykov]

Hi Yong

errors at different locations may mean

DDR errors, may be useful to update calibration coefficients

with links below

https://community.freescale.com/message/331721#331721

https://community.freescale.com/docs/DOC-96412

Just for test one can try to boot with lower frequency using fuse

BT_FREQ (BOOT_CFG3[2]) and increase pause between boots.

This may check if problem is related to power supplies (poor filtering, noise)

problems.

Best regards

chip

-----------------------------------------------------------------------------------------------------------------------

Note: If this post answers your question, please click the Correct Answer button. Thank you!

-----------------------------------------------------------------------------------------------------------------------