Random crash at imx6dl with Android 4.4.2

[denniswang_tw]

Dear all,

i'm developing on a custom imx6dl-based board.

The kernel version is 3.0.35.

We found a problem that android will reboot randomly when application/dialog pop up.

It always happened after power on and enter first app from launcher.

is this a known issue ? Or any suggestion to find the RC?

Thanks.

[09/18/15 Abnormal]-S-| Unable to handle kernel NULL pointer dereference at virtual address 00000010

                      | pgd = b8dcc000

                      | [00000010] *pgd=00000000

                      | Internal error: Oops: 805 [#1] PREEMPT SMP

                      | Modules linked in: wl12xx_sdio wl12xx mac80211 cfg80211 compat

                      | CPU: 0    Not tainted  (3.0.35-r4.4.2 #10)

                      | PC is at _Split+0xa4/0xbc

                      | LR is at __kmalloc+0x44/0x140

                      | pc : [<8041c8d0>]    lr : [<800ecb50>]    psr: 60010013

                      | sp : b87a9cc0  ip : 01100000  fp : b87a9ce4

                      | r10: 00000000  r9 : 00000002  r8 : b87a9cfc

                      | r7 : bc162e00  r6 : 00012000  r5 : 00000001  r4 : bc162e00

                      | r3 : bc072a80  r2 : 00000000  r1 : 80791ca0  r0 : 00000000

                      | Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user

                      | Control: 10c53c7d  Table: 48dcc04a  DAC: 00000015

                      |

                      | PC: 0x8041c850:

                      | c850  0a000021 e5913018 e1560003 8a00001e e3a01074 e24b2020 ebffccf3 e1500005

                      | c870  ba000019 e51b3020 e5942014 e0862002 e5832014 e5942018 e583501c e5835020

                      | c890  e0662002 e5832018 e3a05001 e5942000 e5832000 e5942024 e5832024 e5942028

                      | c8b0  e5832028 e5942004 e9830014 e5823008 e594200c e5843004 e5834010 e583200c

                      | c8d0  e5823010 e584300c e5846018 e1a00005 e24bd018 e89da870 e1a0c00d e92ddff0

                      | c8f0  e24cb004 e24dd014 e2528000 e3a05000 e1a07000 e1a0c001 e1a0a003 e50b5030

                      | c910  0a000030 e1530005 0a00002e e5906004 e3a01074 e24b2030 e50bc038 e1a00006

                      | c930  ebffccc1 e51bc038 e2509000 ba000026 e51b4030 e2840048 e8841080 e5845010

                      |

                      | LR: 0x800ecad0:

                      | cad0  e3a02002 ebffff8e e89da800 e1a0c00d e92dd800 e24cb004 e3a0200a ebffff88

                      | caf0  e89da800 e1a0c00d e92dd800 e24cb004 e3a02009 ebffff82 e89da800 e1a0c00d

                      | cb10  e92dddf0 e24cb004 e3500a02 e1a06001 9a000009 e2403001 e3e01000 e1a035a3

                      | cb30  e1b030a3 e2811001 1afffffc e3860901 ebff68ca e1a04000 ea00003c ebfffd0f

                      | cb50  e3500010 e1a04000 9a000038 e1a0200d e59f10e0 e3c23d7f e3c3303f e5930014

                      | cb70  e5942000 e7910100 e082c000 e59c8004 e7925000 e3550000 1a000004 e1a00004

                      | cb90  e1a01006 eb137162 e1a05000 ea00001b e10f0000 f10c0080 e593c014 e5947000

                      | cbb0  e791c10c e1a02007 e792a00c e15a0005 1a00000e e2877004 e797700c e1570008

                      |

                      | SP: 0xb87a9c40:

                      | 9c40  00000001 8005074c b87a8000 00000000 b87a9c74 b87a9c60 ffffffff b87a9cac

                      | 9c60  00012000 bc162e00 b87a9ce4 b87a9c78 8005066c 8004b3dc 00000000 80791ca0

                      | 9c80  00000000 bc072a80 bc162e00 00000001 00012000 bc162e00 b87a9cfc 00000002

                      | 9ca0  00000000 b87a9ce4 01100000 b87a9cc0 800ecb50 8041c8d0 60010013 ffffffff

                      | 9cc0  00012000 bc072a80 bc6d4f00 bca8bc00 00012000 00000040 b87a9d2c b87a9ce8

                      | 9ce0  8041ced0 8041c838 b87a9cfc b87a9cf8 80095a88 bc6d4f00 b87a9d14 00000000

                      | 9d00  8040f638 00000000 b87a9de0 00000006 bc6d4f00 00012000 0000000a 00000002

                      | 9d20  b87a9dbc b87a9d30 80415460 8041cd58 00000002 b87a9d6c 00000000 00000000

                      |

                      | FP: 0xb87a9c64:

                      | 9c64  bc162e00 b87a9ce4 b87a9c78 8005066c 8004b3dc 00000000 80791ca0 00000000

                      | 9c84  bc072a80 bc162e00 00000001 00012000 bc162e00 b87a9cfc 00000002 00000000

                      | 9ca4  b87a9ce4 01100000 b87a9cc0 800ecb50 8041c8d0 60010013 ffffffff 00012000

                      | 9cc4  bc072a80 bc6d4f00 bca8bc00 00012000 00000040 b87a9d2c b87a9ce8 8041ced0

                      | 9ce4  8041c838 b87a9cfc b87a9cf8 80095a88 bc6d4f00 b87a9d14 00000000 8040f638

                      | 9d04  00000000 b87a9de0 00000006 bc6d4f00 00012000 0000000a 00000002 b87a9dbc

                      | 9d24  b87a9d30 80415460 8041cd58 00000002 b87a9d6c 00000000 00000000 00000002

                      | 9d44  00000040 00000000 00000000 00000000 00000000 00000000 0000084c 2d1d455f

                      |

                      | R1: 0x80791c20:

                      | 1c20  80791c20 80791c20 80791c28 80791c28 00000000 00000000 80791c38 80791c38

                      | 1c40  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

                      | 1c60  00000064 81158040 00008000 0000000f 81158060 00000008 00000002 81158020

                      | 1c80  81149000 0000002c 81150000 81158000 00000001 00001000 00000000 00000001

                      | 1ca0  01100000 01108000 00000000 00000000 00000000 00000002 0004effb 0004ffff

                      | 1cc0  00000001 00000032 0000fffa 00000001 bc02be80 bc002200 bc003700 00000003

                      | 1ce0  bc00d460 bc002200 bc003600 00000011 8115c160 0001ffff 00000064 bc002580

                      | 1d00  00000010 0000ffff 811dc160 bc003680 00100000 bc00c000 00000003 bc003700

                      |

                      | R3: 0xbc072a00:

                      | 2a00  f0000870 00000007 bc072a60 0002416d 00000000 00000000 00000000 00000000

                      | 2a20  805dc300 805dc280 bc037a80 bc037800 00000000 00000000 00000000 00000000

                      | 2a40  00000001 00000000 00000000 00000000 00000000 bc072a54 bc072a54 00000000

                      | 2a60  2d786d69 00633269 bc15cef8 8009e824 ffffffff ffffffff ffffffff ffffffff

                      | 2a80  bca8bc00 bde1d880 bc162e00 00000000 bc162e00 00432000 0034a000 00000000

                      | 2aa0  00000000 00000006 00000000 00000000 00000000 00000000 00000000 00000000

                      | 2ac0  00000000 fffffff0 00000000 00000000 00000000 b8c96980 00000000 bde18200

                      | 2ae0  807a5518 bc25b900 b932faa0 8009e824 65732074 63697672 00000065 00000000

                      |

                      | R4: 0xbc162d80:

                      | 2d80  00000002 00000000 00000000 00000000 00000000 00000000 00000000 00000000

                      | 2da0  00000000 00000000 00000000 00000000 ffffffff ffffffff ffffffff ffffffff

                      | 2dc0  ffffffff ffffffff 00000000 00000000 00000000 bc187580 00000000 807a5730

                      | 2de0  807a5518 807a5e48 00000000 00000000 ffffffff ffffffff ffffffff ffffffff

                      | 2e00  bca8bc00 bc072a80 bc634700 00000000 00000000 00420000 0035c000 00000000

                      | 2e20  00000001 00000006 00000000 00000000 00000000 ffffffff ffffffff ffffffff

                      | 2e40  ffffffff ffffffff 00000001 00000000 00000000 00000000 00000006 807a5730

                      | 2e60  807a5518 807a5e48 bc160b18 8009e824 054ae8bf 00000008 00000000 ffffffff

                      |

                      | R7: 0xbc162d80:

                      | 2d80  00000002 00000000 00000000 00000000 00000000 00000000 00000000 00000000

                      | 2da0  00000000 00000000 00000000 00000000 ffffffff ffffffff ffffffff ffffffff

                      | 2dc0  ffffffff ffffffff 00000000 00000000 00000000 bc187580 00000000 807a5730

                      | 2de0  807a5518 807a5e48 00000000 00000000 ffffffff ffffffff ffffffff ffffffff

                      | 2e00  bca8bc00 bc072a80 bc634700 00000000 00000000 00420000 0035c000 00000000

                      | 2e20  00000001 00000006 00000000 00000000 00000000 ffffffff ffffffff ffffffff

                      | 2e40  ffffffff ffffffff 00000001 00000000 00000000 00000000 00000006 807a5730

                      | 2e60  807a5518 807a5e48 bc160b18 8009e824 054ae8bf 00000008 00000000 ffffffff

                      |

                      | R8: 0xb87a9c7c:

                      | 9c7c  80791ca0 00000000 bc072a80 bc162e00 00000001 00012000 bc162e00 b87a9cfc

                      | 9c9c  00000002 00000000 b87a9ce4 01100000 b87a9cc0 800ecb50 8041c8d0 60010013

                      | 9cbc  ffffffff 00012000 bc072a80 bc6d4f00 bca8bc00 00012000 00000040 b87a9d2c

                      | 9cdc  b87a9ce8 8041ced0 8041c838 b87a9cfc b87a9cf8 80095a88 bc6d4f00 b87a9d14

                      | 9cfc  00000000 8040f638 00000000 b87a9de0 00000006 bc6d4f00 00012000 0000000a

                      | 9d1c  00000002 b87a9dbc b87a9d30 80415460 8041cd58 00000002 b87a9d6c 00000000

                      | 9d3c  00000000 00000002 00000040 00000000 00000000 00000000 00000000 00000000

                      | 9d5c  0000084c 2d1d455f 807cffc0 bca8bc00 00000000 007fffff 53431000 00000000

                      | Process til.saioutility (pid: 2124, stack limit = 0xb87a82f8)

                      | Stack: (0xb87a9cc0 to 0xb87aa000)

                      | 9cc0: 00012000 bc072a80 bc6d4f00 bca8bc00 00012000 00000040 b87a9d2c b87a9ce8

                      | 9ce0: 8041ced0 8041c838 b87a9cfc b87a9cf8 80095a88 bc6d4f00 b87a9d14 00000000

                      | 9d00: 8040f638 00000000 b87a9de0 00000006 bc6d4f00 00012000 0000000a 00000002

                      | 9d20: b87a9dbc b87a9d30 80415460 8041cd58 00000002 b87a9d6c 00000000 00000000

                      | 9d40: 00000002 00000040 00000000 00000000 00000000 00000000 00000000 0000084c

                      | 9d60: 2d1d455f 807cffc0 bca8bc00 00000000 007fffff 53431000 00000000 807d0a40

                      | 9d80: 00000002 00000000 b87a9e2c b87a9d98 800c6908 bc665000 b87a8000 00007530

                      | 9da0: b91b8020 00000000 b87a8000 00000000 b87a9efc b87a9dc0 8040f0ac 80414e24

                      | 9dc0: 7e8aa040 00000000 000000f8 00000000 7e8aa040 00000000 000000f8 00000000

                      | 9de0: 00000007 00000001 5342e008 7e8aa7c8 0000ac40 00000000 7e8aa648 00000000

                      | 9e00: 00012000 00000040 00000002 00000001 0000084c 00000000 00000000 7e8aa648

                      | 9e20: 00000001 00000000 5342e008 00001380 00000007 2c016008 00000008 0000000b

                      | 9e40: 00000008 00000008 00000047 000000b9 00000001 2b0d6924 2c016008 00000100

                      | 9e60: 00000100 2b0d6a10 00000034 0000b900 ffffffff 00000000 7e8aafe8 7e8aa858

                      | 9e80: 0000ab80 00000000 7e8aa6d8 00000000 000000c0 55fb5780 55fb5780 53014d3b

                      | 9ea0: 7e8aa918 0000000c 00000001 7e8aa6d8 00000001 00000000 7e8aafe8 2b0d6924

                      | 9ec0: 2c016008 0000000c 0000000a 2b0d6e0c 00000a54 00000038 bd83dd08 7e8a9fe0

                      | 9ee0: b8d35320 00000026 00000000 00000000 b87a9f74 b87a9f00 800ffc78 8040eefc

                      | 9f00: 8004b40c 80058924 8009d930 800bdf10 00000000 81152090 bd91c01c b8772a00

                      | 9f20: bcf529c0 b87a8000 b87a9f4c b87a9f38 8009d95c 8009d8f4 8004a040 b8772a00

                      | 9f40: 00000001 b8d35320 b87a9f74 b87a9f58 b8d35320 7e8a9fe0 00007530 00000026

                      | 9f60: 00000000 b87a8000 b87a9fa4 b87a9f78 800ffd44 800ff72c b87a9f94 00000001

                      | 9f80: 80095a88 00002710 00007530 53056ee8 00000036 80050d84 00000000 b87a9fa8

                      | 9fa0: 80050c00 800ffcf8 00002710 00007530 00000026 00007530 7e8a9fe0 7e8a9fc8

                      | 9fc0: 00002710 00007530 53056ee8 00000036 7e8aa178 00012000 00000068 5348ab18

                      | 9fe0: 5348caa8 7e8a9fb8 2abfc23b 2abef664 40010010 00000026 00000000 00000000

                      | Backtrace:

                      | [<8041c82c>] (_Split+0x0/0xbc) from [<8041ced0>] (gckVIDMEM_AllocateLinear+0x184/0x220)

                      |  r6:00000040 r5:00012000 r4:bca8bc00

                      | [<8041cd4c>] (gckVIDMEM_AllocateLinear+0x0/0x220) from [<80415460>] (gckKERNEL_Dispatch+0x648/0x1578)

                      | [<80414e18>] (gckKERNEL_Dispatch+0x0/0x1578) from [<8040f0ac>] (drv_ioctl+0x1bc/0x274)

                      | [<8040eef0>] (drv_ioctl+0x0/0x274) from [<800ffc78>] (do_vfs_ioctl+0x558/0x5cc)

                      | [<800ff720>] (do_vfs_ioctl+0x0/0x5cc) from [<800ffd44>] (sys_ioctl+0x58/0x7c)

                      |  r9:b87a8000 r8:00000000 r7:00000026 r6:00007530 r5:7e8a9fe0

                      | r4:b8d35320

                      | [<800ffcec>] (sys_ioctl+0x0/0x7c) from [<80050c00>] (ret_fast_syscall+0x0/0x30)

                      |  r8:80050d84 r7:00000036 r6:53056ee8 r5:00007530 r4:00002710

                      | Code: e594200c e5843004 e5834010 e583200c (e5823010)

                      | ---[ end trace 5847bb0f94423b98 ]---

                      | Kernel panic - not syncing: Fatal exception

                      | CPU1: stopping

                      | Backtrace:

                      | [<800543f0>] (dump_backtrace+0x0/0x10c) from [<805c7794>] (dump_stack+0x18/0x1c)

                      |  r6:00000006 r5:00000001 r4:00000000 r3:00000000

                      | [<805c777c>] (dump_stack+0x0/0x1c) from [<8004b2f8>] (do_IPI+0x104/0x1dc)

                      | [<8004b1f4>] (do_IPI+0x0/0x1dc) from [<8005092c>] (__irq_usr+0x4c/0xe0)

                      | Exception stack(0xbdaeffb0 to 0xbdaefff8)

                      | ffa0:                                     00073400 00078000 00000003 00000008

                      | ffc0: f0000000 00000000 00000000 0000f000 00000000 00000000 00073400 0000a400

                      | ffe0: 00000000 7e95b810 2acaa454 2aca79f4 20070010 ffffffff

                      |  r7:00000001 r6:00000006 r5:f2a00100 r4:ffffffff

[igorpadykov · Accepted solution]

HI Wang

errors like "Unable to handle kernel NULL pointer dereference at virtual address"

may caused also by ddr errors, so it may be useful to run board ddr tests

i.MX6/7 DDR Stress Test Tool V2.10

Best regards

igor

[denniswang_tw]

Dear igor,

I got the same result from others, the RC should be DDR or PMIC.

I had finished the DDR stress test and the result is PASS.

Now I focus debugging on PMIC.

I will update this thread if find the RC and hope can help others.

Thanks

[saurabh206]

Hello Wang,

Please find attached document.

It will help to debug the issue.

Also you can narrow down the issue with disabling the Wi-Fi module.

Thanks

Saurabh

[denniswang_tw]

Dear Saurabh,

Thanks for your fast reply.

I will pass information to kernel owner and hope that can help to analysis RC.

Thanks.