Kernel Oops on i.MX6Q kernel version 3.0.35

[RobertDaniels]

I'm getting random (infrequent) kernel panics on our i.MX6Q board:

Jun  2 11:35:39 Equinox73v2 user.alert kernel: Unable to handle kernel paging request at virtual address 1d911f6e

Jun  2 11:35:39 Equinox73v2 user.alert kernel: pgd = b9e18000

Jun  2 11:35:39 Equinox73v2 user.alert kernel: [1d911f6e] *pgd=00000000

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: Internal error: Oops: 5 [#1] PREEMPT SMP

Jun  2 11:35:39 Equinox73v2 user.warn kernel: Modules linked in:

Jun  2 11:35:39 Equinox73v2 user.warn kernel: CPU: 2    Not tainted  (3.0.35-eq73v2[LITEON-0.09] #2)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: PC is at unmap_vmas+0x154/0x690

Jun  2 11:35:39 Equinox73v2 user.warn kernel: LR is at unmap_vmas+0x4a4/0x690

Jun  2 11:35:39 Equinox73v2 user.warn kernel: pc : [<801f2a9c>]    lr : [<801f2dec>]    psr: 200b0013

Jun  2 11:35:39 Equinox73v2 user.warn kernel: sp : b98b3d98  ip : 00000000  fp : 2d914000

Jun  2 11:35:39 Equinox73v2 user.warn kernel: r10: 2d915000  r9 : b9833d68  r8 : b98b3e18

Jun  2 11:35:39 Equinox73v2 user.warn kernel: r7 : 8b9a9500  r6 : 8bf381cc  r5 : b9c0e44c  r4 : 00000001

Jun  2 11:35:39 Equinox73v2 user.warn kernel: r3 : 2d9fffff  r2 : 2d914fff  r1 : 1d911f6e  r0 : 1d911f6e

Jun  2 11:35:39 Equinox73v2 user.warn kernel: Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user

Jun  2 11:35:39 Equinox73v2 user.warn kernel: Control: 10c53c7d  Table: 49e1804a  DAC: 00000015

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: Process tptng (pid: 5256, stack limit = 0xb98b22f0)

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: Stack: (0xb98b3d98 to 0xb98b4000)

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3d80:                                                       b98b3ddc 00000000

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3da0: 1d4a85dd 8bf381cc 1d911f6e bfaaa340 bfaaa48c 80835720 b98b2000 2d915000

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3dc0: 1d911f6e 00000000 ffffffff 2d914fff 00000001 00000000 00000000 00000000

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3de0: bfaaa340 b9e1d7e8 bfaaa340 00000000 b98b3e38 b9fb9e00 ba127210 bfaaa340

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3e00: 00000002 801f8770 b98b3e14 00000000 bfdad6e0 00003920 bfaaa340 00000001

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3e20: 00000000 bfdad6e0 00000001 00000139 00000400 b99d7000 00000000 ba126f20

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3e40: ba126f20 bfaaa340 bfe58d00 bfe58e64 00014d52 80169d98 bfaaa368 bfaaa340

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3e60: bfaaa340 bfe58d00 b98b2038 8018edfc ba126f20 80214dcc b98b2000 7f000000

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3e80: b9fb9e00 b9e23200 b9e23234 b9fb9e00 b98b3fb0 bfd15b40 00000001 8024ce20

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3ea0: b99bf0a0 8024d108 b9fb9e00 00000080 00000000 b98b3efc b98b2000 bfd15b00

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3ec0: 00000000 00000001 b9fb9e00 b9e17aa0 00000000 00000000 80835720 00000000

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3ee0: 00000003 80214588 00000017 b98b3efc 00000000 00000000 00000000 8be30440

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3f00: 00000c33 807f83b4 b98b2000 b9fb9e00 807dfcc0 fffffff8 00000000 8024ce20

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3f20: 807f7f20 8021418c 0305ef20 00000000 b98b3fb0 00000000 0301ac98 00000001

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3f40: b9fb9e00 00000000 0301ac98 01c5cd20 b98b3fb0 b98b2020 b98bcaa0 80215934

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3f60: 00000000 00000000 7e8e234c ba84a000 b98b3fb0 01c5cd20 0301ac98 8015d0c4

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3f80: b98b2000 00000000 7e8e234c 80160174 b98b3fb0 0301ac98 01c5cd20 2ab614c0

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3fa0: 0000000b 8015cf40 0301ac98 01c5cd20 7e8e22f0 0301ac98 01c5cd20 6962732f

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3fc0: 0301ac98 01c5cd20 2ab614c0 0000000b 00000000 7e8e2f16 7e8e22f0 7e8e234c

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: 3fe0: 7e8e22f4 7e8e22d4 2d7bc628 2d7bbe68 800d0010 7e8e22f0 00000000 00000000

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<801f2a9c>] (unmap_vmas+0x154/0x690) from [<801f8770>] (exit_mmap+0x108/0x24c)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<801f8770>] (exit_mmap+0x108/0x24c) from [<8018edfc>] (mmput+0x48/0x118)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<8018edfc>] (mmput+0x48/0x118) from [<80214dcc>] (flush_old_exec+0x410/0x5ec)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<80214dcc>] (flush_old_exec+0x410/0x5ec) from [<8024d108>] (load_elf_binary+0x2e8/0x134c)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<8024d108>] (load_elf_binary+0x2e8/0x134c) from [<8021418c>] (search_binary_handler+0xe8/0x2e8)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<8021418c>] (search_binary_handler+0xe8/0x2e8) from [<80215934>] (do_execve+0x204/0x274)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<80215934>] (do_execve+0x204/0x274) from [<80160174>] (sys_execve+0x34/0x54)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: [<80160174>] (sys_execve+0x34/0x54) from [<8015cf40>] (ret_fast_syscall+0x0/0x30)

Jun  2 11:35:39 Equinox73v2 user.emerg kernel: Code: e1530002 21a0a001 e59d0010 e1a01000 (e4913004)

Jun  2 11:35:39 Equinox73v2 user.warn kernel: ---[ end trace 6d48c05af2cdcbfd ]---

Jun  2 20:39:13 Equinox73v2 user.alert kernel: Unable to handle kernel paging request at virtual address 10c53dc8

Jun  2 20:39:13 Equinox73v2 user.alert kernel: pgd = bfa74000

Jun  2 20:39:13 Equinox73v2 user.alert kernel: [10c53dc8] *pgd=00000000

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: Internal error: Oops: 5 [#2] PREEMPT SMP

Jun  2 20:39:13 Equinox73v2 user.warn kernel: Modules linked in:

Jun  2 20:39:13 Equinox73v2 user.warn kernel: CPU: 0    Tainted: G      D      (3.0.35-eq73v2[LITEON-0.09] #2)

Jun  2 20:39:13 Equinox73v2 user.warn kernel: PC is at get_page_from_freelist+0x18/0x5c4

Jun  2 20:39:13 Equinox73v2 user.warn kernel: LR is at __alloc_pages_nodemask+0xe4/0x6e4

Jun  2 20:39:13 Equinox73v2 user.warn kernel: pc : [<801de310>]    lr : [<801df328>]    psr: 200b0013

Jun  2 20:39:13 Equinox73v2 user.warn kernel: sp : bfcf3de0  ip : 10c53a3c  fp : 000000d0

Jun  2 20:39:13 Equinox73v2 user.warn kernel: r10: 00000000  r9 : 80829224  r8 : 00000001

Jun  2 20:39:13 Equinox73v2 user.warn kernel: r7 : 00000001  r6 : 00000000  r5 : 80829220  r4 : 4f72c235

Jun  2 20:39:13 Equinox73v2 user.warn kernel: r3 : 80829220  r2 : 00000001  r1 : 00000000  r0 : 000200d0

Jun  2 20:39:13 Equinox73v2 user.warn kernel: Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user

Jun  2 20:39:13 Equinox73v2 user.warn kernel: Control: 10c53c7d  Table: 4fa7404a  DAC: 00000015

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: Process tptng (pid: 3019, stack limit = 0xbfcf22f0)

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: Stack: (0xbfcf3de0 to 0xbfcf4000)

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3de0: 80155c00 bfcf2000 00000102 bfcf2000 bfcf2000 bfcf2000 bfcf2010 000000d0

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3e00: 00000000 807dfcc0 80155c00 801571e0 000b0013 ffffffff f2a00100 0000001d

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3e20: 00000001 00000000 bfcf2000 8015c98c 80c37694 00000001 00000000 bfcf3ed8

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3e40: 807dfb38 80829220 00000000 00000001 00000001 807dfb38 80829220 00000000

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3e60: 00000001 00000001 80829224 00000000 000000d0 801df328 00000001 00000041

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3e80: 10c53a3c 00000000 bfcf3e08 bfff5810 00000001 80610300 000200d0 00000008

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3ea0: 80714896 80714896 00000002 ffffffff 000000d0 80210800 8063ba30 00000000

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3ec0: bfff2700 8c00c2a8 8061a000 000080d0 0055d914 00000000 10c53a3c 8020a724

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3ee0: 00000000 bfc18780 00000000 8082a740 ba23a0a0 bfcf2010 00000000 01200011

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3f00: 00000000 ba127a00 bfcf3fb0 8018f57c 807dfdbc 00000000 02afdfc8 8021082c

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3f20: 7e8e2308 00000000 00000000 bfc18280 bfcf3f54 802109b4 00000003 01200011

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3f40: bfcf3fb0 00000000 00000000 7e8e2308 00000000 00000000 7e8e2354 80190338

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3f60: 2ab61068 00000000 00000000 bfc1e100 00080000 bfc857e0 00000030 8020db84

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3f80: 00000002 00000030 00080000 2ab61068 7e8e2308 2d856000 00000078 8015d0c4

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3fa0: bfcf2000 8015cf40 00000000 2ab61068 01200011 00000000 00000000 00000000

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3fc0: 2ab61068 7e8e2308 2d856000 00000078 2ab61000 2d24a84c 00000bcb 7e8e2354

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: 3fe0: 2ab614c0 7e8e2308 00000bcb 2d7bbb1c 600b0010 01200011 00000000 00000000

Jun  2 20:39:13 Equinox73v2 user.warn kernel: [<801de310>] (get_page_from_freelist+0x18/0x5c4) from [<801df328>] (__alloc_pages_nodemask+0xe4/0x6e4)

Jun  2 20:39:13 Equinox73v2 user.warn kernel: [<801df328>] (__alloc_pages_nodemask+0xe4/0x6e4) from [<8018f57c>] (copy_process.part.47+0x60/0xd04)

Jun  2 20:39:13 Equinox73v2 user.warn kernel: [<8018f57c>] (copy_process.part.47+0x60/0xd04) from [<80190338>] (do_fork+0xf4/0x2cc)

Jun  2 20:39:13 Equinox73v2 user.warn kernel: [<80190338>] (do_fork+0xf4/0x2cc) from [<8015cf40>] (ret_fast_syscall+0x0/0x30)

Jun  2 20:39:13 Equinox73v2 user.emerg kernel: Code: e59dc0a0 e30c4235 e3444f72 e58d1058 (e59ce38c)

Jun  2 20:39:13 Equinox73v2 user.warn kernel: ---[ end trace 6d48c05af2cdcbfe ]---

I've got watchdogd monitoring the tptng process but it did not detect that the process died. I could see in the process list that it was still there as a zombie. I would have expected the watchdogd to detect this and reboot - normally if I kill the process it detects that just fine.

Any ideas on what is causing this or has someone seen this before? Would a newer version of the kernel be better for our product? We're using Qt5 for a QML based application.

Thanks,

Robert Daniels

Here's a new slightly different Oops that just happened:

Unable to handle kernel paging request at virtual address 10c53dc8

pgd = ba2c8000

[10c53dc8] *pgd=00000000

Internal error: Oops: 5 [#1] PREEMPT SMP

Modules linked in:

CPU: 0    Not tainted  (3.0.35-eq73v2[LITEON-0.09] #2)

PC is at get_page_from_freelist+0x18/0x5c4

LR is at __alloc_pages_nodemask+0xe4/0x6e4

pc : [<801de310>]    lr : [<801df328>]    psr: 20030013

sp : ba333de0  ip : 10c53a3c  fp : 000000d0

r10: 00000000  r9 : 80829224  r8 : 00000001

r7 : 00000001  r6 : 00000000  r5 : 80829220  r4 : 4f72c235

r3 : 80829220  r2 : 00000001  r1 : 00000000  r0 : 000200d0

Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user

Control: 10c53c7d  Table: 4a2c804a  DAC: 00000015

Process tptng (pid: 2451, stack limit = 0xba3322f0)

Stack: (0xba333de0 to 0xba334000)

3de0: 80155c00 ba332000 00000102 ba332000 ba332000 ba332000 ba332010 000000d0

3e00: 00000000 807dfcc0 80155c00 801571e0 80030013 ffffffff f2a00100 0000001d

3e20: 00000001 00000000 ba332000 8015c98c 80c3c1e4 00000001 00000000 ba333ed8

3e40: 807dfb38 80829220 00000000 00000001 00000001 807dfb38 80829220 00000000

3e60: 00000001 00000001 80829224 00000000 000000d0 801df328 00000001 00000041

3e80: 10c53a3c 00000000 ba333e08 bfff5810 00000001 80610300 000200d0 00000008

3ea0: 80714896 80714896 00000002 ffffffff ba333f1c 806337cc 8063ba30 8038124c

3ec0: 00000002 0000000a ffffffff ffffffff 46411fff b9bee000 10c53a3c 8020a724

3ee0: 00000000 ba162b40 00000000 8082a740 bffbd5c0 ba332010 00000000 01200011

3f00: 00000000 ba0b0000 ba333fb0 8018f57c 807dfdbc 00000000 01c48448 8021082c

3f20: 7efb0308 00000000 00000000 ba162c80 ba333f54 802109b4 00000003 01200011

3f40: ba333fb0 00000000 00000000 7efb0308 00000000 00000000 7efb0354 80190338

3f60: 2da69068 00000000 00000000 ba8c8b40 00080000 bff17b60 0000002a 8020db84

3f80: 00000002 0000002a 00080000 2da69068 7efb0308 2d8b3000 00000078 8015d0c4

3fa0: ba332000 8015cf40 00000000 2da69068 01200011 00000000 00000000 00000000

3fc0: 2da69068 7efb0308 2d8b3000 00000078 2da69000 2d2ca84c 00000993 7efb0354

3fe0: 2da694c0 7efb0308 00000993 2d818b1c 60030010 01200011 4fffe821 4fffec21

[<801de310>] (get_page_from_freelist+0x18/0x5c4) from [<801df328>] (__alloc_pages_nodemask+0xe4/0x6e4)

[<801df328>] (__alloc_pages_nodemask+0xe4/0x6e4) from [<8018f57c>] (copy_process.part.47+0x60/0xd04)

[<8018f57c>] (copy_process.part.47+0x60/0xd04) from [<80190338>] (do_fork+0xf4/0x2cc)

[<80190338>] (do_fork+0xf4/0x2cc) from [<8015cf40>] (ret_fast_syscall+0x0/0x30)

Code: e59dc0a0 e30c4235 e3444f72 e58d1058 (e59ce38c)

---[ end trace 933c3217a9653cc5 ]---

[igorpadykov]

Hi Robert

in case of kernel oops it may be recommended to retest DDR memory

with DDR tester

https://community.freescale.com/docs/DOC-96412

new ddr settings should be used in uboot flash_header.S file.

In general one can debug this using appnote

	Using Open Source Debugging Tools for Linux on i.MX Processors (REV 0)
	PDF (251.5 kB) AN4553

Best regards

igor

-----------------------------------------------------------------------------------------------------------------------

Note: If this post answers your question, please click the Correct Answer button. Thank you!

-----------------------------------------------------------------------------------------------------------------------