"kernel NULL pointer" error msg when downloading with MFGTool

[jaeminkim]

Hi,

We have 3 board with same revision. (based on Sabre-SD)

2 of them working fine with my u-boot, uImage and rootfs.

on the other board, I encounter following error when I trying to download my files(u-boot, uImage etc) using MFGTool.

so I could not write my files to eMMC on board.

I replaced IMX6S chip twice and also replaced DDR memory, PMIC, eMMC. and problem still exist.

This problem happen after "Jumping to OS image"

I attached error log here

(I sent board to SMT company to replace some part.. so I can get entire log right now..)

Console: switching to colour frame buffer device 128x48
mxc_sdc_fb mxc_sdc_fb.1: register mxc display driver ldb
imx-sdma imx-sdma: loaded firmware 1.1
imx-sdma imx-sdma: initialized

Internal error: Oops - undefined instruction: 0 [#1] PREEMPT SMP
Modules linked in:
CPU: 0 Not tainted (3.0.35-2666-gbdde708 #1)
PC is at 0x805c5dd8
LR is at __do_fault+0x350/0x43c
pc : [<805c5dd8>] lr : [<800d1ba8>] psr: 40000193
sp : 94063ddc ip : 8bad08a0 fp : 8ba8236c
r10: 9411b658 r9 : 94063da0 r8 : 94108aa8
r7 : 2ab96000 r6 : 00000000 r5 : 94063e28 r4 : 4001fd82
r3 : 00000000 r2 : 8bad08a0 r1 : 800b9978 r0 : 00000000
Flags: nZcv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
Control: 10c53c7d Table: 2410804a DAC: 00000015
Process hotplug (pid: 1008, stack limit = 0x940622f0)
Stack: (0x94063ddc to 0x94064000)
3dc0: 00000193
3de0: 00000000 8044f244 4001fd82 94063e28 00000000 2ab96000 00000000 2ab96000
3e00: 00000000 00000000 00000000 800bf41c ffffffff 00000083 ffffffff 8baff800
3e20: 4008020c 805fbbc0 80608d80 94063da4 00000000 60000193 2684559f 805c5d14
3e40: 962d04e0 94112bb0 94108aa8 00000000 962d051c 800d4b00 94108aa8 00000000
3e60: 00000002 962d04e0 2ab961d4 94063fb0 94112bb0 962be0a0 0000001f 2abbadc8
3e80: 962d051c 8004a08c 7ee00000 800cd1c0 94063ef4 800d1e2c 00000200 00000000
3ea0: 00000001 00000000 00000001 800d68d8 940b5f20 00000000 940b5f20 00000001
3ec0: 94063f14 96662000 94062000 94063fb0 9401c140 800d68d8 8ba81a84 940b5f20
3ee0: 962d0680 800d8e78 00000020 0000001f 805c73b0 2ab961d4 94063fb0 00000000
3f00: 2abbb560 2abbadc8 2abbb000 8003a2f4 8ba82000 8ba82080 00000004 20000013
3f20: 8ba82000 00000002 805fbbc0 96662000 94062000 800f1294 9401c140 fffffffe
3f40: 000a7cec 000a7cfc fffffffe 96662000 94062000 94063fb0 9401c140 800f1294
3f60: 94062000 80043154 00000000 2acdf530 2acdf577 2acdf577 00000004 800eb2e0
3f80: 94062000 00000000 00000000 00000000 2acdf530 00000001 2acdf577 0000040f
3fa0: 0000000f 0eef86be 00000003 8003fec4 00000005 00000011 00000006 2ab961c0
3fc0: 00000002 2ab412b4 0eef86be 00000003 00000000 2abbb560 2abbadc8 2abbb000
3fe0: 0000001e 7ec86728 2aba5954 2ab9f6e0 20000010 ffffffff 27ffe821 27ffec21
[<800d1ba8>] (__do_fault+0x350/0x43c) from [<80608d80>] (0x80608d80)
Code: 00000000 805c5dcc 805c5dcc 00000000 (960300b8)
---[ end trace bbe3e5344413ad57 ]---
note: hotplug[1008] exited with preempt_count 1
BUG: scheduling while atomic: hotplug/1008/0x40000002
Modules linked in:
[<800464ac>] (unwind_backtrace+0x0/0xf8) from [<8044b004>] (__schedule+0x4c0/0x6c0)
[<8044b004>] (__schedule+0x4c0/0x6c0) from [<8006e8b4>] (__cond_resched+0x24/0x34)
[<8006e8b4>] (__cond_resched+0x24/0x34) from [<8044b29c>] (_cond_resched+0x34/0x44)
[<8044b29c>] (_cond_resched+0x34/0x44) from [<800d36fc>] (unmap_vmas+0x428/0x668)
[<800d36fc>] (unmap_vmas+0x428/0x668) from [<800d8df0>] (exit_mmap+0x108/0x244)
[<800d8df0>] (exit_mmap+0x108/0x244) from [<8007120c>] (mmput+0x3c/0xfc)
[<8007120c>] (mmput+0x3c/0xfc) from [<800751e0>] (exit_mm+0x128/0x168)
[<800751e0>] (exit_mm+0x128/0x168) from [<80076b48>] (do_exit+0x570/0x6e8)
[<80076b48>] (do_exit+0x570/0x6e8) from [<800436b4>] (die+0x228/0x284)
[<800436b4>] (die+0x228/0x284) from [<8003a134>] (do_undefinstr+0x130/0x140)
[<8003a134>] (do_undefinstr+0x130/0x140) from [<8003faa4>] (__und_svc+0x44/0x60)
Exception stack(0x94063d90 to 0x94063dd8)
3d80: 00000000 800b9978 8bad08a0 00000000
3da0: 4001fd82 94063e28 00000000 2ab96000 94108aa8 94063da0 9411b658 8ba8236c
3dc0: 8bad08a0 94063ddc 800d1ba8 805c5dd8 40000193 ffffffff
[<8003faa4>] (__und_svc+0x44/0x60) from [<805c5dd8>] (0x805c5dd8)
Unable to handle kernel NULL pointer dereference at virtual address 00000161
pgd = 94100000
[00000161] *pgd=2411d831, *pte=00000000, *ppte=00000000
Internal error: Oops: 17 [#2] PREEMPT SMP
Modules linked in:
CPU: 0 Tainted: G D (3.0.35-2666-gbdde708 #1)
PC is at flush_tlb_page+0x3c/0xc4
LR is at ptep_set_access_flags+0x54/0x70
pc : [<80045cf0>] lr : [<800df514>] psr: 20000113
sp : 940cdb40 ip : 7ebf5000 fp : 00000000
r10: 00000000 r9 : 27fea5df r8 : 940e17d4
r7 : 8ba81c2c r6 : 7ebf5000 r5 : 940b5f20 r4 : 00000001
r3 : 00000001 r2 : 00000002 r1 : 7ebf5000 r0 : 8ba81c2c
Flags: nzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
Control: 10c53c7d Table: 2410004a DAC: 00000015
Process hotplug (pid: 1009, stack limit = 0x940cc2f0)
Stack: (0x940cdb40 to 0x940ce000)
db40: 00000012 8004a9a8 00000001 940b5f20 7ebf5000 800df514 00000001 00000000
db60: 8baffcc0 800d1ba8 805c5d14 80608d80 00000001 962d0680 940d4584 00000000
db80: 00000001 0000001d 2ab61000 27fea5df 940b5f20 00000001 7ebf5000 94101fa8
dba0: 962d0680 940e17d4 8ba81c2c 800d4570 94101fa8 8ba81c2c 27fea5df 00000001
dbc0: 00000000 00000000 00000001 94100aa8 962d0680 60000113 962d0680 8ba81a80
dbe0: 00000000 94100000 000003f5 7ebf5000 962d0680 940b5f20 94101fa8 00000001
dc00: 962d06bc 800d4b00 94101fa8 00000001 94100aa8 962d0680 7ebf5f3f 940cdd60
dc20: 940b5f20 962bc3a0 0000081f 96107c60 962d06bc 8004a08c 940cdd68 80049fac
dc40: 00020200 00000200 805fc5e4 800bfa3c 00000200 00000000 805fbbc0 00000000
dc60: 2aac6e17 eaffe5ed 26885630 00000000 00000000 552268c5 941129c8 8021f764
dc80: 940b5160 0000001c 0000001c 0000001c 940b5160 95056afc 95056aec 0000081f
dca0: 805c73b0 7ebf5f3f 940cdd60 940cc000 40000113 96107c60 00000000 8003a2f4
dcc0: 00000000 8003a2f4 0000001d 0000001d 940b5160 940b5188 95056aec 940b5f44
dce0: 940b5f3c 00000002 940b51b8 800cbd48 08100877 95056afc 940b5160 800d6828
dd00: 962d0680 940b5160 95056b18 800d6e68 940b5f44 2ab60000 962d0680 00002000
dd20: 00000002 940b5160 962d0680 940b5478 962d0680 940b5478 962d0680 800d6eb0
dd40: 940b5f40 940b5478 962d0680 0000040f 0000000f 00000000 940cdf78 8003f950
dd60: 7ebf5f3f 805fc991 ffffffff 00000000 9409a200 96662000 00000000 940cdf78
dd80: 940cc000 2ab3c000 96107c60 00000000 00000001 940cddac 00000076 80219e00
dda0: 80000013 ffffffff 96662000 7ebf5f3f 00000004 00000000 9409a200 8012856c
ddc0: 00000812 00000000 2ab62000 00000003 7ebf5f3f 2ab3cd40 9409a234 2ab3c000
dde0: 00000009 000a47ad 9409a200 2ab61870 00008000 0009b5b8 2ab61954 00008000
de00: 000a4000 00000001 8045c200 9401c148 00000080 00000000 9506fb80 940cc000
de20: 805dee34 96662000 805de9a4 805c3cc0 00000001 80127c7c 940cdf78 800ef8c8
de40: 96662000 805de9a4 fffffff8 00000000 00000080 96662000 940cdf78 96662000
de60: 805de9a4 805c3cc0 00000000 801275f0 940cdf78 8012784c 6e69622f 0068732f
de80: 962d0680 8004a840 8baffd40 8004a950 00000017 800d4e18 940cc000 00000000
dea0: 00000000 00000020 00000000 940cdeec 00000000 00000001 96662000 940cc000
dec0: 00000000 940cc000 00000001 96662000 9602fe44 800f0234 00000017 940cdeec
dee0: 00000000 00000000 7effff68 8baffd40 00000004 97feaf4b 00000000 96662002
df00: 8baffd40 940cc000 805dee18 800ef8c8 805e22a0 7efff000 fffffffe 00000000
df20: 00000001 00000000 9602fe44 96014000 00000001 96662000 940cc000 940cdf78
df40: 9401c280 800f136c 00000000 00000000 00000000 9602fe44 805e22a0 940cdf78
df60: 96014000 00000000 00000000 00000000 00000000 80043040 00000000 00000000
df80: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
dfa0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
dfc0: ffffffff 96128740 96107ba0 00000000 ffffffff 00000000 00000000 80085cd0
dfe0: 00000000 96128740 80085bd4 80040a18 00000013 80040a18 27ffc811 27ffcc11
[<80045cf0>] (flush_tlb_page+0x3c/0xc4) from [<800df514>] (ptep_set_access_flags+0x54/0x70)
[<800df514>] (ptep_set_access_flags+0x54/0x70) from [<80608d80>] (0x80608d80)
Code: 9a00001a e5933000 e3ccceff e3ccc00f (e5d32160)
---[ end trace bbe3e5344413ad58 ]---
note: hotplug[1009] exited with preempt_count 1
BUG: scheduling while atomic: hotplug/1009/0x40000002
Modules linked in:
[<800464ac>] (unwind_backtrace+0x0/0xf8) from [<8044b004>] (__schedule+0x4c0/0x6c0)
[<8044b004>] (__schedule+0x4c0/0x6c0) from [<8006e8b4>] (__cond_resched+0x24/0x34)
[<8006e8b4>] (__cond_resched+0x24/0x34) from [<8044b29c>] (_cond_resched+0x34/0x44)
[<8044b29c>] (_cond_resched+0x34/0x44) from [<800d36fc>] (unmap_vmas+0x428/0x668)
[<800d36fc>] (unmap_vmas+0x428/0x668) from [<800d8df0>] (exit_mmap+0x108/0x244)
[<800d8df0>] (exit_mmap+0x108/0x244) from [<8007120c>] (mmput+0x3c/0xfc)
[<8007120c>] (mmput+0x3c/0xfc) from [<800751e0>] (exit_mm+0x128/0x168)
[<800751e0>] (exit_mm+0x128/0x168) from [<80076b48>] (do_exit+0x570/0x6e8)
[<80076b48>] (do_exit+0x570/0x6e8) from [<800436b4>] (die+0x228/0x284)
[<800436b4>] (die+0x228/0x284) from [<80446634>] (__do_kernel_fault.part.4+0x54/0x74)
[<80446634>] (__do_kernel_fault.part.4+0x54/0x74) from [<8004a18c>] (do_page_fault+0x2b4/0x31c)
[<8004a18c>] (do_page_fault+0x2b4/0x31c) from [<8003a2f4>] (do_DataAbort+0x34/0x9c)
[<8003a2f4>] (do_DataAbort+0x34/0x9c) from [<8003f950>] (__dabt_svc+0x70/0xa0)
Exception stack(0x940cdaf8 to 0x940cdb40)
dae0: 8ba81c2c 7ebf5000
db00: 00000002 00000001 00000001 940b5f20 7ebf5000 8ba81c2c 940e17d4 27fea5df
db20: 00000000 00000000 7ebf5000 940cdb40 800df514 80045cf0 20000113 ffffffff
[<8003f950>] (__dabt_svc+0x70/0xa0) from [<80045cf0>] (flush_tlb_page+0x3c/0xc4)
[<80045cf0>] (flush_tlb_page+0x3c/0xc4) from [<800df514>] (ptep_set_access_flags+0x54/0x70)
[<800df514>] (ptep_set_access_flags+0x54/0x70) from [<80608d80>] (0x80608d80)
Unable to handle kernel NULL pointer dereference at virtual address 00000161
pgd = 940c0000
[00000161] *pgd=240b3831, *pte=00000000, *ppte=00000000

2 other boards work fine with same MFGTool, u-boot, uImage. So I assume this is hardware problem.

just in case, I am replacing some parts along with USB-OTG line. there should be error correction on USB protocol though..

Can you guys give me advise please? from where should I start next step?

[igorpadykov]

Hi Jaemin

such errors may be caused by ddr errors, please run ddr test

i.MX6/7 DDR Stress Test Tool V2.70 

and rebuild mfg tools firmware with new ddr coefficients (they are in

uboot/../mx6sabresd/mx6solo_4x_mt41j128.cfg) found from ddr test,

use attached Yocto Guide sect.6.2 Manufacturing Tool, MFGTool

Other reason may be power supplies, please check its requirements in

i.MX6 System Development User’s Guide

http://www.nxp.com/docs/en/user-guide/IMX6DQ6SDLHDG.pdf

Best regards
igor
-----------------------------------------------------------------------------------------------------------------------
Note: If this post answers your question, please click the Correct Answer button. Thank you!
-----------------------------------------------------------------------------------------------------------------------

[jaeminkim]

Thanks for your advise.

I'll try when I get the board back.

[Raana]

Dear JaeMIn Kim,

Did you resolve this issue ?

Because I'm also facing the same issue, while running MFG tool in L3.0.35 kernel.

(only 4 boards are giving issue out of 100)

But these issue boards also working fine with L3.14.38 kernel.

But we want it in L3.0.35 kernel.

If I'm using this L3.14.38 kernel's UBoot with L3.0.35 Kernel means, it's working fine.

I have tried 3 different kind of Power Suppliesbut same crash issue

And also I have tried DDR stress test tool. It's working fine both calibration and stress.

I hope you understand my issue.

Thank You.

Best Regards,

J.P.Raana