topic Re: kernel crash in CAAM in i.MX Processors

kernel crash in CAAM

frédéric — Fri, 07 Nov 2014 19:05:13 GMT

I am using kernel 3.0.35_4.1.0 with latest patch as far as I know, on a iMX6 board.

Kernel crash after 22s:

BUG: soft lockup - CPU#0 stuck for 22s! [swapper:1]

Modules linked in:

Pid: 1, comm:              swapper

CPU: 0    Not tainted (3.0.35 #25)

PC is at __raw_spin_lock_irqsave+0x94/0xb8

LR is at caam_jr_dequeue+0x38/0x2f8

pc : [<c06059b0>]    lr : [<c04082dc>]    psr: a0000113

sp : d4031d00 ip : d43de380 fp : c0864d60

r10: c08227d0 r9 : 00000000 r8 : 00000006

r7 : d43de2f0 r6 : d43de2e0 r5 : 00000001 r4 : d4030000

r3 : e5bff7fe r2 : a0000113 r1 : d43de2f0 r0 : d43de380

Flags: NzCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment kernel

Control: 10c53c7d Table: 1000404a DAC: 00000015

PC: 0xc0605930:

5930 e3c4403f e5943004 e2833001 e5843004 e10f2000 f10c0080 e1903f9f e3330000

5950 01803f95 e3530000 1a000004 f57ff05f e5803004 e1a00002 e28dd00c e8bd8030

5970 e121f002 e5943004 e2433001 e5843004 e5943000 e3130002 1a00000d e5903004

5990 e3530000 e5903000 05805004 e3530000 1a000003 eaffffe2 e5903000 e3530000

59b0 0affffdf e5903004 e3530000 1afffff9 eaffffdb e58d0004 ebfff73f e59d0004

59d0 eaffffed eaffffd0 eaffffcf eafffffd e92d4010 ebffffcc e1a04000 ebea05a8

59f0 e121f004 e8bd8010 eafffff8 e92d4030 e24dd00c e3a05001 e1a0300d e3c34d7f

5a10 e3c4403f e5943004 e2833001 e5843004 e1a03005 e1902f9f e2922001 51803f92

LR: 0xc040825c:

825c e3a00001 e8bd8070 e1a00005 ebf1fb37 eafffff4 eb07ed15 e3a00001 e8bd8070

827c e59f1018 e1a00004 e1a02005 ebfafb31 e59f000c e3a01024 ebf0f74d c0821a6c

829c c0786828 c0786848 e92d4ff0 e24dd01c e58d0014 ebfb04a2 e5903008 e1a06000

82bc e5934020 f57ff04f e5939024 f57ff04f e280c0a0 e58dc004 e1a0000c eb07f5bd

82dc e596708c e59680ac e0683007 e1a03b83 e1a03ba3 e3530000 e1a0c000 0a0000a3

82fc e5963008 e593303c f57ff04f e3530000 0a00009e e58d400c e3a03000 e58d3008

831c e3a01a01 e1cd40d8 e3a02002 e596a0a8 e1844009 e58dc000 e284320b e58d3010

833c e1a00003 ebf110e6 e59dc000 e1a0b00c e1a04b88 e59620b0 e1a0918a e596e068

SP: 0xd4031c80:

1c80 d4030000 c08227d0 c003adc4 d4031dd8 c087c760 d4030000 c08227d0 c003c1b0

1ca0 ffffffff f2a00100 0000001d 00000104 00000103 c004234c d43de380 d43de2f0

1cc0 a0000113 e5bff7fe d4030000 00000001 d43de2e0 d43de2f0 00000006 00000000

1ce0 c08227d0 c0864d60 d43de380 d4031d00 c04082dc c06059b0 a0000113 ffffffff

1d00 c003b320 d4858884 d4031d80 00000000 d4030000 c04082dc 00000000 d43de380

1d20 d4031d84 7fffffff d4030000 d4859408 00000000 d43de2ec d4030000 00000000

1d40 d43de2f0 00000006 c003a278 c08227d0 c0864d60 c00877f8 c00876d8 00000001

1d60 c080e058 d4030000 00000089 00000006 d4030000 c08125ac 00000103 c0087db4

IP: 0xd43de300:

e300 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000 00000000

e320 c04082a4 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000089

e340 d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

e360 eecdbfbe 3ca66287 9d7bff7f fde59fdf fdf7ffbf bf746c5b fe7fdfff 9dd73df5

e380 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e ccbf6bef fdbfd8ff ff7f7fff e59fdefd

e3a0 00000000 d4370420 00000000 00000000 d4181600 d9a40000 d41a11e0 00000000

e3c0 00000000 d99a6000 d9a58000 00004000 00000000 00000034 00000000 00000000

e3e0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 c082fa50

FP: 0xc0864ce0:

4ce0 00000000 00000000 c07ae3f8 00000000 00000000 00000000 00000000 c07ae40c

4d00 00000000 00000000 00000000 00000000 c07ae430 00000000 00000000 00000000

4d20 00000000 c07ae444 00000000 00000000 00000000 00000000 c07ae4a0 00000000

4d40 00000000 00000000 00000000 c07ae4b8 00000000 00000000 00000000 00000000

4d60 c07ae4cc 00000000 00000000 00000000 00000000 c07ae4ec 00000000 00000000

4d80 00000000 00000000 c07ae4dc 00000000 00000000 00000000 00000000 c07ae4fc

4da0 00000000 00000000 00000000 00000000 c07ae510 00000000 00000000 00000000

4dc0 00000000 c07ae5a0 00000000 00000000 00000000 00000000 c07ae5e4 00000000

R0: 0xd43de300:

e300 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000 00000000

e320 c04082a4 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000089

e340 d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

e360 eecdbfbe 3ca66287 9d7bff7f fde59fdf fdf7ffbf bf746c5b fe7fdfff 9dd73df5

e380 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e ccbf6bef fdbfd8ff ff7f7fff e59fdefd

e3a0 00000000 d4370420 00000000 00000000 d4181600 d9a40000 d41a11e0 00000000

e3c0 00000000 d99a6000 d9a58000 00004000 00000000 00000034 00000000 00000000

e3e0 00000000 00000000 00000000 00000000 00000000 00000000 00000000 c082fa50

R1: 0xd43de270:

e270 fbbbbdfa 6f77fdf9 77bdef9f cbfff777 d5eeffff e38d9de8 ffb77f7b f772977f

e290 75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

e2b0 fdf7ffbf bf746c5b fe7fdfff 9dd73df5 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e

e2d0 ccbf6bef fdbfd8ff ff7f7fff e59fdefd d4181608 00000000 d9a41000 00000000

e2f0 00000002 00000000 c04082a4 d4859408 00000000 00000000 00000000 c04082a4

e310 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000

e330 00000000 c04082a4 d4859408 00000089 d5eeffff e38d9de8 ffb77f7b f772977f

e350 75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

R3: 0xe5bff77e:

f77c ******** ******** ******** ******** ******** ******** ******** ********

f79c ******** ******** ******** ******** ******** ******** ******** ********

f7bc ******** ******** ******** ******** ******** ******** ******** ********

f7dc ******** ******** ******** ******** ******** ******** ******** ********

f7fc ******** ******** ******** ******** ******** ******** ******** ********

f81c ******** ******** ******** ******** ******** ******** ******** ********

f83c ******** ******** ******** ******** ******** ******** ******** ********

f85c ******** ******** ******** ******** ******** ******** ******** ********

f87c ******** ******** ******** ******** ******** ******** ******** ********

R4: 0xd402ff80:

ff80 f776ffaf 1b0545fa dbb3d7ff 15e6bd95 eff7dfae 9cd38dad f457fbfe ffe6ad73

ffa0 1e7fdf6d cf3b6ff9 fd7e3ffd f46dcb7d cf7af7f5 c4eedfff f23bf7fa 4c6fcfdf

ffc0 d7f9dfa7 dfdf6f9d d039fdff de9fdfdb fdcfffff f9ff6dfd d78ffd7f 959e7ffd

ffe0 b7fbffd9 b3fdfebc fda5ef7f fae7fefe b5bbf7ff fbe377ee bda59f5a e57fdeff

0000 00000002 00010105 00000000 d4027a00 c08354d0 00000000 00000015 d4027a00

0020 c284c320 00000000 d4030000 7f6e49fd c08292e8 d4027cac d4031cd4 d4031c20

0040 c06030b4 00000000 00000000 00000000 00000000 00000000 00000000 00000000

0060 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

R6: 0xd43de260:

e260 f9137f9e 4aedddef b6f9fbff 8fbfd77f fbbbbdfa 6f77fdf9 77bdef9f cbfff777

e280 d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

e2a0 eecdbfbe 3ca66287 9d7bff7f fde59fdf fdf7ffbf bf746c5b fe7fdfff 9dd73df5

e2c0 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e ccbf6bef fdbfd8ff ff7f7fff e59fdefd

e2e0 d4181608 00000000 d9a41000 00000000 00000002 00000000 c04082a4 d4859408

e300 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000 00000000

e320 c04082a4 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000089

e340 d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

R7: 0xd43de270:

e270 fbbbbdfa 6f77fdf9 77bdef9f cbfff777 d5eeffff e38d9de8 ffb77f7b f772977f

e290 75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

e2b0 fdf7ffbf bf746c5b fe7fdfff 9dd73df5 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e

e2d0 ccbf6bef fdbfd8ff ff7f7fff e59fdefd d4181608 00000000 d9a41000 00000000

e2f0 00000002 00000000 c04082a4 d4859408 00000000 00000000 00000000 c04082a4

e310 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000

e330 00000000 c04082a4 d4859408 00000089 d5eeffff e38d9de8 ffb77f7b f772977f

e350 75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

R10: 0xc0822750:

2750 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

2770 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

2790 00000064 00008000 0000000f c286a020 00000008 00000004 c286a000 c2862000

27b0 c284b000 0000002c c2852000 c285a000 00000001 00001000 00000000 00000003

Re: kernel crash in CAAM

Yuri — Thu, 13 Nov 2014 02:43:42 GMT

Please forward request to i.MX Community

~Yuri.

Re: kernel crash in CAAM

Yuri — Thu, 13 Nov 2014 02:52:24 GMT

Please try the recent BSP (Yocto or LTIB), that may be found on the Web :

https://www.freescale.com/webapp/Download?colCode=L3.10.17_1.0.0_IMX6QDLS_BUNDLE&appType=license&location=null&fasp=1&WT_TYPE=Board%20Support%20Packages&WT_VENDOR=FREESCALE&WT_FILE_FORMAT=gz&WT_ASSET=Downloads&fileExt=.gz&Parent_nodeId=1337637154535695831062&Parent_pageType=product

https://www.freescale.com/webapp/Download?colCode=L3.10.17_1.0.2_iMX6QDLS_BUNDLE&appType=license&location=null&fasp=1&WT…

https://www.freescale.com/webapp/Download?colCode=L3.0.101_4.1.1_SOURCE_BSP&appType=license&location=null&fasp=1&WT_TYPE=Board%20Support%20Packages&WT_VENDOR=FREESCALE&WT_FILE_FORMAT=gz&WT_ASSET=Downloads&fileExt=.gz&Parent_nodeId=1337637154535695831062&Parent_pageType=product

https://www.freescale.com/webapp/Download?colCode=L3.0.101_4.1.1_IM6QDLS_BUNDLE&appType=license&location=null&fasp=1&WT_…

Summary Page :

http://www.freescale.com/webapp/sps/site/prod_summary.jsp?code=i.MX6Q&fpsp=1&tab=Design_Tools_Tab

Have a great day,
Yuri

-----------------------------------------------------------------------------------------------------------------------
Note: If this post answers your question, please click the Correct Answer button. Thank you!
-----------------------------------------------------------------------------------------------------------------------

Re: kernel crash in CAAM

frédéric — Thu, 13 Nov 2014 15:39:14 GMT

Thanks, kernel 3.0.101 seems to go through CAAM fine, I will either import patches into our kernel or modify 3.0.101 sources with our needs.

Frédéric.

Re: kernel crash in CAAM

frédéric — Fri, 14 Nov 2014 19:45:01 GMT

Hello Yuri,

I should have mentionned that this occurs only on board with secure boot set as "closed", all the board in "open" state works fine, but as soon as we burn the fuse (echo 0x2 > HW_OCOTP_CFG5) to go in close mode, the kernel crashes in CAAM. It seems locked in a irq, the JRINTR status value is 0x09 and loop on this. On open boards, the JRINTR value is 0x01 for only one time at boot then it continues.

Using a precompiled 3.0.35 kernel for a nitrogen boundary6x (mostly compatible with our board), the problem sometimes happens, sometimes not, as the precompiled kernel has more modules compiled into it, maybe it is a race condition? When kernel boots successfully, Android starts to load then the system reboots by itself after a few seconds too. All this only in close mode, in open mode there is no problem.

Any clue?

Re: kernel crash in CAAM

Yuri — Mon, 17 Nov 2014 05:23:12 GMT

If there is no HAB event in open mode, but your board cannot bootup after program

SEC_CONFIG to close mode, please check if you have unlocked RNG in CSF script.

[Unlock]

Engine = CAAM

Features = RNG

For the reason to unlock RNG, pleases refer to Q&A: HAB on i.MX6

Q&A: HAB on i.MX6

Mx6 HAB (High Assurance Boot)

~Yuri.

Re: kernel crash in CAAM

frédéric — Mon, 17 Nov 2014 19:12:50 GMT

In close mode, uboot boots fine, no event, kernel boots fine too, but loop in CAAM driver.

Re: kernel crash in CAAM

frédéric — Thu, 20 Nov 2014 19:49:37 GMT

Yuri,

I discovered that our board had the WDOG2 disabled this way:

__raw_writew(0, IO_ADDRESS(MX6Q_WDOG2_BASE_ADDR));

which caused the crash in kernel, I commented the line and now kernel boots fine.

Re: kernel crash in CAAM

Yuri — Fri, 21 Nov 2014 07:28:57 GMT

Interestingly.