kernel crash in CAAM

[frédéric]

I am using kernel 3.0.35_4.1.0 with latest patch as far as I know, on a iMX6 board.

Kernel crash after 22s:

BUG: soft lockup - CPU#0 stuck for 22s! [swapper:1]

Modules linked in:

Pid: 1, comm:              swapper

CPU: 0    Not tainted  (3.0.35 #25)

PC is at __raw_spin_lock_irqsave+0x94/0xb8

LR is at caam_jr_dequeue+0x38/0x2f8

pc : [<c06059b0>]    lr : [<c04082dc>]    psr: a0000113

sp : d4031d00  ip : d43de380  fp : c0864d60

r10: c08227d0  r9 : 00000000  r8 : 00000006

r7 : d43de2f0  r6 : d43de2e0  r5 : 00000001  r4 : d4030000

r3 : e5bff7fe  r2 : a0000113  r1 : d43de2f0  r0 : d43de380

Flags: NzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment kernel

Control: 10c53c7d  Table: 1000404a  DAC: 00000015

PC: 0xc0605930:

5930  e3c4403f e5943004 e2833001 e5843004 e10f2000 f10c0080 e1903f9f e3330000

5950  01803f95 e3530000 1a000004 f57ff05f e5803004 e1a00002 e28dd00c e8bd8030

5970  e121f002 e5943004 e2433001 e5843004 e5943000 e3130002 1a00000d e5903004

5990  e3530000 e5903000 05805004 e3530000 1a000003 eaffffe2 e5903000 e3530000

59b0  0affffdf e5903004 e3530000 1afffff9 eaffffdb e58d0004 ebfff73f e59d0004

59d0  eaffffed eaffffd0 eaffffcf eafffffd e92d4010 ebffffcc e1a04000 ebea05a8

59f0  e121f004 e8bd8010 eafffff8 e92d4030 e24dd00c e3a05001 e1a0300d e3c34d7f

5a10  e3c4403f e5943004 e2833001 e5843004 e1a03005 e1902f9f e2922001 51803f92

LR: 0xc040825c:

825c  e3a00001 e8bd8070 e1a00005 ebf1fb37 eafffff4 eb07ed15 e3a00001 e8bd8070

827c  e59f1018 e1a00004 e1a02005 ebfafb31 e59f000c e3a01024 ebf0f74d c0821a6c

829c  c0786828 c0786848 e92d4ff0 e24dd01c e58d0014 ebfb04a2 e5903008 e1a06000

82bc  e5934020 f57ff04f e5939024 f57ff04f e280c0a0 e58dc004 e1a0000c eb07f5bd

82dc  e596708c e59680ac e0683007 e1a03b83 e1a03ba3 e3530000 e1a0c000 0a0000a3

82fc  e5963008 e593303c f57ff04f e3530000 0a00009e e58d400c e3a03000 e58d3008

831c  e3a01a01 e1cd40d8 e3a02002 e596a0a8 e1844009 e58dc000 e284320b e58d3010

833c  e1a00003 ebf110e6 e59dc000 e1a0b00c e1a04b88 e59620b0 e1a0918a e596e068

SP: 0xd4031c80:

1c80  d4030000 c08227d0 c003adc4 d4031dd8 c087c760 d4030000 c08227d0 c003c1b0

1ca0  ffffffff f2a00100 0000001d 00000104 00000103 c004234c d43de380 d43de2f0

1cc0  a0000113 e5bff7fe d4030000 00000001 d43de2e0 d43de2f0 00000006 00000000

1ce0  c08227d0 c0864d60 d43de380 d4031d00 c04082dc c06059b0 a0000113 ffffffff

1d00  c003b320 d4858884 d4031d80 00000000 d4030000 c04082dc 00000000 d43de380

1d20  d4031d84 7fffffff d4030000 d4859408 00000000 d43de2ec d4030000 00000000

1d40  d43de2f0 00000006 c003a278 c08227d0 c0864d60 c00877f8 c00876d8 00000001

1d60  c080e058 d4030000 00000089 00000006 d4030000 c08125ac 00000103 c0087db4

IP: 0xd43de300:

e300  00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000 00000000

e320  c04082a4 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000089

e340  d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

e360  eecdbfbe 3ca66287 9d7bff7f fde59fdf fdf7ffbf bf746c5b fe7fdfff 9dd73df5

e380  e5bff7fe d9cfe7db 37bb7eff 6dd6f78e ccbf6bef fdbfd8ff ff7f7fff e59fdefd

e3a0  00000000 d4370420 00000000 00000000 d4181600 d9a40000 d41a11e0 00000000

e3c0  00000000 d99a6000 d9a58000 00004000 00000000 00000034 00000000 00000000

e3e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 c082fa50

FP: 0xc0864ce0:

4ce0  00000000 00000000 c07ae3f8 00000000 00000000 00000000 00000000 c07ae40c

4d00  00000000 00000000 00000000 00000000 c07ae430 00000000 00000000 00000000

4d20  00000000 c07ae444 00000000 00000000 00000000 00000000 c07ae4a0 00000000

4d40  00000000 00000000 00000000 c07ae4b8 00000000 00000000 00000000 00000000

4d60  c07ae4cc 00000000 00000000 00000000 00000000 c07ae4ec 00000000 00000000

4d80  00000000 00000000 c07ae4dc 00000000 00000000 00000000 00000000 c07ae4fc

4da0  00000000 00000000 00000000 00000000 c07ae510 00000000 00000000 00000000

4dc0  00000000 c07ae5a0 00000000 00000000 00000000 00000000 c07ae5e4 00000000

R0: 0xd43de300:

e300  00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000 00000000

e320  c04082a4 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000089

e340  d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

e360  eecdbfbe 3ca66287 9d7bff7f fde59fdf fdf7ffbf bf746c5b fe7fdfff 9dd73df5

e380  e5bff7fe d9cfe7db 37bb7eff 6dd6f78e ccbf6bef fdbfd8ff ff7f7fff e59fdefd

e3a0  00000000 d4370420 00000000 00000000 d4181600 d9a40000 d41a11e0 00000000

e3c0  00000000 d99a6000 d9a58000 00004000 00000000 00000034 00000000 00000000

e3e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 c082fa50

R1: 0xd43de270:

e270  fbbbbdfa 6f77fdf9 77bdef9f cbfff777 d5eeffff e38d9de8 ffb77f7b f772977f

e290  75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

e2b0  fdf7ffbf bf746c5b fe7fdfff 9dd73df5 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e

e2d0  ccbf6bef fdbfd8ff ff7f7fff e59fdefd d4181608 00000000 d9a41000 00000000

e2f0  00000002 00000000 c04082a4 d4859408 00000000 00000000 00000000 c04082a4

e310  d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000

e330  00000000 c04082a4 d4859408 00000089 d5eeffff e38d9de8 ffb77f7b f772977f

e350  75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

R3: 0xe5bff77e:

f77c  ******** ******** ******** ******** ******** ******** ******** ********

f79c  ******** ******** ******** ******** ******** ******** ******** ********

f7bc  ******** ******** ******** ******** ******** ******** ******** ********

f7dc  ******** ******** ******** ******** ******** ******** ******** ********

f7fc  ******** ******** ******** ******** ******** ******** ******** ********

f81c  ******** ******** ******** ******** ******** ******** ******** ********

f83c  ******** ******** ******** ******** ******** ******** ******** ********

f85c  ******** ******** ******** ******** ******** ******** ******** ********

f87c  ******** ******** ******** ******** ******** ******** ******** ********

R4: 0xd402ff80:

ff80  f776ffaf 1b0545fa dbb3d7ff 15e6bd95 eff7dfae 9cd38dad f457fbfe ffe6ad73

ffa0  1e7fdf6d cf3b6ff9 fd7e3ffd f46dcb7d cf7af7f5 c4eedfff f23bf7fa 4c6fcfdf

ffc0  d7f9dfa7 dfdf6f9d d039fdff de9fdfdb fdcfffff f9ff6dfd d78ffd7f 959e7ffd

ffe0  b7fbffd9 b3fdfebc fda5ef7f fae7fefe b5bbf7ff fbe377ee bda59f5a e57fdeff

0000  00000002 00010105 00000000 d4027a00 c08354d0 00000000 00000015 d4027a00

0020  c284c320 00000000 d4030000 7f6e49fd c08292e8 d4027cac d4031cd4 d4031c20

0040  c06030b4 00000000 00000000 00000000 00000000 00000000 00000000 00000000

0060  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

R6: 0xd43de260:

e260  f9137f9e 4aedddef b6f9fbff 8fbfd77f fbbbbdfa 6f77fdf9 77bdef9f cbfff777

e280  d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

e2a0  eecdbfbe 3ca66287 9d7bff7f fde59fdf fdf7ffbf bf746c5b fe7fdfff 9dd73df5

e2c0  e5bff7fe d9cfe7db 37bb7eff 6dd6f78e ccbf6bef fdbfd8ff ff7f7fff e59fdefd

e2e0  d4181608 00000000 d9a41000 00000000 00000002 00000000 c04082a4 d4859408

e300  00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000 00000000

e320  c04082a4 d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000089

e340  d5eeffff e38d9de8 ffb77f7b f772977f 75ee7fff 5b5d022f 7ffabfff f7ef64fb

R7: 0xd43de270:

e270  fbbbbdfa 6f77fdf9 77bdef9f cbfff777 d5eeffff e38d9de8 ffb77f7b f772977f

e290  75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

e2b0  fdf7ffbf bf746c5b fe7fdfff 9dd73df5 e5bff7fe d9cfe7db 37bb7eff 6dd6f78e

e2d0  ccbf6bef fdbfd8ff ff7f7fff e59fdefd d4181608 00000000 d9a41000 00000000

e2f0  00000002 00000000 c04082a4 d4859408 00000000 00000000 00000000 c04082a4

e310  d4859408 00000000 00000000 00000000 c04082a4 d4859408 00000000 00000000

e330  00000000 c04082a4 d4859408 00000089 d5eeffff e38d9de8 ffb77f7b f772977f

e350  75ee7fff 5b5d022f 7ffabfff f7ef64fb eecdbfbe 3ca66287 9d7bff7f fde59fdf

R10: 0xc0822750:

2750  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

2770  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000

2790  00000064 00008000 0000000f c286a020 00000008 00000004 c286a000 c2862000

27b0  c284b000 0000002c c2852000 c285a000 00000001 00001000 00000000 00000003

[Yuri]

Please try the recent BSP (Yocto or LTIB), that may be found on the Web :

https://www.freescale.com/webapp/Download?colCode=L3.10.17_1.0.0_IMX6QDLS_BUNDLE&appType=license&loc...

https://www.freescale.com/webapp/Download?colCode=L3.10.17_1.0.2_iMX6QDLS_BUNDLE&appType=license&loc...

https://www.freescale.com/webapp/Download?colCode=L3.0.101_4.1.1_SOURCE_BSP&appType=license&location...

https://www.freescale.com/webapp/Download?colCode=L3.0.101_4.1.1_IM6QDLS_BUNDLE&appType=license&loca...

Summary Page :

http://www.freescale.com/webapp/sps/site/prod_summary.jsp?code=i.MX6Q&fpsp=1&tab=Design_Tools_Tab

Have a great day,
Yuri

-----------------------------------------------------------------------------------------------------------------------
Note: If this post answers your question, please click the Correct Answer button. Thank you!
-----------------------------------------------------------------------------------------------------------------------

[frédéric]

Hello Yuri,

I should have mentionned that this occurs only on board with secure boot set as "closed", all the board in "open" state works fine, but as soon as we burn the fuse (echo 0x2 > HW_OCOTP_CFG5) to go in close mode, the kernel crashes in CAAM. It seems locked in a irq, the JRINTR status value is 0x09 and loop on this. On open boards, the JRINTR value is 0x01 for only one time at boot then it continues.

Using a precompiled 3.0.35 kernel for a nitrogen boundary6x (mostly compatible with our board), the problem sometimes happens, sometimes not, as the precompiled kernel has more modules compiled into it, maybe it is a race condition? When kernel boots successfully, Android starts to load then the system reboots by itself after a few seconds too. All this only in close mode, in open mode there is no problem.

Any clue?

[Yuri]

If there is no HAB event in open mode, but your board cannot bootup after program

SEC_CONFIG to close mode, please check if you have unlocked RNG in CSF script.

[Unlock]

Engine = CAAM

Features = RNG

For the reason to unlock RNG, pleases refer to Q&A: HAB on i.MX6

Q&amp;A: HAB on i.MX6

Mx6 HAB (High Assurance Boot)

~Yuri.

[frédéric · Accepted solution]

Yuri,

I discovered that our board had the WDOG2 disabled this way:

__raw_writew(0, IO_ADDRESS(MX6Q_WDOG2_BASE_ADDR));

which caused the crash in kernel, I commented the line and now kernel boots fine.

[Yuri]

Interestingly.

[frédéric]

In close mode, uboot boots fine, no event, kernel boots fine too, but loop in CAAM driver.

[frédéric]

Thanks, kernel 3.0.101 seems to go through CAAM fine, I will either import patches into our kernel or modify 3.0.101 sources with our needs.

Frédéric.

[Yuri]

Please forward request to   i.MX Community

~Yuri.