AnsweredAssumed Answered

INFO: rcu_sched_state detected stall on CPU 3 (t=0 jiffies)

Question asked by 贵福 徐 on Nov 30, 2017
Latest reply on Nov 30, 2017 by igorpadykov

Hi,

freescale android kernel have scheduling problem .It will random crash( rcu_sched_state detected stall on CPU )

 

Similar problems:
 https://community.nxp.com/thread/316911#comment-429399

freescale android kernel have scheduling problem !!!

 

11-26 09:53:55.445277337 INFO: rcu_sched_state detected stall on CPU 3 (t=0 jiffies)
11-26 09:53:55.452895670 Backtrace for cpu 3 (current):
11-26 09:53:55.457955003 [<c0057104>] (unwind_backtrace+0x0/0x138) from [<c0055f88>] (smp_send_all_cpu_backtrace+0x60/0xdc)
11-26 09:53:55.468968337 [<c0055f88>] (smp_send_all_cpu_backtrace+0x60/0xdc) from [<c00dfa98>] (__rcu_pending+0x144/0x3c0)
11-26 09:53:55.479885337 [<c00dfa98>] (__rcu_pending+0x144/0x3c0) from [<c00e05b8>] (rcu_check_callbacks+0xb0/0x204)
11-26 09:53:55.490281003 [<c00e05b8>] (rcu_check_callbacks+0xb0/0x204) from [<c00a0b28>] (update_process_times+0x38/0x68)
11-26 09:53:55.501113670 [<c00a0b28>] (update_process_times+0x38/0x68) from [<c00c03a8>] (tick_sched_timer+0x80/0xe4)
11-26 09:53:55.511600336 [<c00c03a8>] (tick_sched_timer+0x80/0xe4) from [<c00b3c54>] (__run_hrtimer+0x80/0x2c0)
11-26 09:53:55.521713336 [<c00b3c54>] (__run_hrtimer+0x80/0x2c0) from [<c00b4b50>] (hrtimer_interrupt+0x118/0x294)
11-26 09:53:55.532106003 [<c00b4b50>] (hrtimer_interrupt+0x118/0x294) from [<c0049334>] (do_IPI+0x14c/0x208)
11-26 09:53:55.541849003 [<c0049334>] (do_IPI+0x14c/0x208) from [<c004f40c>] (__irq_svc+0x4c/0xe8)
11-26 09:53:55.550832337 Exception stack(0xd609bf90 to 0xd609bfd8)
11-26 09:53:55.557036670 bf80:                                     c0a004a8 600d0093 00000001 00000000
11-26 09:53:55.566252337 bfa0: d609a000 c09f7ea4 c0971a70 c06cb4b8 c097a2ac 412fc09a 00000000 00000000
11-26 09:53:55.575586004 bfc0: 00000000 d609bfd8 c005f450 c0050528 400d0013 ffffffff
11-26 09:53:55.583363336 [<c004f40c>] (__irq_svc+0x4c/0xe8) from [<c0050528>] (default_idle+0x24/0x28)
11-26 09:53:55.592700670 [<c0050528>] (default_idle+0x24/0x28) from [<c0050850>] (cpu_idle+0xe0/0x124)
11-26 09:53:55.602039003 [<c0050850>] (cpu_idle+0xe0/0x124) from [<106bcdd4>] (0x106bcdd4)
11-26 09:53:55.610199337
11-26 09:53:55.610210003 sending IPI to all other CPUs:
11-26 09:53:55.617948003 IPI backtrace for cpu 0
11-26 09:53:55.622467670
11-26 09:53:55.624979336 Pid: 9201, comm:          kworker/0:3
11-26 09:53:55.630835669 CPU: 0    Not tainted  (3.0.35 #402)
11-26 09:53:55.636492335 PC is at generic_exec_single+0x6c/0x90
11-26 09:53:55.642437001 LR is at arch_send_call_function_single_ipi+0x34/0x38
11-26 09:53:55.649682667 pc : [<c00c508c>]    lr : [<c0055d8c>]    psr: 200f0013
11-26 09:53:55.649699667 sp : d7bc7dc8  ip : 00000000  fp : c09727d0
11-26 09:53:55.663342333 r10: 00000001  r9 : c28b9888  r8 : 02871000
11-26 09:53:55.669593666 r7 : c28b9880  r6 : 00000003  r5 : c28b9880  r4 : d7bc7df4
11-26 09:53:55.677268998 r3 : 00000001  r2 : f2a01000  r1 : 00000005  r0 : c06cb43c
11-26 09:53:55.684948664 Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment kernel
11-26 09:53:55.693287330 Control: 10c53c7d  Table: 2774404a  DAC: 00000015
11-26 09:53:55.700176330
11-26 09:53:55.700185996 PC: 0xc00c500c:
11-26 09:53:55.706489662 500c  e59f0008 e3a01079 ebff310c eafffff6 c0851b6c e59f3080 e92d47f0 e1a06000
11-26 09:53:55.717183995 502c  e7938100 e1a04001 e59f5070 e1a0a002 e0857008 e2879008 e1a00009 eb180e43
11-26 09:53:55.727879661 504c  e5973004 e7955008 e5874004 e5847000 e5843004 e5834000 e1a01000 e1a00009
11-26 09:53:55.738577660 506c  eb180ceb e1570005 0a000008 e35a0000 08bd87f0 e1d431b0 e3130001 08bd87f0
11-26 09:53:55.749273659 508c  e1d431b0 e3130001 1afffffc e8bd87f0 e1a00006 ebfe432c eafffff3 c09727d0
11-26 09:53:55.759851991 50ac  c0048880 e92d45f0 e24dd024 e1a05000 e1a06001 e1a0c00d e3cc4d7f e3c4403f
11-26 09:53:55.770534657 50cc  e3a0c000 e58dc010 e58dc00c e5947004 e58dc014 e58dc018 e2877001 e58dc01c
11-26 09:53:55.781092656 50ec  e5847004 e5947014 e59f8168 e3570000 e287c01f e207101f a1a0c007 e5980000
11-26 09:53:55.791774988
11-26 09:53:55.791784988 LR: 0xc0055d0c:
11-26 09:53:55.798087988 5d0c  e59f0020 e1a01004 e8bd4010 ea19ae0c e59f0014 e1a01004 e8bd4010 ea19ae08
11-26 09:53:55.808773320 5d2c  c097a75c c08453dc c08453f0 c08453c0 e92d4008 e3083050 e34c309f e3a01004
11-26 09:53:55.819465653 5d4c  e5933000 e12fff33 e8bd8008 e200201f e30b142c e2822001 e34c106c e92d4008
11-26 09:53:55.830149652 5d6c  e0812102 e3083050 e1a002a0 e34c309f e3a01005 e0420100 e5933000 e12fff33
11-26 09:53:55.840827651 5d8c  e8bd8008 e59f3098 e92d4ff0 e241b001 e59f9090 e24dd00c e59f708c e1a06000
11-26 09:53:55.851397650 5dac  e593a000 e3a05000 e59f8080 e1a00006 e59f107c e1a0200b e59f3078 e58d5000
11-26 09:53:55.862077316 5dcc  e3e04000 eb03fe64 ea000001 e5922008 eb03fe61 e2842001 e3a01004 e1a0000a
11-26 09:53:55.872768648 5dec  eb0a333b e59f1050 e0853180 e1a04000 e1a00006 e0882103 e5973000 e1530004
11-26 09:53:55.883459314
11-26 09:53:55.883469647 SP: 0xd7bc7d48:
11-26 09:53:55.889778980 7d48  d7bc7d80 c09f8050 c09727d0 c0050cb0 c09727d0 c0049380 ffffffff f2a00100
11-26 09:53:55.900480646 7d68  00000c07 00000002 00000001 d7bc6000 00000001 c004f40c c06cb43c 00000005
11-26 09:53:55.911165311 7d88  f2a01000 00000001 d7bc7df4 c28b9880 00000003 c28b9880 02871000 c28b9888
11-26 09:53:55.921843310 7da8  00000001 c09727d0 00000000 d7bc7dc8 c0055d8c c00c508c 200f0013 ffffffff
11-26 09:53:55.932414309 7dc8  d7bc6000 00000000 c00568b8 00000000 c06cb4b8 d7bc7ec8 d7bc7ec8 c00c51c8
11-26 09:53:55.942983975 7de8  d6285e00 d6285e00 00000040 c28b9880 c28b9880 c00568b8 00000000 00000001
11-26 09:53:55.953668974 7e08  d7042820 ffffffff c09cc434 00000000 d7bc7ec8 00000001 d7bc7ec8 c0056a30
11-26 09:53:55.964359307 7e28  c00569e8 c00b5a18 c0a5209c c0a52084 00000000 00000001 ffffffff c00b5b6c
11-26 09:53:55.975038306
11-26 09:53:55.975048306 FP: 0xc0972750:
11-26 09:53:55.981351638 2750  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:55.992030638 2770  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.002588970 2790  00000064 00008000 0000000f c28bf020 00000008 00000004 c28bf000 c28b7000
11-26 09:53:56.013266969 27b0  c28a0000 0000002c c28a7000 c28af000 00000001 00001000 00000000 00000003
11-26 09:53:56.023957301 27d0  02859000 02861000 02869000 02871000 00057700 00000002 00028ffb 0008ffff
11-26 09:53:56.034502967 27f0  00000001 00000032 0000fffa 00000001 d6227a20 d62279c0 00000000 d6019e60
11-26 09:53:56.045188633 2810  0000000f d601e580 d6227960 d6019f20 00000010 c28c1120 0000ffff 00000064
11-26 09:53:56.055873965 2830  d6019f80 0000000f c2901120 00007fff d6019ec0 00100000 d601c000 0000000f
11-26 09:53:56.066568964
11-26 09:53:56.066579298 R0: 0xc06cb3bc:
11-26 09:53:56.072884297 b3bc  73756170 6e6f5f65 706f6f5f 00000073 696e6170 00000063 423e323c 203a4755
11-26 09:53:56.083578963 b3dc  65636572 7020746e 746e6972 6572206b 73727563 216e6f69 0000000a 6e697270
11-26 09:53:56.094272295 b3fc  742e6b74 00656d69 6e697270 702e6b74 746e6972 74725f6b 00000063 7570635f
11-26 09:53:56.104954628 b41c  0070755f 7570635f 776f645f 0000006e 00000000 00000001 00000002 00000004
11-26 09:53:56.115537960 b43c  00000008 00000010 00000020 00000040 00000080 00000100 00000200 00000400
11-26 09:53:56.126114959 b45c  00000800 00001000 00002000 00004000 00008000 00010000 00020000 00040000
11-26 09:53:56.136803958 b47c  00080000 00100000 00200000 00400000 00800000 01000000 02000000 04000000
11-26 09:53:56.147490624 b49c  08000000 10000000 20000000 40000000 80000000 c0971b20 c0971b18 c0971b14
11-26 09:53:56.158059290
11-26 09:53:56.158068956 R2: 0xf2a00f80:
11-26 09:53:56.164370623 0f80  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.175052288 0fa0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.185731287 0fc0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.196424286 0fe0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.207000619 1000  00000001 0000fc64 0102043b 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.217684285 1020  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.228236617 1040  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.238916616 1060  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.249610615
11-26 09:53:56.249620282 R4: 0xd7bc7d74:
11-26 09:53:56.255924615 7d74  d7bc6000 00000001 c004f40c c06cb43c 00000005 f2a01000 00000001 d7bc7df4
11-26 09:53:56.266612280 7d94  c28b9880 00000003 c28b9880 02871000 c28b9888 00000001 c09727d0 00000000
11-26 09:53:56.277285279 7db4  d7bc7dc8 c0055d8c c00c508c 200f0013 ffffffff d7bc6000 00000000 c00568b8
11-26 09:53:56.287962612 7dd4  00000000 c06cb4b8 d7bc7ec8 d7bc7ec8 c00c51c8 d6285e00 d6285e00 00000040
11-26 09:53:56.298519278 7df4  c28b9880 c28b9880 c00568b8 00000000 00000001 d7042820 ffffffff c09cc434
11-26 09:53:56.309216277 7e14  00000000 d7bc7ec8 00000001 d7bc7ec8 c0056a30 c00569e8 c00b5a18 c0a5209c
11-26 09:53:56.319912609 7e34  c0a52084 00000000 00000001 ffffffff c00b5b6c 00000000 c032d794 0011edd8
11-26 09:53:56.330604608 7e54  d7bc7ec8 00000001 d62018e0 00060ae0 c09efa60 00000003 c00b5ba0 00000000
11-26 09:53:56.341300274
11-26 09:53:56.341310274 R5: 0xc28b9800:
11-26 09:53:56.347612273 9800  d7f3c5f2 00000b78 000003e3 00000000 0474a9d0 017b1dc2 01dfa97b 011ad3e0
11-26 09:53:56.358294606 9820  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.368976938 9840  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.379542937 9860  c095e0e0 00200200 c005d980 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.390091270 9880  d7bc7df4 d7bc7df4 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.400771602 98a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.411465934 98c0  00000000 c28b98c0 c28b98c8 c28b98c8 00000000 c28b98d4 c28b98d4 00000000
11-26 09:53:56.422156933 98e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.432841599
11-26 09:53:56.432851266 R7: 0xc28b9800:
11-26 09:53:56.439151599 9800  d7f3c5f2 00000b78 000003e3 00000000 0474a9d0 017b1dc2 01dfa97b 011ad3e0
11-26 09:53:56.449699264 9820  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.460382930 9840  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.471069262 9860  c095e0e0 00200200 c005d980 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.481621595 9880  d7bc7df4 d7bc7df4 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.492304261 98a0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.502982593 98c0  00000000 c28b98c0 c28b98c8 c28b98c8 00000000 c28b98d4 c28b98d4 00000000
11-26 09:53:56.513671925 98e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.524357924
11-26 09:53:56.524367924 R9: 0xc28b9808:
11-26 09:53:56.530672924 9808  000003e3 00000000 0474a9d0 017b1dc2 01dfa97b 011ad3e0 00000000 00000000
11-26 09:53:56.541352923 9828  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.552055589 9848  00000000 00000000 00000000 00000000 00000000 00000000 c095e0e0 00200200
11-26 09:53:56.562615254 9868  c005d980 00000000 00000000 00000000 00000000 00000000 d7bc7df4 d7bc7df4
11-26 09:53:56.573189920 9888  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.583889253 98a8  00000000 00000000 00000000 00000000 00000000 00000000 00000000 c28b98c0
11-26 09:53:56.594574918 98c8  c28b98c8 c28b98c8 00000000 c28b98d4 c28b98d4 00000000 00000000 00000000
11-26 09:53:56.605138584 98e8  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.615814917 IPI backtrace for cpu 1
11-26 09:53:56.620328609
11-26 09:53:56.622841291 Pid: 0, comm:              swapper
11-26 09:53:56.628434990 CPU: 1    Not tainted  (3.0.35 #402)
11-26 09:53:56.634082691 PC is at default_idle+0x24/0x28
11-26 09:53:56.639424044 LR is at arch_idle+0xbc/0xf4
11-26 09:53:56.644373392 pc : [<c0050528>]    lr : [<c005f450>]    psr: 400f0013
11-26 09:53:56.644389725 sp : d6065fd8  ip : 00000000  fp : 00000000
11-26 09:53:56.658023055 r10: 00000000  r9 : 412fc09a  r8 : c097a2ac
11-26 09:53:56.664396371 r7 : c06cb4b8  r6 : c0971a70  r5 : c09f7ea4  r4 : d6064000
11-26 09:53:56.671948685 r3 : 00000000  r2 : 00000001  r1 : 200f0093  r0 : c0a004a8
11-26 09:53:56.679627668 Flags: nZcv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment kernel
11-26 09:53:56.688085987 Control: 10c53c7d  Table: 269f004a  DAC: 00000015
11-26 09:53:56.694854648
11-26 09:53:56.694864648 PC: 0xc00504a8:
11-26 09:53:56.701288985 04a8  c09e3e98 c0843d58 c06c99e4 c0843d78 e121f007 e1a00004 e1a0e006 e1a0f005
11-26 09:53:56.711971664 04c8  eb01119c e320f000 e3073ea4 e34c309f e5932000 e2822001 e5832000 e12fff1e
11-26 09:53:56.722524674 04e8  e3073ea4 e34c309f e5932000 e2422001 e5832000 e12fff1e e12fff1e e92d4008
11-26 09:53:56.733192676 0508  e1a0200d e3c23d7f e3c3303f e5933000 e3130002 1a000000 eb003b9b f1080080
11-26 09:53:56.743855007 0528  e8bd8008 e92d4070 e24dd050 e1a04000 e1a05001 e28d0008 e3a01048 e1a06002
11-26 09:53:56.754532338 0548  eb0a4ddc e3a0c000 e3860502 e1a0100c e28d2008 e1a0300c e3800c01 e58d5018
11-26 09:53:56.765215336 0568  e300e4c8 e58d401c e34ce005 e58dc000 e58de020 e3a0e013 e58dc004 e58de024
11-26 09:53:56.775770001 0588  e300e4b8 e34ce005 e58de044 e3a0e093 e58de048 eb010013 e28dd050 e8bd8070
11-26 09:53:56.786454001
11-26 09:53:56.786463668 LR: 0xc005f3d0:
11-26 09:53:56.792890002 f3d0  e8bd8000 ebfffe85 ebffff37 eafffffa eb01830e e3500000 0afffff7 e3a00004
11-26 09:53:56.803574002 f3f0  e08d1000 eb017bb4 e59f307c e5d33010 e3530000 13a00000 03a00002 ebfffe77
11-26 09:53:56.814121003 f410  e59f3068 e5d33000 e3530000 1a00000e e59f305c e5933000 e5930000 e200000f
11-26 09:53:56.824804337 f430  eb0a526b e3500001 0a000005 e59d0004 ebffffbc e3a00005 e28d1004 eb017b9e
11-26 09:53:56.835628337 f450  eaffffdd ebffff22 eafffff9 e3a03901 e34f340c e5932064 e3c22002 e5832064
11-26 09:53:56.846307670 f470  ebffff11 eafffff2 c097adf0 c09f8308 c09f82e8 c06cb4bc e3a03902 e340320d
11-26 09:53:56.856861670 f490  e5932040 e3822030 e5832040 e5932044 e3822201 e5832044 e12fff1e e3a03902
11-26 09:53:56.867413670 f4b0  e340320d e5932040 e3c22030 e5832040 e5932044 e3c22201 e5832044 e12fff1e
11-26 09:53:56.878106337
11-26 09:53:56.878116337 SP: 0xd6065f58:
11-26 09:53:56.884544670 5f58  d6065f90 c09f8050 00000000 c0050cb0 c09727d0 c0049380 ffffffff f2a00100
11-26 09:53:56.895229003 5f78  00000c07 00000002 00000001 d6064000 00000000 c004f40c c0a004a8 200f0093
11-26 09:53:56.905790004 5f98  00000001 00000000 d6064000 c09f7ea4 c0971a70 c06cb4b8 c097a2ac 412fc09a
11-26 09:53:56.916480004 5fb8  00000000 00000000 00000000 d6065fd8 c005f450 c0050528 400f0013 ffffffff
11-26 09:53:56.927039337 5fd8  c0050504 c0050850 2606806a 00000015 10c03c7d c09f8058 1000406a 106bcdd4
11-26 09:53:56.937707004 5ff8  213647a0 5031b069 00000000 00000001 00000000 d60440a0 c098f714 00000001
11-26 09:53:56.948385670 6018  00000015 d60440a0 c28a9320 00000000 d6066000 53f4b996 d6044560 d604433c
11-26 09:53:56.958932337 6038  d6067fac d6067ef8 c06c6038 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.969617670
11-26 09:53:56.969627670 R0: 0xc0a00428:
11-26 09:53:56.976053670 0428  00000000 00000000 00000000 00000000 00000000 00000000 c00bb2cc c28a0530
11-26 09:53:56.986607004 0448  00000000 ffffffff 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:56.997286670 0468  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:57.007959337 0488  00000000 00000000 00000000 00000000 00000000 00000000 d60090c0 00000001
11-26 09:53:57.018628337 04a8  00000000 00000000 c0991f18 00000000 056f8900 00008be4 00989680 00000000
11-26 09:53:57.029308337 04c8  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
11-26 09:53:57.039867003 04e8  c098e1c0 00000001 00000000 00000000 00000000 00000000 06a0b600 00008be4
11-26 09:53:57.050419337 0508  00000000 00000000 00000000 00000000 00000000 00000CONFIG_SYS_I2C_SPEED----------100000
oprate rtc chip--plpl--loop-----
pcf8563 i2c_write_3 RTC_REG_CON_STA2 5

Outcomes