root@apalis-imx8-06980499:~# [18559.512466] rcu: INFO: rcu_preempt self-detected stall on CPU [18559.518233] rcu: 0-....: (1 GPs behind) idle=8b6/1/0x4000000000000002 softirq=1906571/1906572 fqs=2623 [18559.527723] (t=5253 jiffies g=5684629 q=3155) [18559.532165] Task dump for CPU 0: [18559.535388] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [18559.542442] Call trace: [18559.544895] dump_backtrace+0x0/0x168 [18559.548560] show_stack+0x14/0x20 [18559.551873] sched_show_task+0x110/0x138 [18559.555799] dump_cpu_task+0x40/0x4c [18559.559375] rcu_dump_cpu_stacks+0x94/0xd0 [18559.563471] rcu_sched_clock_irq+0x75c/0x9c8 [18559.567744] update_process_times+0x2c/0x68 [18559.571936] tick_sched_handle.isra.0+0x30/0x50 [18559.576464] tick_sched_timer+0x48/0x98 [18559.580294] __hrtimer_run_queues+0x110/0x1b0 [18559.584647] hrtimer_interrupt+0xe4/0x238 [18559.588657] arch_timer_handler_phys+0x30/0x40 [18559.593101] handle_percpu_devid_irq+0x80/0x140 [18559.597637] generic_handle_irq+0x24/0x38 [18559.601649] __handle_domain_irq+0x60/0xb8 [18559.605741] gic_handle_irq+0x5c/0x148 [18559.609487] el1_irq+0xb8/0x180 [18559.612635] __fget+0xbc/0x128 [18559.615687] __fget_light+0x78/0x98 [18559.619170] __fdget+0x10/0x18 [18559.622222] do_epoll_wait+0x68/0x110 [18559.625886] __arm64_sys_epoll_pwait+0x78/0xe8 [18559.630328] el0_svc_common.constprop.0+0x68/0x178 [18559.635122] el0_svc_handler+0x20/0x80 [18559.638866] el0_svc+0x8/0x600 [18622.526048] rcu: INFO: rcu_preempt self-detected stall on CPU [18622.531803] rcu: 0-....: (1 GPs behind) idle=8b6/1/0x4000000000000002 softirq=1906571/1906572 fqs=10484 [18622.541369] (t=21006 jiffies g=5684629 q=9464) [18622.545894] Task dump for CPU 0: [18622.549117] ModCliTCPStack- R running task 0 1266 1214 0x00000202 [18622.556171] Call trace: [18622.558614] dump_backtrace+0x0/0x168 [18622.562271] show_stack+0x14/0x20 [18622.565582] sched_show_task+0x110/0x138 [18622.569508] dump_cpu_task+0x40/0x4c [18622.573078] rcu_dump_cpu_stacks+0x94/0xd0 [18622.577171] rcu_sched_clock_irq+0x75c/0x9c8 [18622.581436] update_process_times+0x2c/0x68 [18622.585616] tick_sched_handle.isra.0+0x30/0x50 [18622.590142] tick_sched_timer+0x48/0x98 [18622.593972] __hrtimer_run_queues+0x110/0x1b0 [18622.598325] hrtimer_interrupt+0xe4/0x238 [18622.602338] arch_timer_handler_phys+0x30/0x40 [18622.606778] handle_percpu_devid_irq+0x80/0x140 [18622.611304] generic_handle_irq+0x24/0x38 [18622.615309] __handle_domain_irq+0x60/0xb8 [18622.619409] gic_handle_irq+0x5c/0x148 [18622.623153] el1_irq+0xb8/0x180 [18622.626290] arch_counter_get_cntpct+0x8/0x18 [18622.630642] ktime_get_ts64+0x48/0xe0 [18622.634299] ep_poll+0xf8/0x3c0 [18622.637435] do_epoll_wait+0xd0/0x110 [18622.641093] __arm64_sys_epoll_pwait+0x78/0xe8 [18622.645533] el0_svc_common.constprop.0+0x68/0x178 [18622.650320] el0_svc_handler+0x20/0x80 [18622.654063] el0_svc+0x8/0x600 [18685.539635] rcu: INFO: rcu_preempt self-detected stall on CPU [18685.545382] rcu: 0-....: (1 GPs behind) idle=8b6/1/0x4000000000000002 softirq=1906571/1906572 fqs=18343 [18685.554952] (t=36759 jiffies g=5684629 q=15862) [18685.559563] Task dump for CPU 0: [18685.562786] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [18685.569840] Call trace: [18685.572284] dump_backtrace+0x0/0x168 [18685.575940] show_stack+0x14/0x20 [18685.579251] sched_show_task+0x110/0x138 [18685.583168] dump_cpu_task+0x40/0x4c [18685.586739] rcu_dump_cpu_stacks+0x94/0xd0 [18685.590831] rcu_sched_clock_irq+0x75c/0x9c8 [18685.595097] update_process_times+0x2c/0x68 [18685.599276] tick_sched_handle.isra.0+0x30/0x50 [18685.603802] tick_sched_timer+0x48/0x98 [18685.607633] __hrtimer_run_queues+0x110/0x1b0 [18685.611985] hrtimer_interrupt+0xe4/0x238 [18685.615990] arch_timer_handler_phys+0x30/0x40 [18685.620430] handle_percpu_devid_irq+0x80/0x140 [18685.624956] generic_handle_irq+0x24/0x38 [18685.628961] __handle_domain_irq+0x60/0xb8 [18685.633052] gic_handle_irq+0x5c/0x148 [18685.636796] el0_irq_naked+0x4c/0x54 [18748.553221] rcu: INFO: rcu_preempt self-detected stall on CPU [18748.558975] rcu: 0-....: (1 GPs behind) idle=8b6/1/0x4000000000000002 softirq=1906571/1906572 fqs=26207 [18748.568543] (t=52512 jiffies g=5684629 q=22205) [18748.573155] Task dump for CPU 0: [18748.576377] ModCliTCPStack- R running task 0 1266 1214 0x00000202 [18748.583431] Call trace: [18748.585874] dump_backtrace+0x0/0x168 [18748.589531] show_stack+0x14/0x20 [18748.592842] sched_show_task+0x110/0x138 [18748.596760] dump_cpu_task+0x40/0x4c [18748.600330] rcu_dump_cpu_stacks+0x94/0xd0 [18748.604423] rcu_sched_clock_irq+0x75c/0x9c8 [18748.608688] update_process_times+0x2c/0x68 [18748.612867] tick_sched_handle.isra.0+0x30/0x50 [18748.617393] tick_sched_timer+0x48/0x98 [18748.621224] __hrtimer_run_queues+0x110/0x1b0 [18748.625576] hrtimer_interrupt+0xe4/0x238 [18748.629581] arch_timer_handler_phys+0x30/0x40 [18748.634021] handle_percpu_devid_irq+0x80/0x140 [18748.638547] generic_handle_irq+0x24/0x38 [18748.642552] __handle_domain_irq+0x60/0xb8 [18748.646643] gic_handle_irq+0x5c/0x148 [18748.650387] el1_irq+0xb8/0x180 [18748.653524] __fget+0x68/0x128 [18748.656573] __fget_light+0x78/0x98 [18748.660056] __fdget+0x10/0x18 [18748.663106] do_epoll_wait+0x68/0x110 [18748.666764] __arm64_sys_epoll_pwait+0x78/0xe8 [18748.671204] el0_svc_common.constprop.0+0x68/0x178 [18748.675990] el0_svc_handler+0x20/0x80 [18748.679734] el0_svc+0x8/0x600 [18811.566808] rcu: INFO: rcu_preempt self-detected stall on CPU [18811.572555] rcu: 0-....: (1 GPs behind) idle=8b6/1/0x4000000000000002 softirq=1906571/1906572 fqs=34067 [18811.582125] (t=68265 jiffies g=5684629 q=28547) [18811.586737] Task dump for CPU 0: [18811.589960] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [18811.597013] Call trace: [18811.599457] dump_backtrace+0x0/0x168 [18811.603114] show_stack+0x14/0x20 [18811.606425] sched_show_task+0x110/0x138 [18811.610342] dump_cpu_task+0x40/0x4c [18811.613912] rcu_dump_cpu_stacks+0x94/0xd0 [18811.618005] rcu_sched_clock_irq+0x75c/0x9c8 [18811.622270] update_process_times+0x2c/0x68 [18811.626450] tick_sched_handle.isra.0+0x30/0x50 [18811.630976] tick_sched_timer+0x48/0x98 [18811.634806] __hrtimer_run_queues+0x110/0x1b0 [18811.639168] hrtimer_interrupt+0xe4/0x238 [18811.643172] arch_timer_handler_phys+0x30/0x40 [18811.647612] handle_percpu_devid_irq+0x80/0x140 [18811.652138] generic_handle_irq+0x24/0x38 [18811.656143] __handle_domain_irq+0x60/0xb8 [18811.660234] gic_handle_irq+0x5c/0x148 [18811.663978] el1_irq+0xb8/0x180 [18811.667118] path_put+0x10/0x30 [18811.670262] __audit_syscall_exit+0xf8/0x228 [18811.674535] syscall_trace_exit+0x138/0x158 [18811.678714] el0_svc_common.constprop.0+0xa4/0x178 [18811.683509] el0_svc_handler+0x20/0x80 [18811.687252] el0_svc+0x8/0x600 [18846.163684] sched: RT throttling activated [18912.343002] rcu: INFO: rcu_preempt self-detected stall on CPU [18912.348774] rcu: 0-....: (5249 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=2622 [18912.358777] (t=5253 jiffies g=5695897 q=3834) [18912.363215] Task dump for CPU 0: [18912.366438] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [18912.373492] Call trace: [18912.375948] dump_backtrace+0x0/0x168 [18912.379609] show_stack+0x14/0x20 [18912.382922] sched_show_task+0x110/0x138 [18912.386848] dump_cpu_task+0x40/0x4c [18912.390425] rcu_dump_cpu_stacks+0x94/0xd0 [18912.394520] rcu_sched_clock_irq+0x75c/0x9c8 [18912.398793] update_process_times+0x2c/0x68 [18912.402982] tick_sched_handle.isra.0+0x30/0x50 [18912.407513] tick_sched_timer+0x48/0x98 [18912.411344] __hrtimer_run_queues+0x110/0x1b0 [18912.415697] hrtimer_interrupt+0xe4/0x238 [18912.419705] arch_timer_handler_phys+0x30/0x40 [18912.424151] handle_percpu_devid_irq+0x80/0x140 [18912.428687] generic_handle_irq+0x24/0x38 [18912.432698] __handle_domain_irq+0x60/0xb8 [18912.436791] gic_handle_irq+0x5c/0x148 [18912.440534] el1_irq+0xb8/0x180 [18912.443673] _raw_write_unlock_irq+0x10/0x48 [18912.447947] ep_poll+0x80/0x3c0 [18912.451089] do_epoll_wait+0xd0/0x110 [18912.454755] __arm64_sys_epoll_pwait+0x78/0xe8 [18912.459198] el0_svc_common.constprop.0+0x68/0x178 [18912.463991] el0_svc_handler+0x20/0x80 [18912.467735] el0_svc+0x8/0x600 [18975.358480] rcu: INFO: rcu_preempt self-detected stall on CPU [18975.364231] rcu: 0-....: (20972 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=10469 [18975.374408] (t=21006 jiffies g=5695897 q=15366) [18975.379020] Task dump for CPU 0: [18975.382243] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [18975.389297] Call trace: [18975.391740] dump_backtrace+0x0/0x168 [18975.395397] show_stack+0x14/0x20 [18975.398708] sched_show_task+0x110/0x138 [18975.402625] dump_cpu_task+0x40/0x4c [18975.406196] rcu_dump_cpu_stacks+0x94/0xd0 [18975.410288] rcu_sched_clock_irq+0x75c/0x9c8 [18975.414553] update_process_times+0x2c/0x68 [18975.418733] tick_sched_handle.isra.0+0x30/0x50 [18975.423259] tick_sched_timer+0x48/0x98 [18975.427089] __hrtimer_run_queues+0x110/0x1b0 [18975.431442] hrtimer_interrupt+0xe4/0x238 [18975.435447] arch_timer_handler_phys+0x30/0x40 [18975.439886] handle_percpu_devid_irq+0x80/0x140 [18975.444413] generic_handle_irq+0x24/0x38 [18975.448418] __handle_domain_irq+0x60/0xb8 [18975.452509] gic_handle_irq+0x5c/0x148 [18975.456253] el1_irq+0xb8/0x180 [18975.459390] do_epoll_wait+0x60/0x110 [18975.463047] __arm64_sys_epoll_pwait+0x78/0xe8 [18975.467487] el0_svc_common.constprop.0+0x68/0x178 [18975.472274] el0_svc_handler+0x20/0x80 [18975.476017] el0_svc+0x8/0x600 [19038.373922] rcu: INFO: rcu_preempt self-detected stall on CPU [19038.379672] rcu: 0-....: (36696 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=18317 [19038.389850] (t=36759 jiffies g=5695897 q=26989) [19038.394461] Task dump for CPU 0: [19038.397684] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [19038.404738] Call trace: [19038.407182] dump_backtrace+0x0/0x168 [19038.410839] show_stack+0x14/0x20 [19038.414149] sched_show_task+0x110/0x138 [19038.418067] dump_cpu_task+0x40/0x4c [19038.421637] rcu_dump_cpu_stacks+0x94/0xd0 [19038.425730] rcu_sched_clock_irq+0x75c/0x9c8 [19038.429995] update_process_times+0x2c/0x68 [19038.434174] tick_sched_handle.isra.0+0x30/0x50 [19038.438700] tick_sched_timer+0x48/0x98 [19038.442531] __hrtimer_run_queues+0x110/0x1b0 [19038.446884] hrtimer_interrupt+0xe4/0x238 [19038.450888] arch_timer_handler_phys+0x30/0x40 [19038.455328] handle_percpu_devid_irq+0x80/0x140 [19038.459854] generic_handle_irq+0x24/0x38 [19038.463859] __handle_domain_irq+0x60/0xb8 [19038.467950] gic_handle_irq+0x5c/0x148 [19038.471695] el0_irq_naked+0x4c/0x54 [19101.389362] rcu: INFO: rcu_preempt self-detected stall on CPU [19101.395114] rcu: 0-....: (52425 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=26166 [19101.405291] (t=52512 jiffies g=5695897 q=38476) [19101.409903] Task dump for CPU 0: [19101.413126] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [19101.420171] Call trace: [19101.422615] dump_backtrace+0x0/0x168 [19101.426271] show_stack+0x14/0x20 [19101.429582] sched_show_task+0x110/0x138 [19101.433500] dump_cpu_task+0x40/0x4c [19101.437070] rcu_dump_cpu_stacks+0x94/0xd0 [19101.441162] rcu_sched_clock_irq+0x75c/0x9c8 [19101.445428] update_process_times+0x2c/0x68 [19101.449607] tick_sched_handle.isra.0+0x30/0x50 [19101.454133] tick_sched_timer+0x48/0x98 [19101.457964] __hrtimer_run_queues+0x110/0x1b0 [19101.462316] hrtimer_interrupt+0xe4/0x238 [19101.466321] arch_timer_handler_phys+0x30/0x40 [19101.470761] handle_percpu_devid_irq+0x80/0x140 [19101.475287] generic_handle_irq+0x24/0x38 [19101.479292] __handle_domain_irq+0x60/0xb8 [19101.483383] gic_handle_irq+0x5c/0x148 [19101.487127] el0_irq_naked+0x4c/0x54 [19164.404801] rcu: INFO: rcu_preempt self-detected stall on CPU [19164.410555] rcu: 0-....: (68154 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=34019 [19164.420733] (t=68265 jiffies g=5695897 q=50010) [19164.425345] Task dump for CPU 0: [19164.428567] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [19164.435621] Call trace: [19164.438065] dump_backtrace+0x0/0x168 [19164.441722] show_stack+0x14/0x20 [19164.445032] sched_show_task+0x110/0x138 [19164.448950] dump_cpu_task+0x40/0x4c [19164.452520] rcu_dump_cpu_stacks+0x94/0xd0 [19164.456613] rcu_sched_clock_irq+0x75c/0x9c8 [19164.460878] update_process_times+0x2c/0x68 [19164.465057] tick_sched_handle.isra.0+0x30/0x50 [19164.469583] tick_sched_timer+0x48/0x98 [19164.473414] __hrtimer_run_queues+0x110/0x1b0 [19164.477766] hrtimer_interrupt+0xe4/0x238 [19164.481771] arch_timer_handler_phys+0x30/0x40 [19164.486211] handle_percpu_devid_irq+0x80/0x140 [19164.490737] generic_handle_irq+0x24/0x38 [19164.494742] __handle_domain_irq+0x60/0xb8 [19164.498833] gic_handle_irq+0x5c/0x148 [19164.502577] el1_irq+0xb8/0x180 [19164.505718] release_sock+0x10/0x88 [19164.509209] tcp_recvmsg+0x1d4/0x9a8 [19164.512788] inet_recvmsg+0x4c/0x118 [19164.516365] __sys_recvfrom+0xac/0x120 [19164.520109] __arm64_sys_recvfrom+0x20/0x30 [19164.524289] el0_svc_common.constprop.0+0x68/0x178 [19164.529075] el0_svc_handler+0x20/0x80 [19164.532819] el0_svc+0x8/0x600 [19227.420241] rcu: INFO: rcu_preempt self-detected stall on CPU [19227.425988] rcu: 0-....: (83876 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=41868 [19227.436166] (t=84018 jiffies g=5695897 q=61449) [19227.440777] Task dump for CPU 0: [19227.444000] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [19227.451054] Call trace: [19227.453498] dump_backtrace+0x0/0x168 [19227.457154] show_stack+0x14/0x20 [19227.460465] sched_show_task+0x110/0x138 [19227.464383] dump_cpu_task+0x40/0x4c [19227.467953] rcu_dump_cpu_stacks+0x94/0xd0 [19227.472046] rcu_sched_clock_irq+0x75c/0x9c8 [19227.476311] update_process_times+0x2c/0x68 [19227.480490] tick_sched_handle.isra.0+0x30/0x50 [19227.485016] tick_sched_timer+0x48/0x98 [19227.488847] __hrtimer_run_queues+0x110/0x1b0 [19227.493199] hrtimer_interrupt+0xe4/0x238 [19227.497204] arch_timer_handler_phys+0x30/0x40 [19227.501644] handle_percpu_devid_irq+0x80/0x140 [19227.506170] generic_handle_irq+0x24/0x38 [19227.510175] __handle_domain_irq+0x60/0xb8 [19227.514266] gic_handle_irq+0x5c/0x148 [19227.518010] el1_irq+0xb8/0x180 [19227.521147] _raw_write_unlock_irq+0x1c/0x48 [19227.525412] ep_poll+0x80/0x3c0 [19227.528548] do_epoll_wait+0xd0/0x110 [19227.532206] __arm64_sys_epoll_pwait+0x78/0xe8 [19227.536646] el0_svc_common.constprop.0+0x68/0x178 [19227.541433] el0_svc_handler+0x20/0x80 [19227.545176] el0_svc+0x8/0x600 [19290.435680] rcu: INFO: rcu_preempt self-detected stall on CPU [19290.441430] rcu: 0-....: (99598 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=49717 [19290.451607] (t=99771 jiffies g=5695897 q=72967) [19290.456219] Task dump for CPU 0: [19290.459441] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [19290.466495] Call trace: [19290.468939] dump_backtrace+0x0/0x168 [19290.472596] show_stack+0x14/0x20 [19290.475907] sched_show_task+0x110/0x138 [19290.479824] dump_cpu_task+0x40/0x4c [19290.483395] rcu_dump_cpu_stacks+0x94/0xd0 [19290.487487] rcu_sched_clock_irq+0x75c/0x9c8 [19290.491752] update_process_times+0x2c/0x68 [19290.495932] tick_sched_handle.isra.0+0x30/0x50 [19290.500458] tick_sched_timer+0x48/0x98 [19290.504288] __hrtimer_run_queues+0x110/0x1b0 [19290.508641] hrtimer_interrupt+0xe4/0x238 [19290.512646] arch_timer_handler_phys+0x30/0x40 [19290.517085] handle_percpu_devid_irq+0x80/0x140 [19290.521612] generic_handle_irq+0x24/0x38 [19290.525617] __handle_domain_irq+0x60/0xb8 [19290.529707] gic_handle_irq+0x5c/0x148 [19290.533452] el0_irq_naked+0x4c/0x54 [19353.451119] rcu: INFO: rcu_preempt self-detected stall on CPU [19353.456871] rcu: 0-....: (115327 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=57571 [19353.467135] (t=115525 jiffies g=5695897 q=84451) [19353.471834] Task dump for CPU 0: [19353.475057] ModCliTCPStack- R running task 0 1266 1214 0x00000200 [19353.482111] Call trace: [19353.484554] dump_backtrace+0x0/0x168 [19353.488211] show_stack+0x14/0x20 [19353.491522] sched_show_task+0x110/0x138 [19353.495439] dump_cpu_task+0x40/0x4c [19353.499010] rcu_dump_cpu_stacks+0x94/0xd0 [19353.503102] rcu_sched_clock_irq+0x75c/0x9c8 [19353.507368] update_process_times+0x2c/0x68 [19353.511547] tick_sched_handle.isra.0+0x30/0x50 [19353.516073] tick_sched_timer+0x48/0x98 [19353.519904] __hrtimer_run_queues+0x110/0x1b0 [19353.524256] hrtimer_interrupt+0xe4/0x238 [19353.528261] arch_timer_handler_phys+0x30/0x40 [19353.532700] handle_percpu_devid_irq+0x80/0x140 [19353.537227] generic_handle_irq+0x24/0x38 [19353.541232] __handle_domain_irq+0x60/0xb8 [19353.545323] gic_handle_irq+0x5c/0x148 [19353.549067] el1_irq+0xb8/0x180 [19353.552204] __rcu_read_lock+0x0/0x18 [19353.555863] __fget_light+0x78/0x98 [19353.559353] __fdget+0x10/0x18 [19353.562403] sockfd_lookup_light+0x18/0x88 [19353.566494] __sys_recvfrom+0x5c/0x120 [19353.570239] __arm64_sys_recvfrom+0x20/0x30 [19353.574418] el0_svc_common.constprop.0+0x68/0x178 [19353.579205] el0_svc_handler+0x20/0x80 [19353.582948] el0_svc+0x8/0x600 [19416.466560] rcu: INFO: rcu_preempt self-detected stall on CPU [19416.472312] rcu: 0-....: (131048 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=65421 [19416.482577] (t=131278 jiffies g=5695897 q=95908) [19416.487276] Task dump for CPU 0: [19416.490498] ModCliTCPStack- R running task 0 1266 1214 0x00000202 [19416.497552] Call trace: [19416.499996] dump_backtrace+0x0/0x168 [19416.503653] show_stack+0x14/0x20 [19416.506963] sched_show_task+0x110/0x138 [19416.510881] dump_cpu_task+0x40/0x4c [19416.514451] rcu_dump_cpu_stacks+0x94/0xd0 [19416.518544] rcu_sched_clock_irq+0x75c/0x9c8 [19416.522809] update_process_times+0x2c/0x68 [19416.526989] tick_sched_handle.isra.0+0x30/0x50 [19416.531514] tick_sched_timer+0x48/0x98 [19416.535345] __hrtimer_run_queues+0x110/0x1b0 [19416.539698] hrtimer_interrupt+0xe4/0x238 [19416.543702] arch_timer_handler_phys+0x30/0x40 [19416.548142] handle_percpu_devid_irq+0x80/0x140 [19416.552668] generic_handle_irq+0x24/0x38 [19416.556673] __handle_domain_irq+0x60/0xb8 [19416.560764] gic_handle_irq+0x5c/0x148 [19416.564508] el1_irq+0xb8/0x180 [19416.567645] ep_poll+0x124/0x3c0 [19416.570868] do_epoll_wait+0xd0/0x110 [19416.574526] __arm64_sys_epoll_pwait+0x78/0xe8 [19416.578966] el0_svc_common.constprop.0+0x68/0x178 [19416.583752] el0_svc_handler+0x20/0x80 [19416.587496] el0_svc+0x8/0x600 [19479.481999] rcu: INFO: rcu_preempt self-detected stall on CPU [19479.487755] rcu: 0-....: (146772 ticks this GP) idle=a72/1/0x4000000000000002 softirq=1914107/1914107 fqs=73269 [19479.498018] (t=147031 jiffies g=5695897 q=107451) [19479.502804] Task dump for CPU 0: [19479.506027] ModCliTCPStack- R running task 0 1266 1214 0x00000202 [19479.513081] Call trace: [19479.515524] dump_backtrace+0x0/0x168 [19479.519181] show_stack+0x14/0x20 [19479.522492] sched_show_task+0x110/0x138 [19479.526409] dump_cpu_task+0x40/0x4c [19479.529980] rcu_dump_cpu_stacks+0x94/0xd0 [19479.534072] rcu_sched_clock_irq+0x75c/0x9c8 [19479.538337] update_process_times+0x2c/0x68 [19479.542517] tick_sched_handle.isra.0+0x30/0x50 [19479.547043] tick_sched_timer+0x48/0x98 [19479.550873] __hrtimer_run_queues+0x110/0x1b0 [19479.555226] hrtimer_interrupt+0xe4/0x238 [19479.559231] arch_timer_handler_phys+0x30/0x40 [19479.563670] handle_percpu_devid_irq+0x80/0x140 [19479.568197] generic_handle_irq+0x24/0x38 [19479.572202] __handle_domain_irq+0x60/0xb8 [19479.576292] gic_handle_irq+0x5c/0x148 [19479.580037] el1_irq+0xb8/0x180 [19479.583173] __sys_recvfrom+0x58/0x120 [19479.586926] __arm64_sys_recvfrom+0x20/0x30 [19479.591106] el0_svc_common.constprop.0+0x68/0x178 [19479.595892] el0_svc_handler+0x20/0x80 [19479.599636] el0_svc+0x8/0x600 [20928.861216] ModCliTCPStack- R running task 0 1266 1214 0x00000202 [20928.868270] Call trace: [20928.870714] dump_backtrace+0x0/0x168 [20928.874370] show_stack+0x14/0x20 [20928.877681] sched_show_task+0x110/0x138 [20928.881598] dump_cpu_task+0x40/0x4c [20928.885169] rcu_dump_cpu_stacks+0x94/0xd0 [20928.889261] rcu_sched_clock_irq+0x75c/0x9c8 [20928.893527] update_process_times+0x2c/0x68 [20928.897706] tick_sched_handle.isra.0+0x30/0x50 [20928.902232] tick_sched_timer+0x48/0x98 [20928.906063] __hrtimer_run_queues+0x110/0x1b0 [20928.910415] hrtimer_interrupt+0xe4/0x238 [20928.914420] arch_timer_handler_phys+0x30/0x40 [20928.918859] handle_percpu_devid_irq+0x80/0x140 [20928.923386] generic_handle_irq+0x24/0x38 [20928.927391] __handle_domain_irq+0x60/0xb8 [20928.931482] gic_handle_irq+0x5c/0x148 [20928.935226] el1_irq+0xb8/0x180 [20928.938363] _raw_spin_lock_bh+0x0/0x68 [20928.942194] tcp_recvmsg+0x1d4/0x9a8 [20928.945764] inet_recvmsg+0x4c/0x118 [20928.949335] __sys_recvfrom+0xac/0x120 [20928.953079] __arm64_sys_recvfrom+0x20/0x30 [20928.957259] el0_svc_common.constprop.0+0x68/0x178 [20928.962045] el0_svc_handler+0x20/0x80 [20928.965789] el0_svc+0x8/0x600 [20947.358129] ------------[ cut here ]------------ [20947.362770] NETDEV WATCHDOG: eth0 (fec): transmit queue 0 timed out [20947.369128] WARNING: CPU: 5 PID: 0 at net/sched/sch_generic.c:479 dev_watchdog+0x31c/0x328 [20947.377388] Modules linked in: 8021q rfcomm btusb btrtl btintel btbcm usb_f_rndis u_ether bluetooth ecdh_generic ecc mwifiex_pcie crct10dif_ce snd_soc_imx_cdnhdmi mwifiex snd_soc_hdmi_codec cfg80211 rfkill ahci_imx tca8418_keypad flexcan can_dev mxc_jpeg_encdec cdns_mhdp_imx libcomposite configfs galcore(O) [20947.404619] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G O 5.4.193-5.7.1-devel+git.f78299297185 #1 [20947.414536] Hardware name: Toradex Apalis iMX8QM V1.1 on Apalis Evaluation Board (DT) [20947.422365] pstate: 40000005 (nZcv daif -PAN -UAO) [20947.427151] pc : dev_watchdog+0x31c/0x328 [20947.431156] lr : dev_watchdog+0x31c/0x328 [20947.435160] sp : ffff80001002bdb0 [20947.438470] x29: ffff80001002bdb0 x28: ffff0008793a2700 [20947.443778] x27: 0000000000000004 x26: 0000000000000140 [20947.449086] x25: 00000000ffffffff x24: 0000000000000005 [20947.454394] x23: ffff000878f8541c x22: ffff000878f85000 [20947.459702] x21: ffff000878f85438 x20: ffff8000117d6000 [20947.465010] x19: 0000000000000000 x18: 0000000000000010 [20947.470318] x17: 0000000000000000 x16: 0000000000000000 [20947.475626] x15: ffff0008780ce830 x14: ffffffffffffffff [20947.480934] x13: ffff80009002bb07 x12: ffff80001002bb0f [20947.486242] x11: ffff8000117f1000 x10: ffff800011913368 [20947.491550] x9 : 0000000000000000 x8 : ffff800011914000 [20947.496858] x7 : ffff8000106a0140 x6 : 0000000000000663 [20947.502166] x5 : 0000000000000000 x4 : ffff00087f7a6198 [20947.507474] x3 : ffff00087f7acf28 x2 : ffff00087f7a6198 [20947.512782] x1 : 3a556b1599067300 x0 : 0000000000000000 [20947.518091] Call trace: [20947.520536] dev_watchdog+0x31c/0x328 [20947.524192] call_timer_fn.isra.0+0x20/0x78 [20947.528369] run_timer_softirq+0x1a0/0x408 [20947.532461] __do_softirq+0x120/0x25c [20947.536120] irq_exit+0xb8/0xd8 [20947.539257] __handle_domain_irq+0x64/0xb8 [20947.543346] gic_handle_irq+0x5c/0x148 [20947.547090] el1_irq+0xb8/0x180 [20947.550228] arch_cpu_idle+0x10/0x18 [20947.553803] do_idle+0x200/0x280 [20947.557029] cpu_startup_entry+0x20/0x80 [20947.560949] secondary_start_kernel+0x16c/0x198 [20947.565473] ---[ end trace ec4c05f9b47a2828 ]--- [20947.570108] fec 5b050000.ethernet eth0: TX ring dump [20947.575075] Nr SC addr len SKB [20947.579431] 0 0x1400 0xfebce50a 54 0000000000000000 [20947.584920] 1 0x1c00 0xfeb83040 64 00000000c5de9b91 [20947.590412] 2 0x1c00 0xfeabd8f6 74 0000000004b04b62 [20947.595900] 3 0x1c00 0xfeadbcf6 74 00000000fbd91175 [20947.601381] 4 0x1c00 0xfea084f6 74 00000000cae60d03 [20947.606863] 5 0x1c00 0xfeb1d4f6 74 0000000079915922 [20947.612345] 6 0x1c00 0xfea4c4f6 74 0000000027e3908b [20947.617827] 7 0x1c00 0xfea054f6 74 00000000af9c9bf5 [20947.623308] 8 0x1c00 0xfebf5cf6 74 0000000029233106 [20947.628790] 9 0x1c00 0xfec07cf6 74 0000000074b796af [20947.634272] 10 0x1c00 0xfeb2ecf6 74 00000000e7702914 [20947.639754] 11 0x1c00 0xfea108f6 74 00000000a2b050de [20947.645236] 12 0x1c00 0xfea4b0f6 74 000000001a56daa7 [20947.650718] 13 0x1c00 0xfeb2c8f6 74 00000000f3957e80 [20947.656199] 14 0x1400 0xfebde10a 54 0000000000000000 [20947.661681] 15 0x1c00 0xfeb08080 1352 000000006e4786eb [20947.667163] 16 0x1c00 0xfea7bcf6 74 00000000bb208722 [20947.672645] 17 0x1c00 0xfea38cf6 74 000000007e255055 [20947.678126] 18 0x1c00 0xfeb31cf6 74 00000000d8710933 [20947.683608] 19 0x1c00 0xfebf08f6 74 000000005f42fb50 [20947.689092] 20 0x1c00 0xfea8f4f6 74 000000003ffcb709 [20947.694581] 21 0x1c00 0xfeb304f6 74 00000000bcef3e9c [20947.700063] 22 0x1c00 0xfeb02202 90 000000004ff05d9f [20947.705544] 23 0x1c00 0xfea800f6 74 00000000a4f2248c [20947.711026] 24 0x1c00 0xfea6a4f6 74 000000002dbe89d0 [20947.716508] 25 0x1c00 0xfea3e0f6 74 000000007ab9e597 [20947.721990] 26 0x1c00 0xfeb1bcf6 74 0000000059f44f4c [20947.727472] 27 0x1c00 0xfebfacf6 74 00000000a0e22b9f [20947.732953] 28 0x1c00 0xfeb930f6 74 00000000e4e8df27 [20947.738435] 29 0x1c00 0xfeba60f6 74 000000001a0c3526 [20947.743917] 30 0x1c00 0xfeabbcf6 74 00000000c7607802 [20947.749399] 31 0x1c00 0xfea978f6 74 000000007cb3203f [20947.754881] 32 0x1c00 0xfea014f6 74 0000000098a52432 [20947.760363] 33 0x1c00 0xfeb918f6 74 00000000f2ff21ea [20947.765844] 34 0x1c00 0xfea488f6 74 000000001d653ad7 [20947.771329] 35 0x1c00 0xfeb760f6 74 000000001fe7bcab [20947.776816] 36 0x1c00 0xfea8a4f6 74 000000003ec10c8d [20947.782298] 37 0x1c00 0xfea9f0f6 74 0000000037f63e23 [20947.787780] 38 0x1c00 0xfea8b8f6 74 000000008dc61a65 [20947.793262] 39 0x1c00 0xfebf2cf6 74 000000004c609b2a [20947.798744] 40 0x1c00 0xfea0ecf6 74 0000000092c31abb [20947.804226] 41 0x1c00 0xfeab88f6 74 00000000a107a796 [20947.809707] 42 0x1c00 0xfeb244f6 74 00000000dc1aa7bb [20947.815189] 43 0x1c00 0xfebe10f6 74 00000000f8152b09 [20947.820671] 44 0x1c00 0xfebf70f6 74 000000006fb6f009 [20947.826153] 45 0x1c00 0xfeb6e4f6 74 000000003c074ac6 [20947.831635] 46 0x1c00 0xfeab54f6 74 00000000b5d31b9b [20947.837117] 47 0x1c00 0xfebaacf6 74 00000000febe9c64 [20947.842598] 48 0x1c00 0xfebd3cf6 74 0000000083f2fb88 [20947.848083] 49 0x1c00 0xfebc3cf6 74 0000000076adc42c [20947.853571] 50 0x1c00 0xfebd44f6 74 00000000d1e59d6d [20947.859053] 51 0x1c00 0xfea3a0f6 74 000000000fc9a3c9 [20947.864534] 52 0x1c00 0xfea230f6 74 00000000dfd6ff1a [20947.870016] 53 0x1c00 0xfebb3cf6 74 00000000581e99f1 [20947.875499] 54 0x1c00 0xfebdf8f6 74 000000009ab2a094 [20947.880980] 55 0x1c00 0xfec09802 90 00000000ab6d5a83 [20947.886462] 56 0x1c00 0xfebb40f6 74 00000000f991ec15 [20947.891944] 57 0x1c00 0xfeadf4f6 74 00000000ef0339e5 [20947.897426] 58 0x1c00 0xfebb18f6 74 00000000cd3b6535 [20947.902907] 59 0x1c00 0xfeb700f6 74 00000000f730d3e3 [20947.908389] 60 0x1c00 0xfeb34cf6 74 0000000044739d78 [20947.913871] 61 0x1c00 0xfeaf58f6 74 000000000c67fc19 [20947.919352] 62 0x1c00 0xfeaa64f6 74 00000000f6a40ab3 [20947.924837] 63 0x1c00 0xfea648f6 74 00000000474f0425 [20947.930325] 64 0x1c00 0xfeb168f6 74 0000000051cec181 [20947.935807] 65 0x1c00 0xfeb720f6 74 0000000044daa873 [20947.941288] 66 0x1c00 0xfea9bcf6 74 00000000f50e0447 [20947.946770] 67 0x1c00 0xfea728f6 74 000000009046177b [20947.952252] 68 0x1c00 0xfeb040f6 74 0000000091724d4c [20947.957734] 69 0x1c00 0xfea934f6 74 000000006800bca6 [20947.963216] 70 0x1c00 0xfea0f0f6 74 00000000cee0cd88 [20947.968697] 71 0x1c00 0xfeb920f6 74 000000004d05bafa [20947.974179] 72 0x1c00 0xfeaa2cf6 74 00000000e08c8aeb [20947.979661] 73 0x1c00 0xfeb034f6 74 0000000067d4efe0 [20947.985143] 74 0x1c00 0xfea818f6 74 00000000143549d0 [20947.990625] 75 0x1c00 0xfeb794f6 74 00000000e7d4edde [20947.996106] 76 0x1c00 0xfea1b4f6 74 000000001b164492 [20948.001588] 77 0x1c00 0xfeaa40f6 74 0000000028b370c5 [20948.007070] 78 0x1c00 0xfec298f6 74 000000002eecdefd [20948.012552] 79 0x1c00 0xfebc5cf6 74 00000000cce1b3e1 [20948.018034] 80 0x1c00 0xfea7acf6 74 0000000099ec55b1 [20948.023516] 81 0x1c00 0xfea6c0f6 74 000000007df9a1c1 [20948.028997] 82 0x1c00 0xfeb1ecf6 74 000000007640f784 [20948.034479] 83 0x1c00 0xfebff8f6 74 00000000f3470525 [20948.039961] 84 0x1c00 0xfeb7f0f6 74 000000004f02006a [20948.045443] 85 0x1c00 0xfea7e4f6 74 000000002978e9f2 [20948.050925] 86 0x1c00 0xfea300f6 74 00000000fdc99517 [20948.056406] 87 0x1c00 0xfeb7b0f6 74 0000000044bd82f2 [20948.061889] 88 0x1c00 0xfeacdcf6 74 000000007833ad14 [20948.067370] 89 0x1c00 0xfeaac8f6 74 0000000027d5fb75 [20948.072853] 90 0x1c00 0xfea1f8f6 74 000000003c5e1fa6 [20948.078334] 91 0x1c00 0xfeb81cf6 74 00000000a90b7e4f [20948.083816] 92 0x1c00 0xfea1e4f6 74 000000001327ab06 [20948.089300] 93 0x1c00 0xfea318f6 74 000000006b25b7a4 [20948.094788] 94 0x1c00 0xfeb624f6 74 000000009dd0ee0d [20948.100270] 95 0x1c00 0xfeab64f6 74 00000000e0ebcac3 [20948.105752] 96 0x1c00 0xfea2d0f6 74 00000000df055cc0 [20948.111233] 97 0x1c00 0xfeb8ccf6 74 00000000da25a01c [20948.116715] 98 0x1c00 0xfea4ecf6 74 00000000ca0c0dc7 [20948.122197] 99 0x1c00 0xfeae38f6 74 000000004428017e [20948.127679] 100 0x1c00 0xfeb784f6 74 00000000f1d12499 [20948.133161] 101 0x1c00 0xfea1d4f6 74 0000000089a742ca [20948.138643] 102 0x1c00 0xfeab48f6 74 000000004232502b [20948.144124] 103 0x1c00 0xfea890f6 74 000000002a95fce6 [20948.149606] 104 0x1c00 0xfea114f6 74 000000007086973f [20948.155090] 105 0x1c00 0xfeb860f6 74 000000003c752129 [20948.160578] 106 0x1c00 0xfeb618f6 74 00000000815bc004 [20948.166060] 107 0x1c00 0xfea90cf6 74 000000009d695c8e [20948.171542] 108 0x1c00 0xfea5f0f6 74 00000000ee164cba [20948.177024] 109 0x1c00 0xfeb3e8f6 74 000000000769d910 [20948.182505] 110 0x1c00 0xfea184f6 74 00000000a152c87e [20948.187988] 111 0x1c00 0xfea244f6 74 0000000029150b49 [20948.193469] 112 0x1c00 0xfec280f6 74 000000008133fd77 [20948.198951] 113 0x1c00 0xfebf14f6 74 0000000076a13ff4 [20948.204434] 114 0x1c00 0xfea20cf6 74 000000000cf52750 [20948.209915] 115 0x1c00 0xfeaeb8f6 74 000000003bc901f7 [20948.215396] 116 0x1c00 0xfeb3b4f6 74 00000000b58d62f6 [20948.220878] 117 0x1c00 0xfea144f6 74 00000000da65cd93 [20948.226360] 118 0x1c00 0xfea598f6 74 000000009cb43514 [20948.231844] 119 0x1c00 0xfebf40f6 74 00000000b7b72c4c [20948.237333] 120 0x1c00 0xfea94202 90 00000000ec9cd25b [20948.242814] 121 0x1c00 0xfea454f6 74 00000000252f1bd7 [20948.248296] 122 0x1c00 0xfead90f6 74 00000000899fa1c1 [20948.253778] 123 0x1c00 0xfeab18f6 74 000000007afaa214 [20948.259260] 124 0x1c00 0xfeb8acf6 74 00000000a386d525 [20948.264741] 125 0x1c00 0xfeae90f6 74 0000000088e418bd [20948.270223] 126 0x1c00 0xfeb2d8f6 74 00000000b7e9f6f4 [20948.275705] 127 0x1c00 0xfeb094f6 74 0000000094ce71f1 [20948.281187] 128 0x1c00 0xfea17cf6 74 00000000cdefa6ae [20948.286669] 129 0x1c00 0xfeaaa0f6 74 00000000ff478bb6 [20948.292150] 130 0x1c00 0xfeb28cf6 74 00000000907f3b21 [20948.297632] 131 0x1c00 0xfeaee0f6 74 00000000138ade0b [20948.303114] 132 0x1c00 0xfeb17602 90 00000000c04e69a0 [20948.308596] 133 0x1c00 0xfea120f6 74 000000001ad2a971 [20948.314086] 134 0x1c00 0xfea264f6 74 00000000e2f8a458 [20948.319568] 135 0x1c00 0xfebdb4f6 74 0000000006e410ba [20948.325050] 136 0x1c00 0xfec058f6 74 00000000a32e9838 [20948.330532] 137 0x1c00 0xfea6dcf6 74 000000004051059f [20948.336014] 138 0x1c00 0xfeba84f6 74 000000004b8e1363 [20948.341496] 139 0x1c00 0xfea0d0f6 74 00000000d984a232 [20948.346977] 140 0x1c00 0xfea77cf6 74 00000000e6f9f9c4 [20948.352459] 141 0x1c00 0xfeb0acf6 74 00000000e725a7fb [20948.357941] 142 0x1c00 0xfeaed0f6 74 00000000f9ad0d9e [20948.363423] 143 0x1c00 0xfea47e02 90 00000000b78c4694 [20948.368905] 144 0x1c00 0xfebc98f6 74 00000000866a7bd6 [20948.374386] 145 0x1c00 0xfebbacf6 74 0000000093f321f0 [20948.379868] 146 0x1c00 0xfea9acf6 74 000000002931d694 [20948.385350] 147 0x1c00 0xfeab38f6 74 00000000d40f3b0e [20948.390832] 148 0x1c00 0xfeb208f6 74 00000000fb9571b5 [20948.396314] 149 0x1c00 0xfeac80f6 74 000000001f3c6357 [20948.401795] 150 0x1c00 0xfea320f6 74 000000009b75fe30 [20948.407277] 151 0x1c00 0xfebb04f6 74 000000002f77d234 [20948.412759] 152 0x1c00 0xfea8e8f6 74 000000004fbe8000 [20948.418241] 153 0x1c00 0xfeb378f6 74 0000000041b9d6fa [20948.423723] 154 0x1c00 0xfeba0a02 90 0000000040320cec [20948.429213] 155 0x1c00 0xfebdccf6 74 00000000823537bf [20948.434695] 156 0x1c00 0xfeaa84f6 74 00000000862d5e60 [20948.440177] 157 0x1c00 0xfea4f8f6 74 00000000f8b77723 [20948.445670] 158 0x1c00 0xfeaa1cf6 74 0000000070f15102 [20948.451158] 159 0x1c00 0xfebb5cf6 74 000000006a0745da [20948.456642] 160 0x1c00 0xfeb120f6 74 0000000080dc5346 [20948.462130] 161 0x1c00 0xfec034f6 74 0000000056ddf3d1 [20948.467612] 162 0x1c00 0xfea75cf6 74 00000000fe84fa05 [20948.473094] 163 0x1c00 0xfeb154f6 74 0000000069123d6b [20948.478576] 164 0x1c00 0xfea628f6 74 00000000d0b9c2f1 [20948.484057] 165 0x1c00 0xfebbd0f6 74 000000002defa049 [20948.489539] 166 0x1c00 0xfea210f6 74 00000000739d97d2 [20948.495021] 167 0x1c00 0xfeb250f6 74 000000004f728d87 [20948.500503] 168 0x1c00 0xfead24f6 74 00000000632d1a26 [20948.505985] 169 0x1c00 0xfeb388f6 74 0000000008035896 [20948.511466] 170 0x1c00 0xfea358f6 74 0000000023b85c84 [20948.516949] 171 0x1c00 0xfeb2acf6 74 00000000ff2afb70 [20948.522430] 172 0x1c00 0xfeae8cf6 74 000000003d569300 [20948.527912] 173 0x1c00 0xfea508f6 74 000000006cd63cbc [20948.533394] 174 0x1c00 0xfeb104f6 74 0000000095e9bc78 [20948.538876] 175 0x1c00 0xfebe8cf6 74 00000000eabc23fc [20948.544357] 176 0x1c00 0xfea9d0f6 74 000000003a226131 [20948.549839] 177 0x1c00 0xfeaf84f6 74 0000000015c748c6 [20948.555324] 178 0x1c00 0xfebb8cf6 74 00000000e6aa1203 [20948.560811] 179 0x1c00 0xfeba44f6 74 000000005e01e428 [20948.566293] 180 0x1c00 0xfeb364f6 74 00000000366ac8f0 [20948.571775] 181 0x1c00 0xfea830f6 74 0000000098e1d7d1 [20948.577257] 182 0x1c00 0xfea290f6 74 0000000026691b02 [20948.582746] 183 0x1c00 0xfeaf40f6 74 000000003eee17fc [20948.588229] 184 0x1c00 0xfeb184f6 74 0000000092772434 [20948.593711] 185 0x1c00 0xfeadc8f6 74 0000000027836438 [20948.599193] 186 0x1c00 0xfea918f6 74 00000000132288bd [20948.604675] 187 0x1c00 0xfead5cf6 74 000000002c432735 [20948.610159] 188 0x1c00 0xfeb23cf6 74 00000000b7fdf300 [20948.615647] 189 0x1c00 0xfea258f6 74 00000000a329ecd1 [20948.621129] 190 0x1c00 0xfeb674f6 74 0000000091e6aeb9 [20948.626611] 191 0x1c00 0xfeb66cf6 74 00000000ecbd70e5 [20948.632092] 192 0x1c00 0xfea84802 90 000000000cab9b46 [20948.637574] 193 0x1c00 0xfea78402 90 00000000af45633d [20948.643056] 194 0x1c00 0xfeb6b602 90 00000000ddfa2cc2 [20948.648538] 195 0x1c00 0xfeaea202 90 0000000016e065ef [20948.654020] 196 0x1c00 0xfebc8e02 90 000000009b899744 [20948.659501] 197 0x1c00 0xfeb21002 90 000000005d6e4f69 [20948.664983] 198 0x1c00 0xfebcac02 90 00000000ca4d9dd4 [20948.670465] 199 0x1c00 0xfebd5a02 90 0000000038579a41 [20948.675947] 200 0x1c00 0xfeb75602 90 00000000c576117f [20948.681429] 201 0x1c00 0xfeb39802 90 000000003babb178 [20948.686911] 202 0x1c00 0xfea68402 90 00000000cf1cf88e [20948.692392] 203 0x1c00 0xfeb2b202 90 00000000bfe625d2 [20948.697874] 204 0x1c00 0xfeb27002 90 00000000d6b08018 [20948.703356] 205 0x1c00 0xfead7a02 90 00000000c29b676f [20948.708838] 206 0x1c00 0xfeb43c02 90 0000000096105067 [20948.714319] 207 0x1c00 0xfea37a02 90 000000002f5abeaa [20948.719802] 208 0x1c00 0xfeaec602 90 000000001ac098d2 [20948.725283] 209 0x1c00 0xfeb3a402 90 000000004bfa4471 [20948.730765] 210 0x1c00 0xfea06202 90 0000000049114b32 [20948.736247] 211 0x1c00 0xfebd8002 90 000000003dc8dbcc [20948.741729] 212 0x1c00 0xfeb71802 90 00000000185a4337 [20948.747210] 213 0x1c00 0xfea7dc02 90 000000002da04864 [20948.752692] 214 0x1c00 0xfeb69a02 90 000000008b9934ef [20948.758174] 215 0x1c00 0xfebfee02 90 00000000b72392f0 [20948.763656] 216 0x1c00 0xfeaa5602 90 00000000ba25d857 [20948.769138] 217 0x1c00 0xfea36802 90 000000002fc60a76 [20948.774622] 218 0x1c00 0xfeb3c402 90 0000000027403826 [20948.780114] 219 0x1c00 0xfea16202 90 000000002983f669 [20948.785601] 220 0x1c00 0xfea00002 90 0000000072f13da3 [20948.791085] 221 0x1c00 0xfea5ac02 90 000000009542cefb [20948.796573] 222 0x1c00 0xfea9ca02 90 00000000405d995d [20948.802055] 223 0x1c00 0xfeba9402 90 000000005ad05fac [20948.807536] 224 0x1c00 0xfea6b0f6 74 00000000ff61ef2d [20948.813018] 225 0x1c00 0xfead6002 90 00000000bcf4726d [20948.818500] 226 0x1c00 0xfead1802 90 0000000011267cce [20948.823982] 227 0x1c00 0xfea28602 90 000000009c1f0fe9 [20948.829464] 228 0x1c00 0xfea13a02 90 0000000060c4164b [20948.834946] 229 0x1c00 0xfebd2c02 90 00000000d054b2e6 [20948.840427] 230 0x1c00 0xfeac4e02 90 0000000090b35d6a [20948.845910] 231 0x1c00 0xfebab202 90 0000000031272946 [20948.851391] 232 0x1c00 0xfebad002 90 00000000ac256a8a [20948.856873] 233 0x1c00 0xfea4a602 90 000000007b779045 [20948.862354] 234 0x1c00 0xfeb6d402 90 0000000072591632 [20948.867836] 235 0x1c00 0xfeb77a02 90 000000003a070644 [20948.873318] 236 0x1c00 0xfea70c02 90 00000000d654b6f1 [20948.878800] 237 0x1c00 0xfeb22e02 90 0000000014b4392c [20948.884282] 238 0x1c00 0xfea2e802 90 000000003f08a8da [20948.889764] 239 0x1c00 0xfea92a02 90 00000000840bda01 [20948.895245] 240 0x1c00 0xfea3f202 90 0000000086ddd36a [20948.900727] 241 0x1c00 0xfeb6f402 90 000000009b8dc276 [20948.906209] 242 0x1c00 0xfe9fd602 90 00000000632c43c3 [20948.911691] 243 0x1c00 0xfe9fc802 90 00000000a2c495b1 [20948.917173] 244 0x1c00 0xfe9fb202 90 00000000c4b0f67b [20948.922654] 245 0x1c00 0xfe9fac02 90 0000000079811f2d [20948.928136] 246 0x1c00 0xfe9f9a02 90 000000000ba2982f [20948.933618] 247 0x1c00 0xfe9f8002 90 00000000dc034dc4 [20948.939100] 248 0x1c00 0xfe9f7e02 90 000000008a0f890a [20948.944582] 249 0x1c00 0xfe9f6202 90 00000000ac7feff4 [20948.950063] 250 0x1c00 0xfe9f5602 90 0000000032bc334a [20948.955545] 251 0x1c00 0xfe9f4002 90 0000000064452118 [20948.961027] 252 0x1c00 0xfe9f3a02 90 000000004224b33e [20948.966509] 253 0x1c00 0xfe9f2802 75 000000007c4d5ca5 [20948.971991] 254 0x1c00 0xfe9f1c02 75 000000009da8d823 [20948.977473] 255 0x1c00 0xfe9f0e02 75 000000004c9ddf75 [20948.982954] 256 0x1c00 0xfe9efe02 75 0000000003c91c9d [20948.988436] 257 0x1c00 0xfe9ee002 75 00000000ef1ebdab [20948.993918] 258 0x1c00 0xfe9ed202 75 00000000b36c808c [20948.999400] 259 0x1c00 0xfe9ec802 75 000000005a88dee4 [20949.004882] 260 0x1c00 0xfe9eb602 75 00000000850f4645 [20949.010363] 261 0x1c00 0xfe9ea402 75 0000000004b013fc [20949.015845] 262 0x1c00 0xfe9e9e02 75 00000000e9bf54b8 [20949.021327] 263 0x1c00 0xfe9e8a02 75 0000000095107bd9 [20949.026809] 264 0x1c00 0xfe9e7c02 75 00000000c785406b [20949.032291] 265 0x1c00 0xfe9e6602 75 0000000078a9aef9 [20949.037773] 266 0x1c00 0xfe9e5802 75 00000000e917579c [20949.043255] 267 0x1c00 0xfe9e4a02 75 00000000dbc86ac1 [20949.048736] 268 0x1c00 0xfe9e3402 75 0000000042d410cf [20949.054218] 269 0x1c00 0xfe9e2c02 75 00000000089e7a64 [20949.059700] 270 0x1c00 0xfe9e1e02 75 000000008db33ead [20949.065181] 271 0x1c00 0xfe9e0002 75 0000000025b1bd08 [20949.070663] 272 0x1c00 0xfe9df202 75 00000000315573c1 [20949.076145] 273 0x1c00 0xfe9de402 75 0000000063cded76 [20949.081627] 274 0x1c00 0xfe9dd802 75 00000000f483911d [20949.087109] 275 0x1c00 0xfe9dc602 75 0000000011941607 [20949.092593] 276 0x1c00 0xfe9dbc02 75 00000000ecc98500 [20949.098081] 277 0x1c00 0xfe9da202 75 00000000c94acdb0 [20949.103563] 278 0x1c00 0xfe9d9e02 75 00000000f998b355 [20949.109045] 279 0x1c00 0xfe9d8402 75 00000000c0b3cb61 [20949.114527] 280 0x1c00 0xfe9d7802 75 0000000002914f9f [20949.120009] 281 0x1c00 0xfe9d6602 75 000000005cbd79f6 [20949.125490] 282 0x1c00 0xfe9d5a02 75 0000000022f5d48f [20949.130972] 283 0x1c00 0xfe9d4c02 75 00000000ac50a762 [20949.136454] 284 0x1c00 0xfe9d3e02 75 00000000fc605168 [20949.141936] 285 0x1c00 0xfe9d2202 75 000000002c2898ee [20949.147418] 286 0x1c00 0xfe9d1402 75 00000000eda2ce62 [20949.152900] 287 0x1c00 0xfe9d0402 75 00000000a38e577e [20949.158381] 288 0x1c00 0xfe9cf002 75 00000000af3cd22d [20949.163863] 289 0x1c00 0xfe9ce602 75 00000000d86562d2 [20949.169345] 290 S 0x1400 0x00000000 54 0000000000000000 [20949.174827] 291 0x1c00 0x00000000 64 0000000000000000 [20949.180309] 292 0x1400 0x00000000 54 0000000000000000 [20949.185790] 293 0x1c00 0x00000000 64 0000000000000000 [20949.191272] 294 0x1c00 0x00000000 74 0000000000000000 [20949.196754] 295 0x1400 0x00000000 54 0000000000000000 [20949.202235] 296 0x1c00 0x00000000 64 0000000000000000 [20949.207717] 297 0x1400 0x00000000 54 0000000000000000 [20949.213199] 298 0x1c00 0x00000000 64 0000000000000000 [20949.218681] 299 0x1c00 0x00000000 74 0000000000000000 [20949.224163] 300 0x1400 0x00000000 54 0000000000000000 [20949.229645] 301 0x1c00 0x00000000 64 0000000000000000 [20949.235126] 302 0x1400 0x00000000 54 0000000000000000 [20949.240608] 303 0x1c00 0x00000000 64 0000000000000000 [20949.246090] 304 0x1c00 0x00000000 74 0000000000000000 [20949.251572] 305 0x1400 0x00000000 54 0000000000000000 [20949.257054] 306 0x1c00 0x00000000 64 0000000000000000 [20949.262536] 307 0x1400 0x00000000 54 0000000000000000 [20949.268017] 308 0x1c00 0x00000000 64 0000000000000000 [20949.273499] 309 0x1c00 0x00000000 74 0000000000000000 [20949.278981] 310 0x1400 0x00000000 54 0000000000000000 [20949.284463] 311 0x1c00 0x00000000 64 0000000000000000 [20949.289945] 312 0x1400 0x00000000 54 0000000000000000 [20949.295427] 313 0x1c00 0x00000000 64 0000000000000000 [20949.300908] 314 0x1c00 0x00000000 74 0000000000000000 [20949.306390] 315 0x1400 0x00000000 54 0000000000000000 [20949.311872] 316 0x1c00 0x00000000 64 0000000000000000 [20949.317354] 317 0x1400 0x00000000 54 0000000000000000 [20949.322836] 318 0x1c00 0x00000000 64 0000000000000000 [20949.328317] 319 0x1c00 0x00000000 74 0000000000000000 [20949.333799] 320 0x1400 0x00000000 54 0000000000000000 [20949.339281] 321 0x1c00 0x00000000 64 0000000000000000 [20949.344763] 322 0x1400 0x00000000 54 0000000000000000 [20949.350245] 323 0x1c00 0x00000000 64 0000000000000000 [20949.355726] 324 0x1c00 0x00000000 74 0000000000000000 [20949.361208] 325 0x1400 0x00000000 54 0000000000000000 [20949.366690] 326 0x1c00 0x00000000 64 0000000000000000 [20949.372172] 327 0x1400 0x00000000 54 0000000000000000 [20949.377654] 328 0x1c00 0x00000000 64 0000000000000000 [20949.383135] 329 0x1c00 0x00000000 74 0000000000000000 [20949.388617] 330 0x1400 0x00000000 54 0000000000000000 [20949.394099] 331 0x1c00 0x00000000 64 0000000000000000 [20949.399581] 332 0x1400 0x00000000 54 0000000000000000 [20949.405063] 333 0x1c00 0x00000000 64 0000000000000000 [20949.410545] 334 0x1c00 0x00000000 74 0000000000000000 [20949.416026] 335 0x1400 0x00000000 54 0000000000000000 [20949.421508] 336 0x1c00 0x00000000 64 0000000000000000 [20949.426990] 337 0x1400 0x00000000 54 0000000000000000 [20949.432472] 338 0x1c00 0x00000000 64 0000000000000000 [20949.437953] 339 0x1c00 0x00000000 74 0000000000000000 [20949.443438] 340 0x1400 0x00000000 54 0000000000000000 [20949.448926] 341 0x1c00 0x00000000 64 0000000000000000 [20949.454408] 342 0x1400 0x00000000 54 0000000000000000 [20949.459889] 343 0x1c00 0x00000000 64 0000000000000000 [20949.465371] 344 0x1c00 0x00000000 74 0000000000000000 [20949.470853] 345 0x1400 0000000000000000 [20949.629878] 374 0x1c00 0x00000000 74 0000000000000000 [20949.635360] 375 0x1400 0x00000000 54 0000000000000000 [20949.640841] 376 0x1c00 0x00000000 64 0000000000000000 [20949.646332] 377 0x1400 0x00000000 54 0000000000000000 [20949.651825] 378 0x1c00 0x00000000 64 0000000000000000 [20949.657313] 379 0x1c00 0x00000000 74 0000000000000000 [20949.662795] 380 0x1400 0x00000000 54 0000000000000000 [20949.668276] 381 0x1c00 0x00000000 64 0000000000000000 [20949.673758] 382 0x1400 0x00000000 54 0000000000000000 [20949.679240] 383 0x1c00 0x00000000 64 0000000000000000 [20949.684722] 384 0x1c00 0x00000000 74 0000000000000000 [20949.690204] 385 0x1400 0x00000000 54 0000000000000000 [20949.695686] 386 0x1c00 0x00000000 64 0000000000000000 [20949.701167] 387 0x1400 0x00000000 54 0000000000000000 [20949.706649] 388 0x1c00 0x00000000 64 0000000000000000 [20949.712131] 389 0x1c00 0x00000000 74 0000000000000000 [20949.717613] 390 0x1400 0x00000000 54 0000000000000000 [20949.723095] 391 0x1c00 0x00000000 64 0000000000000000 [20949.728577] 392 0x1400 0x00000000 54 0000000000000000 [20949.734059] 393 0x1c00 0x00000000 64 0000000000000000 [20949.739540] 394 0x1c00 0x00000000 74 0000000000000000 [20949.745024] 395 0x1400 0x00000000 54 0000000000000000 [20949.750512] 396 0x1c00 0x00000000 64 0000000000000000 [20949.755995] 397 0x1400 0x00000000 54 0000000000000000 [20949.761478] 398 0x1c00 0x00000000 64 0000000000000000 [20949.766966] 399 0x1c00 0x00000000 74 0000000000000000 [20949.772457] 400 0x1400 0x00000000 54 0000000000000000 [20949.777941] 401 0x1c00 0x00000000 64 0000000000000000 [20949.783429] 402 0x1400 0x00000000 54 0000000000000000 [20949.788911] 403 0x1c00 0x00000000 64 0000000000000000 [20949.794393] 404 0x1c00 0x00000000 74 0000000000000000 [20949.799875] 405 0x1400 0x00000000 54 0000000000000000 [20949.805357] 406 0x1c00 0x00000000 65674] 417 0x1400 0x00000000 54 0000000000000000 [20949.871156] 418 0x1c00 0x00000000 64 0000000000000000 [20949.876638] 419 0x1c00 0x00000000 74 0000000000000000 [20949.882121] 420 0x1400 0x00000000 54 0000000000000000 [20949.887610] 421 0x1c00 0x00000000 64 0000000000000000 [20949.893100] 422 0x1400 0x00000000 54 0000000000000000 [20949.898582] 423 0x1c00 0x00000000 64 0000000000000000 [20949.904064] 424 0x1c00 0x00000000 74 0000000000000000 [20949.909546] 425 0x1400 0x00000000 54 0000000000000000 [20949.915028] 426 0x1c00 0x00000000 64 0000000000000000 [20949.920509] 427 0x1400 0x00000000 54 0000000000000000 [20949.925991] 428 0x1c00 0x00000000 64 0000000000000000 [20949.931473] 429 0x1c00 0x00000000 74 0000000000000000 [20949.936955] 430 0x1400 0x00000000 54 0000000000000000 [20949.942439] 431 0x1c00 0x00000000 64 0000000000000000 [20949.947927] 432 0x1400 0x00000000 54 0000000000000000 [20949.953409] 433 0x1c00 0x00000000 64 0000000000000000 [20949.958891] 434 0x1c00 0x00000000 74 0000000000000000 [20949.964373] 435 0x1400 0x00000000 54 0000000000000000 [20949.969857] 436 0x1c00 0x00000000 64 0000000000000000 [20949.975345] 437 0x1400 0x00000000 54 0000000000000000 [20949.980827] 438 0x1c00 0x00000000 64 0000000000000000 [20949.986309] 439 0x1c00 0x00000000 74 0000000000000000 [20949.991791] 440 0x1400 0x00000000 54 0000000000000000 [20949.997273] 441 0x1c00 0x00000000 64 0000000000000000 [20950.002754] 442 0x1400 0x00000000 54 0000000000000000 [20950.008236] 443 0x1c00 0x00000000 64 0000000000000000 [20950.013718] 444 0x1c00 0x00000000 74 0000000000000000 [20950.019200] 445 0x1400 0x00000000 54 0000000000000000 [20950.024682] 446 0x1c00 0x00000000 64 0000000000000000 [20950.030163] 447 0x1400 0x00000000 54 0000000000000000 [20950.035645] 448 0x1c00 0x00000000 64 0000000000000000 [20950.041127] 449 0x1c00 0x00000000 74 0000000000000000 [20950.046609] 450 0x1400 0x00000000 54 0000000000000000 [20950.052091] 451 0x1c00 0x00000000 64 0000000000000000 [20950.057572] 452 0x1400 0x00000000 54 0000000000000000 [20950.063054] 453 0x1c00 0x00000000 64 0000000000000000 [20950.068536] 454 0x1c00 0x00000000 74 0000000000000000 [20950.074018] 455 0x1400 0x00000000 54 0000000000000000 [20950.079499] 456 0x1c00 0x00000000 64 0000000000000000 [20950.084982] 457 0x1400 0x00000000 54 0000000000000000 [20950.090463] 458 0x1c00 0x00000000 64 0000000000000000 [20950.095945] 459 0x1c00 0x00000000 74 0000000000000000 [20950.101427] 460 0x1400 0x00000000 54 0000000000000000 [20950.106908] 461 0x1c00 0x00000000 64 0000000000000000 [20950.112391] 462 0x1400 0x00000000 54 0000000000000000 [20950.117872] 463 0x1c00 0x00000000 64 0000000000000000 [20950.123354] 464 0x1c00 0x00000000 74 0000000000000000 [20950.128836] 465 0x1400 0x00000000 54 0000000000000000 [20950.134318] 466 0x1c00 0x00000000 64 0000000000000000 [20950.139799] 467 0x1400 0x00000000 54 0000000000000000 [20950.145281] 468 0x1c00 0x00000000 64 0000000000000000 [20950.150764] 469 0x1c00 0x00000000 74 0000000000000000 [20950.156245] 470 0x1400 0x00000000 54 0000000000000000 [20950.161727] 471 0x1c00 0x00000000 64 0000000000000000 [20950.167209] 472 0x1400 0x00000000 54 0000000000000000 [20950.172690] 473 0x1c00 0x00000000 64 0000000000000000 [20950.178172] 474 0x1c00 0x00000000 74 0000000000000000 [20950.183655] 475 0x1400 0x00000000 54 0000000000000000 [20950.189136] 476 0x1c00 0x00000000 64 0000000000000000 [20950.194618] 477 0x1400 0x00000000 54 0000000000000000 [20950.200100] 478 0x1c00 0x00000000 64 0000000000000000 [20950.205582] 479 0x1c00 0x00000000 74 0000000000000000 [20950.211063] 480 0x1400 0x00000000 54 0000000000000000 [20950.216545] 481 0x1c00 0x00000000 64 0000000000000000 [20950.222027] 482 0x1400 0x00000000 54 0000000000000000 [20950.227508] 483 0x1c00 0x00000000 64 0000000000000000 [20950.232990] 484 0x1c00 0x00000000 74 0000000000000000 [20950.238472] 485 0x1400 0x00000000 54 0000000000000000 [20950.243954] 486 0x1c00 0x00000000 64 0000000000000000 [20950.249435] 487 0x1400 0x00000000 54 0000000000000000 [20950.254918] 488 0x1c00 0x00000000 64 0000000000000000 [20950.260399] 489 0x1c00 0x00000000 74 0000000000000000 [20950.265882] 490 0x1400 0x00000000 54 0000000000000000 [20950.271363] 491 0x1c00 0x00000000 64 0000000000000000 [20950.276845] 492 0x1400 0x00000000 54 0000000000000000 [20950.282327] 493 0x1c00 0x00000000 64 0000000000000000 [20950.287809] 494 0x1c00 0x00000000 74 0000000000000000 [20950.293290] 495 0x1400 0x00000000 54 0000000000000000 [20950.298772] 496 0x1c00 0x00000000 64 0000000000000000 [20950.304254] 497 0x1400 0x00000000 54 0000000000000000 [20950.309735] 498 0x1c00 0x00000000 64 0000000000000000 [20950.315218] 499 0x1c00 0x00000000 74 0000000000000000 [20950.320699] 500 0x1400 0x00000000 54 0000000000000000 [20950.326181] 501 0x1c00 0x00000000 64 0000000000000000 [20950.331663] 502 0x1400 0x00000000 54 0000000000000000 [20950.337147] 503 0x1c00 0x00000000 64 0000000000000000 [20950.342635] 504 0x1c00 0x00000000 74 0000000000000000 [20950.348117] 505 0x1400 0x00000000 54 0000000000000000 [20950.353599] 506 0x1c00 0x00000000 64 0000000000000000 [20950.359080] 507 0x1400 0x00000000 54 0000000000000000 [20950.364563] 508 0x1c00 0x00000000 64 0000000000000000 [20950.370044] 509 0x1c00 0x00000000 74 0000000000000000 [20950.375526] 510 0x1400 0x00000000 54 0000000000000000 [20950.381008] 511 0x3c00 0x00000000 64 0000000000000000 2. Second time tried this same case and issue reproduced logs- root@apalis-imx8-06980499:~# [27425.495116] rcu: INFO: rcu_preempt self-detected stall on CPU [27425.500874] rcu: 5-....: (1 GPs behind) idle=4e6/1/0x4000000000000002 softirq=1803268/1803269 fqs=2607 [27425.510355] (t=5254 jiffies g=7607473 q=3776) [27425.514793] Task dump for CPU 5: [27425.518016] ModCliTCPStack- R running task 0 1454 1393 0x00000200 [27425.525062] Call trace: [27425.527510] dump_backtrace+0x0/0x168 [27425.531169] show_stack+0x14/0x20 [27425.534483] sched_show_task+0x110/0x138 [27425.538408] dump_cpu_task+0x40/0x4c [27425.541976] rcu_dump_cpu_stacks+0x94/0xd0 [27425.546071] rcu_sched_clock_irq+0x75c/0x9c8 [27425.550334] update_process_times+0x2c/0x68 [27425.554515] tick_sched_handle.isra.0+0x30/0x50 [27425.559039] tick_sched_timer+0x48/0x98 [27425.562869] __hrtimer_run_queues+0x110/0x1b0 [27425.567222] hrtimer_interrupt+0xe4/0x238 [27425.571229] arch_timer_handler_phys+0x30/0x40 [27425.575667] handle_percpu_devid_irq+0x80/0x140 [27425.580193] generic_handle_irq+0x24/0x38 [27425.584197] __handle_domain_irq+0x60/0xb8 [27425.588289] gic_handle_irq+0x5c/0x148 [27425.592033] el1_irq+0xb8/0x180 [27425.595171] __arm64_sys_recvfrom+0xc/0x30 [27425.599263] el0_svc_common.constprop.0+0x68/0x178 [27425.604048] el0_svc_handler+0x20/0x80 [27425.607792] el0_svc+0x8/0x600