page allocation failure of imx6 linux kernel

[fangxu]

I use imx6 with yocto-1.7.1。But i find a problem on my 2 systems。who can help me?

one is

---------------------------------------

THDS: page allocation failure: order:0, mode:0x280020

CPU: 1 PID: 597 Comm: THDS Not tainted 3.10.17 #62

[<800147d4>] (unwind_backtrace+0x0/0xec) from [<800115a8>] (show_stack+0x10/0x14)

[<800115a8>] (show_stack+0x10/0x14) from [<8008f4a4>] (warn_alloc_failed+0xe4/0x11c)

[<8008f4a4>] (warn_alloc_failed+0xe4/0x11c) from [<80092414>] (__alloc_pages_nodemask+0x658/0x8b0)

[<80092414>] (__alloc_pages_nodemask+0x658/0x8b0) from [<800bc664>] (new_slab+0x1c8/0x220)

[<800bc664>] (new_slab+0x1c8/0x220) from [<800be2ec>] (__slab_alloc.isra.64.constprop.69+0x51c/0x5d8)

[<800be2ec>] (__slab_alloc.isra.64.constprop.69+0x51c/0x5d8) from [<800be5e0>] (kmem_cache_alloc+0xec/0x120)

[<800be5e0>] (kmem_cache_alloc+0xec/0x120) from [<80175e2c>] (__es_insert_extent+0xb0/0x248)

[<80175e2c>] (__es_insert_extent+0xb0/0x248) from [<8017673c>] (ext4_es_insert_extent+0xa0/0xac)

[<8017673c>] (ext4_es_insert_extent+0xa0/0xac) from [<80147ddc>] (ext4_da_get_block_prep+0x480/0x5b8)

[<80147ddc>] (ext4_da_get_block_prep+0x480/0x5b8) from [<800ec820>] (__block_write_begin+0x17c/0x3d0)

[<800ec820>] (__block_write_begin+0x17c/0x3d0) from [<8014c6b4>] (ext4_da_write_begin+0x9c/0x254)

[<8014c6b4>] (ext4_da_write_begin+0x9c/0x254) from [<8008afd8>] (generic_file_buffered_write+0xc4/0x284)

[<8008afd8>] (generic_file_buffered_write+0xc4/0x284) from [<8008c32c>] (__generic_file_aio_write+0x298/0x4c8)

[<8008c32c>] (__generic_file_aio_write+0x298/0x4c8) from [<8008c5b0>] (generic_file_aio_write+0x54/0xb8)

[<8008c5b0>] (generic_file_aio_write+0x54/0xb8) from [<801435ec>] (ext4_file_write+0xf0/0x500)

[<801435ec>] (ext4_file_write+0xf0/0x500) from [<800c257c>] (do_sync_readv_writev+0x74/0x9c)

[<800c257c>] (do_sync_readv_writev+0x74/0x9c) from [<800c34a0>] (do_readv_writev+0xbc/0x228)

[<800c34a0>] (do_readv_writev+0xbc/0x228) from [<800c36c8>] (vfs_writev+0x48/0x74)

[<800c36c8>] (vfs_writev+0x48/0x74) from [<800c37a8>] (SyS_writev+0x3c/0x78)

[<800c37a8>] (SyS_writev+0x3c/0x78) from [<8000e100>] (ret_fast_syscall+0x0/0x30)

Mem-info:

DMA per-cpu:

CPU    0: hi:  186, btch:  31 usd: 121

CPU    1: hi:  186, btch:  31 usd:  26

CPU    2: hi:  186, btch:  31 usd: 128

CPU    3: hi:  186, btch:  31 usd: 177

HighMem per-cpu:

CPU    0: hi:   90, btch:  15 usd:  81

CPU    1: hi:   90, btch:  15 usd:  69

CPU    2: hi:   90, btch:  15 usd:  25

CPU    3: hi:   90, btch:  15 usd:  87

active_anon:147463 inactive_anon:5352 isolated_anon:0

active_file:154148 inactive_file:147500 isolated_file:0

unevictable:0 dirty:2666 writeback:0 unstable:0

free:7894 slab_reclaimable:7020 slab_unreclaimable:2249

mapped:4469 shmem:26778 pagetables:686 bounce:0

free_cma:4102

DMA free:30748kB min:4844kB low:6052kB high:7264kB active_anon:344588kB inactive_anon:16740kB active_file:606440kB inactive_file:582772kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1826816kB managed:1466672kB mlocked:0kB dirty:10664kB writeback:0kB mapped:12120kB shmem:76028kB slab_reclaimable:28080kB slab_unreclaimable:8996kB kernel_stack:1120kB pagetables:2744kB unstable:0kB bounce:0kB free_cma:16408kB writeback_tmp:0kB pages_scanned:40 all_unreclaimable? no

lowmem_reserve[]: 0 0 264 264

HighMem free:828kB min:264kB low:484kB high:708kB active_anon:245264kB inactive_anon:4668kB active_file:10152kB inactive_file:7228kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:270336kB managed:270336kB mlocked:0kB dirty:0kB writeback:0kB mapped:5756kB shmem:31084kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:39 all_unreclaimable? no

lowmem_reserve[]: 0 0 0 0

DMA: 6301*4kB (UEMC) 671*8kB (UMC) 5*16kB (UM) 1*32kB (U) 1*64kB (U) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB 0*32768kB = 30748kB

HighMem: 119*4kB (UMR) 10*8kB (MR) 1*16kB (R) 2*32kB (R) 1*64kB (R) 1*128kB (R) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB 0*32768kB = 828kB

328477 total pagecache pages

0 pages in swap cache

Swap cache stats: add 0, delete 0, find 0/0

Free swap  = 0kB

Total swap = 0kB

SLUB: Unable to allocate memory on node -1 (gfp=0x20)

  cache: ext4_extent_status, object size: 32, buffer size: 32, default order: 0, min order: 0

  node 0: slabs: 0, objs: 0, free: 0

the other is

---------------------------------------

swapper/1: page allocation failure: order:0, mode:0x200020

CPU: 1 PID: 0 Comm: swapper/1 Tainted: G           O 3.10.17 #62

[<800147d4>] (unwind_backtrace+0x0/0xec) from [<800115a8>] (show_stack+0x10/0x14)

[<800115a8>] (show_stack+0x10/0x14) from [<8008f4a4>] (warn_alloc_failed+0xe4/0x11c)

[<8008f4a4>] (warn_alloc_failed+0xe4/0x11c) from [<80092414>] (__alloc_pages_nodemask+0x658/0x8b0)

[<80092414>] (__alloc_pages_nodemask+0x658/0x8b0) from [<800bc664>] (new_slab+0x1c8/0x220)

[<800bc664>] (new_slab+0x1c8/0x220) from [<800be2ec>] (__slab_alloc.isra.64.constprop.69+0x51c/0x5d8)

[<800be2ec>] (__slab_alloc.isra.64.constprop.69+0x51c/0x5d8) from [<800be5e0>] (kmem_cache_alloc+0xec/0x120)

[<800be5e0>] (kmem_cache_alloc+0xec/0x120) from [<80342120>] (scsi_pool_alloc_command+0x38/0x64)

[<80342120>] (scsi_pool_alloc_command+0x38/0x64) from [<80342a48>] (scsi_host_alloc_command+0x14/0x6c)

[<80342a48>] (scsi_host_alloc_command+0x14/0x6c) from [<80342aac>] (__scsi_get_command+0xc/0x90)

[<80342aac>] (__scsi_get_command+0xc/0x90) from [<80342b5c>] (scsi_get_command+0x2c/0x9c)

[<80342b5c>] (scsi_get_command+0x2c/0x9c) from [<803492d8>] (scsi_get_cmd_from_req+0x40/0x50)

[<803492d8>] (scsi_get_cmd_from_req+0x40/0x50) from [<80349b44>] (scsi_setup_fs_cmnd+0x3c/0x9c)

[<80349b44>] (scsi_setup_fs_cmnd+0x3c/0x9c) from [<803500cc>] (sd_prep_fn+0x28c/0xfb4)

[<803500cc>] (sd_prep_fn+0x28c/0xfb4) from [<8025984c>] (blk_peek_request+0x134/0x1f4)

[<8025984c>] (blk_peek_request+0x134/0x1f4) from [<80349ca8>] (scsi_request_fn+0x38/0x518)

[<80349ca8>] (scsi_request_fn+0x38/0x518) from [<80256d30>] (__blk_run_queue+0x34/0x44)

[<80256d30>] (__blk_run_queue+0x34/0x44) from [<80256e74>] (blk_run_queue+0x1c/0x2c)

[<80256e74>] (blk_run_queue+0x1c/0x2c) from [<80348e54>] (scsi_run_queue+0x10c/0x234)

[<80348e54>] (scsi_run_queue+0x10c/0x234) from [<8034a604>] (scsi_next_command+0x2c/0x38)

[<8034a604>] (scsi_next_command+0x2c/0x38) from [<8034a8ac>] (scsi_io_completion+0x254/0x634)

[<8034a8ac>] (scsi_io_completion+0x254/0x634) from [<8025dd90>] (blk_done_softirq+0x84/0x98)

[<8025dd90>] (blk_done_softirq+0x84/0x98) from [<8002dfc4>] (__do_softirq+0x110/0x1ec)

[<8002dfc4>] (__do_softirq+0x110/0x1ec) from [<8002e134>] (do_softirq+0x50/0x58)

[<8002e134>] (do_softirq+0x50/0x58) from [<8002e3d0>] (irq_exit+0x9c/0xd0)

[<8002e3d0>] (irq_exit+0x9c/0xd0) from [<80013998>] (handle_IPI+0xa0/0x118)

[<80013998>] (handle_IPI+0xa0/0x118) from [<80008558>] (gic_handle_irq+0x58/0x5c)

[<80008558>] (gic_handle_irq+0x58/0x5c) from [<8000dd00>] (__irq_svc+0x40/0x70)

Exception stack(0xd809bf50 to 0xd809bf98)

bf40:                                     d809bf98 3b9aca00 ecd6fee7 0007ade2

bf60: 80c98290 80c98290 81d66130 00000000 ecd6d53c 0007ade2 d809a000 00000000

bf80: 00000017 d809bf98 00000009 804822b8 000f0013 ffffffff

[<8000dd00>] (__irq_svc+0x40/0x70) from [<804822b8>] (cpuidle_enter_state+0x54/0xe4)

[<804822b8>] (cpuidle_enter_state+0x54/0xe4) from [<80482404>] (cpuidle_idle_call+0xbc/0x154)

[<80482404>] (cpuidle_idle_call+0xbc/0x154) from [<8000ecf0>] (arch_cpu_idle+0x10/0x54)

[<8000ecf0>] (arch_cpu_idle+0x10/0x54) from [<8005a9dc>] (cpu_startup_entry+0x100/0x14c)

[<8005a9dc>] (cpu_startup_entry+0x100/0x14c) from [<10656344>] (0x10656344)

Mem-info:

DMA per-cpu:

CPU    0: hi:  186, btch:  31 usd: 156

CPU    1: hi:  186, btch:  31 usd: 103

CPU    2: hi:  186, btch:  31 usd: 164

CPU    3: hi:  186, btch:  31 usd: 162

HighMem per-cpu:

CPU    0: hi:   90, btch:  15 usd:  73

CPU    1: hi:   90, btch:  15 usd:  88

CPU    2: hi:   90, btch:  15 usd:  74

CPU    3: hi:   90, btch:  15 usd:  73

active_anon:138786 inactive_anon:1810 isolated_anon:0

active_file:110544 inactive_file:207236 isolated_file:0

unevictable:0 dirty:25 writeback:8510 unstable:0

free:7078 slab_reclaimable:7918 slab_unreclaimable:2189

mapped:3212 shmem:14002 pagetables:659 bounce:0

free_cma:3285

DMA free:27572kB min:4844kB low:6052kB high:7264kB active_anon:319712kB inactive_anon:6212kB active_file:427072kB inactive_file:813708kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:1826816kB managed:1466672kB mlocked:0kB dirty:100kB writeback:34040kB mapped:6420kB shmem:46504kB slab_reclaimable:31672kB slab_unreclaimable:8756kB kernel_stack:1112kB pagetables:2636kB unstable:0kB bounce:0kB free_cma:13140kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

kernel:nthds_ad register success Major:245, Minor:0

lowmem_reserve[]: 0 0 264 264

HighMem free:740kB min:264kB low:484kB high:708kB active_anon:235432kB inactive_anon:1028kB active_file:15104kB inactive_file:15236kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:270336kB managed:270336kB mlocked:0kB dirty:0kB writeback:0kB mapped:6428kB shmem:9504kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no

lowmem_reserve[]: 0 0 0 0

DMA: 5079*4kB (UEMC) 536*8kB (UEMC) 166*16kB (UEMC) 10*32kB (EM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB 0*32768kB = 27580kB

HighMem: 80*4kB (UMR) 15*8kB (MR) 2*16kB (R) 1*32kB (R) 0*64kB 0*128kB 1*256kB (R) 0*512kB 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB 0*32768kB = 760kB

331782 total pagecache pages

0 pages in swap cache

Swap cache stats: add 0, delete 0, find 0/0

Free swap  = 0kB

Total swap = 0kB

SLUB: Unable to allocate memory on node -1 (gfp=0x20)

  cache: kmalloc-128, object size: 128, buffer size: 128, default order: 0, min order: 0

  node 0: slabs: 0, objs: 0, free: 0

[igorpadykov]

Hi fang

if errors appear only on small number of boards

it may be caused by ddr errors, one can try to run ddr

test on these boards and find new calibration coefficients

https://community.freescale.com/docs/DOC-105652

Best regards

igor

-----------------------------------------------------------------------------------------------------------------------

Note: If this post answers your question, please click the Correct Answer button. Thank you!

-----------------------------------------------------------------------------------------------------------------------

[fangxu]

I had test the ddr on the two boards。I think the problems are about with swap。