T4240 Booting problems when CONFIG_HAS_FSL_QBMAN enabled

[ronbelaire]

On our own board, that boots fine normally, when I enable CONFIG_HAS_FSL_QBMAN, the board no longer boots.

The boot up looks like:

## Booting kernel from Legacy Image at 10000000 ...

   Image Name:   THORINsaos-thorin_080599_rbelair

   Created:      2015-09-25  21:33:04 UTC

   Image Type:   PowerPC Linux Multi-File Image (gzip compressed)

   Data Size:    36935129 Bytes = 35.2 MiB

   Load Address: 00000000

   Entry Point:  00000000

   Contents:

      Image 0: 5060750 Bytes = 4.8 MiB

      Image 1: 31778219 Bytes = 30.3 MiB

      Image 2: 96141 Bytes = 93.9 KiB

         Compatible with:

            ciena,ctm-20

            ciena,sw1_ctm-20

            ciena,sw1_ctx-hd*

   Verifying Checksum ... OK

## Loading init Ramdisk from multi component Legacy Image at 10000000 ...

## Flattened Device Tree from multi component Image at 10000000

   Booting using the fdt at 0x12321e8c size 0x1778d

   Uncompressing Multi-File Image ... OK

   Loading Ramdisk to 2e1b1000, end 2ffff5ab ... OK

   Loading Device Tree to 03fe5000, end 03fff78c ... OK

[    0.000000] ciena_machine_probe: matched ciena machine id 'ciena,ctm-20'

[    0.000000] Using ciena-cn54xx machine description

[    0.000000] MMU: Supported page sizes

[    0.000000]          4 KB as direct

[    0.000000]       4096 KB as direct

[    0.000000]      16384 KB as direct

[    0.000000]      65536 KB as direct

[    0.000000]     262144 KB as direct

[    0.000000]    1048576 KB as direct

[    0.000000] MMU: Book3E HW tablewalk not supported

[    0.000000] No /soc@ffe000000/qman@318000 property 'fsl,qman-fqd', using memblock_alloc(0000000000400000)

[    0.000000] No /soc@ffe000000/qman@318000 property 'fsl,qman-pfdr', using memblock_alloc(0000000002000000)

[    0.000000] Qman ver:0a01,03,01

[    0.000000] No /soc@ffe000000/bman@31a000 property 'fsl,bman-fbpr', using memblock_alloc(0000000001000000)

[    0.000000] Bman ver:0a02,02,01

[    0.000000] No USDPAA memory, no 'usdpaa_mem' bootarg

[    0.000000] bootconsole [udbg0] enabled

[    0.000000] CPU maps initialized for 1 thread per core

[    0.000000] Linux version 3.10.79-e6500 (rbelaire@onx-rbelaire-01) (gcc version 4.9.2 (GCC) ) #72 SMP Fri Sep 25 17:30:53 EDT 2015

CF000012

Setup Arch

ciena_machine_setup_arch:

[    0.000000] MMU: Allocated 2112 bytes of context maps for 255 contexts

CF000015

Setup Done

[    0.000000] PERCPU: Embedded 12 pages/cpu @c00000000e900000 s17728 r0 d31424 u65536

[    0.000000] Kernel command line: rw panic=10 console=ttyS1,9600

[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)

[    0.000000] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)

[    0.000000] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)

[    0.000000] Sorting __ex_table...

[    0.000000] Memory: 12218780k/12582912k available (12096k kernel code, 364132k reserved, 1356k data, 1430k bss, 560k init)

[    0.000000] Hierarchical RCU implementation.

[    0.000000]  RCU restricting CPUs from NR_CPUS=32 to nr_cpu_ids=12.

[    0.000000] NR_IRQS:512 nr_irqs:512 16

ciena_machine_irq_init:

ciena_machine_cn54xx_irq_init:

ciena_mpic_init:

ciena_mpic_init: ciena_mpic_init: /soc@ffe000000/pic@40000

ciena_mpic_init: ciena_mpic_init: flags 2

[    0.000000] mpic: Setting up MPIC "fsl-open-pic" version 1.2 at ffe040000, max 12 CPUs

[    0.000000] mpic: ISU size: 512, shift: 9, mask: 1ff

[    0.000000] mpic: Initializing for 512 sources

[    0.000000] clocksource: timebase mult[15cea9c8] shift[24] registered

[    0.000000] Console: colour dummy device 80x25

[    0.129937] pid_max: default: 32768 minimum: 301

[    0.185155] Mount-cache hash table entries: 256

[    0.251726] ftrace: allocating 21726 entries in 128 pages

[    0.341054] mpic: requesting IPIs...

[    0.393220] Brought up 12 CPUs

[    0.429388] devtmpfs: initialized

[    0.471294] NET: Registered protocol family 16

ciena_machine_arch_init:

ciena_machine_cn54xx_arch_init:

ciena_pci_arch_init:

[    0.611989] Found FSL PCI host bridge at 0x0000000ffe240000. Firmware bus number: 0->21

[    0.706925] PCI host bridge /pcie@ffe240000  ranges:

[    0.766284]  MEM 0x0000000c00000000..0x0000000c0fffffff -> 0x00000000e0000000

[    0.852746] /pcie@ffe240000: PCICSRBAR @ 0xff000007

[    0.911065] /pcie@ffe240000: Setup 64-bit PCI DMA window

[    0.974584] /pcie@ffe240000: WARNING: Outbound window cfg leaves gaps in memory map. Adjusting the memory map could reduce unnecessary bounce buffering.

[    1.138101] /pcie@ffe240000: DMA window size is 0xe0000000

[    1.203933] Found FSL PCI host bridge at 0x0000000ffe250000. Firmware bus number: 0->1

[    1.298500] PCI host bridge /pcie@ffe250000  ranges:

[    1.357865]  MEM 0x0000000c20000000..0x0000000c200fffff -> 0x00000000fff00000

[    1.444325] /pcie@ffe250000: PCICSRBAR @ 0xfe000007

[    1.502646] /pcie@ffe250000: Setup 64-bit PCI DMA window

[    1.566164] /pcie@ffe250000: DMA window size is 0xfe000007

[    1.631790] ciena_pci_fsl_pcie_create: failed to create platform device for node /pcie@ffe260000

[    1.736979] ciena_pci_fsl_pcie_create: failed to create platform device for node /pcie@ffe270000

ciena_machine_phy_fixups:

ciena_machine_cn54xx_ctx_phy_fixups:

[    1.939007] software IO TLB [mem 0x107fb000-0x147fb000] (64MB) mapped at [c0000000107fb000-c0000000147fafff]

[    2.055676] PCI: Probing PCI hardware

[    2.099422] PCI: I/O resource not set for host bridge /pcie@ffe240000 (domain 0)

[    2.188062] fsl-pci ffe240000.pcie: PCI host bridge to bus 0000:00

[    2.261900] pci_bus 0000:00: root bus resource [mem 0xc00000000-0xc0fffffff] (bus address [0xe0000000-0xefffffff])

[    2.385835] pci_bus 0000:00: root bus resource [bus 00-15]

[    2.451494] pci 0000:00:00.0: Set DMA mask to 0xdfffffff

[    2.515561] pci 0000:01:00.0: Set DMA mask to 0xdfffffff

[    2.579176] pci 0000:02:04.0: Set DMA mask to 0xdfffffff

[    2.642468] pci 0000:02:05.0: Set DMA mask to 0xdfffffff

[    2.705983] pci 0000:02:07.0: Set DMA mask to 0xdfffffff

[    2.769522] pci 0000:02:09.0: Set DMA mask to 0xdfffffff

[    2.833922] PCI: I/O resource not set for host bridge /pcie@ffe250000 (domain 1)

[    2.921539] fsl-pci ffe250000.pcie: PCI host bridge to bus 0001:00

[    2.995377] pci_bus 0001:00: root bus resource [mem 0xc20000000-0xc200fffff] (bus address [0xfff00000-0xffffffff])

[    3.119314] pci_bus 0001:00: root bus resource [bus 00-01]

[    3.184959] pci 0001:00:00.0: Set DMA mask to 0xfe000006

[    3.249009] pci 0001:01:00.0: Set DMA mask to 0xfe000006

[    3.312525] PCI: Cannot allocate resource region 0 of device 0001:01:00.0, will remap

[    3.405819] pci 0000:02:04.0: PCI bridge to [bus 03-08]

[    3.468228] pci 0000:02:04.0:   bridge window [mem 0xc04000000-0xc07ffffff]

[    3.551554] pci 0000:02:05.0: PCI bridge to [bus 09-0e]

[    3.614039] pci 0000:02:05.0:   bridge window [mem 0xc08000000-0xc0bffffff]

[    3.697366] pci 0000:02:07.0: PCI bridge to [bus 0f-14]

[    3.759851] pci 0000:02:07.0:   bridge window [mem 0xc0c000000-0xc0fffffff]

[    3.843178] pci 0000:02:09.0: PCI bridge to [bus 15]

[    3.902550] pci 0000:01:00.0: PCI bridge to [bus 02-15]

[    3.965030] pci 0000:01:00.0:   bridge window [mem 0xc04000000-0xc0fffffff]

[    4.048356] pci 0000:00:00.0: PCI bridge to [bus 01-15]

[    4.110840] pci 0000:00:00.0:   bridge window [mem 0xc00000000-0xc0fffffff]

[    4.194168] pci 0001:01:00.0: BAR 0: assigned [mem 0xc20000000-0xc2003ffff 64bit]

[    4.283748] pci 0001:00:00.0: PCI bridge to [bus 01]

[    4.343098] pci 0001:00:00.0:   bridge window [mem 0xc20000000-0xc200fffff]

[    4.426438] pci 0000:01:00.0: enabling device (0000 -> 0002)

[    4.494137] pci 0000:02:04.0: enabling device (0000 -> 0002)

[    4.561834] pci 0000:02:05.0: enabling device (0000 -> 0002)

[    4.629533] pci 0000:02:07.0: enabling device (0000 -> 0002)

[    4.711505] bio: create slab <bio-0> at 0

[    4.758890] Freescale Elo series DMA driver

[    4.808994] SCSI subsystem initialized

[    4.853985] usbcore: registered new interface driver usbfs

[    4.918878] usbcore: registered new interface driver hub

[    4.982438] usbcore: registered new device driver usb

[    5.043019] EDAC MC: Ver: 3.0.0

[    5.081122] Bman err interrupt handler present

[    5.133734] Can't get /bman-portals@ff4000000/bman-portal@0 property 'reg::CI'

[    5.219795] Can't get /bman-portals@ff4000000/bman-portal@4000 property 'reg::CI'

[    5.309365] Can't get /bman-portals@ff4000000/bman-portal@8000 property 'reg::CI'

[    5.398936] Can't get /bman-portals@ff4000000/bman-portal@c000 property 'reg::CI'

[    5.488505] Can't get /bman-portals@ff4000000/bman-portal@10000 property 'reg::CI'

[    5.579117] Can't get /bman-portals@ff4000000/bman-portal@14000 property 'reg::CI'

[    5.669729] Can't get /bman-portals@ff4000000/bman-portal@18000 property 'reg::CI'

[    5.760341] Can't get /bman-portals@ff4000000/bman-portal@1c000 property 'reg::CI'

[    5.850952] Can't get /bman-portals@ff4000000/bman-portal@20000 property 'reg::CI'

[    5.941565] Can't get /bman-portals@ff4000000/bman-portal@24000 property 'reg::CI'

[    6.032176] Can't get /bman-portals@ff4000000/bman-portal@28000 property 'reg::CI'

[    6.122789] Can't get /bman-portals@ff4000000/bman-portal@2c000 property 'reg::CI'

[    6.213400] Can't get /bman-portals@ff4000000/bman-portal@30000 property 'reg::CI'

[    6.304012] Can't get /bman-portals@ff4000000/bman-portal@34000 property 'reg::CI'

[    6.394624] Can't get /bman-portals@ff4000000/bman-portal@38000 property 'reg::CI'

[    6.485236] Can't get /bman-portals@ff4000000/bman-portal@3c000 property 'reg::CI'

[    6.575847] Can't get /bman-portals@ff4000000/bman-portal@40000 property 'reg::CI'

[    6.666460] Can't get /bman-portals@ff4000000/bman-portal@44000 property 'reg::CI'

[    6.757077] Can't get /bman-portals@ff4000000/bman-portal@48000 property 'reg::CI'

[    6.847683] Can't get /bman-portals@ff4000000/bman-portal@4c000 property 'reg::CI'

[    6.938295] Can't get /bman-portals@ff4000000/bman-portal@50000 property 'reg::CI'

[    7.028907] Can't get /bman-portals@ff4000000/bman-portal@54000 property 'reg::CI'

[    7.119518] Can't get /bman-portals@ff4000000/bman-portal@58000 property 'reg::CI'

[    7.210130] Can't get /bman-portals@ff4000000/bman-portal@5c000 property 'reg::CI'

[    7.300743] Can't get /bman-portals@ff4000000/bman-portal@60000 property 'reg::CI'

[    7.391354] Can't get /bman-portals@ff4000000/bman-portal@64000 property 'reg::CI'

[    7.481966] Can't get /bman-portals@ff4000000/bman-portal@68000 property 'reg::CI'

[    7.572578] Can't get /bman-portals@ff4000000/bman-portal@6c000 property 'reg::CI'

[    7.663190] Can't get /bman-portals@ff4000000/bman-portal@70000 property 'reg::CI'

[    7.753802] Can't get /bman-portals@ff4000000/bman-portal@74000 property 'reg::CI'

[    7.844414] Can't get /bman-portals@ff4000000/bman-portal@78000 property 'reg::CI'

[    7.935026] Can't get /bman-portals@ff4000000/bman-portal@7c000 property 'reg::CI'

[    8.025637] Can't get /bman-portals@ff4000000/bman-portal@80000 property 'reg::CI'

[    8.116249] Can't get /bman-portals@ff4000000/bman-portal@84000 property 'reg::CI'

[    8.206861] Can't get /bman-portals@ff4000000/bman-portal@88000 property 'reg::CI'

[    8.297473] Can't get /bman-portals@ff4000000/bman-portal@8c000 property 'reg::CI'

[    8.388084] Can't get /bman-portals@ff4000000/bman-portal@90000 property 'reg::CI'

[    8.478697] Can't get /bman-portals@ff4000000/bman-portal@94000 property 'reg::CI'

[    8.569308] Can't get /bman-portals@ff4000000/bman-portal@98000 property 'reg::CI'

[    8.659920] Can't get /bman-portals@ff4000000/bman-portal@9c000 property 'reg::CI'

[    8.750532] Can't get /bman-portals@ff4000000/bman-portal@a0000 property 'reg::CI'

[    8.841144] Can't get /bman-portals@ff4000000/bman-portal@a4000 property 'reg::CI'

[    8.931756] Can't get /bman-portals@ff4000000/bman-portal@a8000 property 'reg::CI'

[    9.022368] Can't get /bman-portals@ff4000000/bman-portal@ac000 property 'reg::CI'

[    9.112979] Can't get /bman-portals@ff4000000/bman-portal@b0000 property 'reg::CI'

[    9.203592] Can't get /bman-portals@ff4000000/bman-portal@b4000 property 'reg::CI'

[    9.294203] Can't get /bman-portals@ff4000000/bman-portal@b8000 property 'reg::CI'

[    9.384815] Can't get /bman-portals@ff4000000/bman-portal@bc000 property 'reg::CI'

[    9.475427] Can't get /bman-portals@ff4000000/bman-portal@c0000 property 'reg::CI'

[    9.566039] Can't get /bman-portals@ff4000000/bman-portal@c4000 property 'reg::CI'

[    9.656781] No BMan portals available!

[    9.701998] Qman err interrupt handler present

[    9.754751] QMan: Allocated lookup table at 8000000000000000, entry count 65537

[yipingwang]

Hello Ron Belaire,

It looks the problem is caused by dts file, do you use Linux Kernel and dtb from the same Linux SDK?

It seem that Kernel 3.10 is not from Freescale formal released Linux SDK, is it possible for you to provide all files related with T4240 dts?

Have a great day,
Yiping

-----------------------------------------------------------------------------------------------------------------------
Note: If this post answers your question, please click the Correct Answer button. Thank you!
-----------------------------------------------------------------------------------------------------------------------

[ronbelaire · Accepted solution]

Solved!

The device was correct but u-boot was limiting the bman ranges based on the LAW.  Increased the size value in u-boot and problem went away.