Macchiatobin Double Shot. PCIe devices not enumerated behind PCIe bridge

Hi everyone,

The enumeration of PCIe devices behind a PCIe bridge with the Macchiatobin Double Shot under U-Boot is not working. I tested it with the PEX 8606.

This is the result in the kernel log:

pci_bus 0000:03: busn_res: can not insert [bus 03-02] under [bus 02] (conflicts with (null) [bus 02])

Using the latest version of U-Boot (01/Dec/2020) downloaded from SolidRun Images (solid-run.com)

Booting the McBin with a PEX8606 bridge and a card inserted into it, but the card is not visible. The cards work if using them without a bridge.

The bridge itself is detected:
01:00.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
02:01.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
02:04.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
02:05.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
02:07.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
02:09.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)

I am trying to use it with OpenWRT. Alternatively, is there a working OpenWRT build for McBin under the UEFI boot? Thanks

edk2 / UEFI will not be able to work with the bridge. The way the PCI controller has to be setup to work with edk2 only allows it to expose a single device behind the bridge.

For u-boot and Linux can you please post the full dmesg output of a Linux boot with the controller installed as well as the lspci -vvv output?

Thanks for the answer.

Here is the boot output:

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd081]
[    0.000000] Linux version 5.10.161 (builder@buildhost) (aarch64-openwrt-linux-musl-gcc (OpenWrt GCC 11.2.0 r20028-43d71ad93e) 11.2.0, GNU ld (GNU Binutils) 2.37) #0 SMP Tue Jan 3 00:24:21 2023
[    0.000000] Machine model: Marvell 8040 MACCHIATOBin Double-shot
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000013fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000000003ffffff]
[    0.000000]   node   0: [mem 0x0000000004000000-0x00000000041fffff]
[    0.000000]   node   0: [mem 0x0000000004200000-0x00000000bfffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000013fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000013fffffff]
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.1
[    0.000000] percpu: Embedded 16 pages/cpu s28120 r8192 d29224 u65536
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: Spectre-v2
[    0.000000] CPU features: detected: Spectre-BHB
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1032192
[    0.000000] Kernel command line: root=/dev/mmcblk1p2 rw rootwait
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x00000000bc000000-0x00000000c0000000] (64MB)
[    0.000000] Memory: 4042964K/4194304K available (8126K kernel code, 912K rwdata, 1332K rodata, 448K init, 285K bss, 151340K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: Adjusting CPU interface base to 0x00000000f022f000
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] GICv2m: DT overriding V2M MSI_TYPER (base:160, num:32)
[    0.000000] GICv2m: range[mem 0xf0280000-0xf0280fff], SPI[160:191]
[    0.000000] GICv2m: DT overriding V2M MSI_TYPER (base:192, num:32)
[    0.000000] GICv2m: range[mem 0xf0290000-0xf0290fff], SPI[192:223]
[    0.000000] GICv2m: DT overriding V2M MSI_TYPER (base:224, num:32)
[    0.000000] GICv2m: range[mem 0xf02a0000-0xf02a0fff], SPI[224:255]
[    0.000000] GICv2m: DT overriding V2M MSI_TYPER (base:256, num:32)
[    0.000000] GICv2m: range[mem 0xf02b0000-0xf02b0fff], SPI[256:287]
[    0.000000] arch_timer: cp15 timer(s) running at 25.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x5c40939b5, max_idle_ns: 440795202646 ns
[    0.000003] sched_clock: 56 bits at 25MHz, resolution 40ns, wraps every 4398046511100ns
[    0.000118] Calibrating delay loop (skipped), value calculated using timer frequency.. 50.00 BogoMIPS (lpj=250000)
[    0.000126] pid_max: default: 32768 minimum: 301
[    0.000203] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.000223] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.000946] rcu: Hierarchical SRCU implementation.
[    0.001023] dyndbg: Ignore empty _ddebug table in a CONFIG_DYNAMIC_DEBUG_CORE build
[    0.001235] smp: Bringing up secondary CPUs ...
[    0.001582] Detected PIPT I-cache on CPU1
[    0.001621] CPU1: Booted secondary processor 0x0000000001 [0x410fd081]
[    0.001998] Detected PIPT I-cache on CPU2
[    0.002031] CPU2: Booted secondary processor 0x0000000100 [0x410fd081]
[    0.002416] Detected PIPT I-cache on CPU3
[    0.002438] CPU3: Booted secondary processor 0x0000000101 [0x410fd081]
[    0.002480] smp: Brought up 1 node, 4 CPUs
[    0.002494] SMP: Total of 4 processors activated.
[    0.002499] CPU features: detected: 32-bit EL0 Support
[    0.002504] CPU features: detected: CRC32 instructions
[    0.002540] CPU features: emulated: Privileged Access Never (PAN) using TTBR0_EL1 switching
[    0.002546] CPU: All CPU(s) started at EL2
[    0.002562] alternatives: patching kernel code
[    0.005245] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.005256] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.005317] pinctrl core: initialized pinctrl subsystem
[    0.006101] NET: Registered protocol family 16
[    0.006411] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations
[    0.006524] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.006634] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.006809] thermal_sys: Registered thermal governor 'step_wise'
[    0.007629] cpuidle: using governor ladder
[    0.007676] ASID allocator initialised with 65536 entries
[    0.021611] cryptd: max_cpu_qlen set to 1000
[    0.023052] SCSI subsystem initialized
[    0.023239] usbcore: registered new interface driver usbfs
[    0.023259] usbcore: registered new interface driver hub
[    0.023279] usbcore: registered new device driver usb
[    0.024154] clocksource: Switched to clocksource arch_sys_counter
[    0.024475] NET: Registered protocol family 2
[    0.024685] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.026024] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    0.026066] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.026227] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    0.026535] TCP: Hash tables configured (established 32768 bind 32768)
[    0.026607] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.026671] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.026812] NET: Registered protocol family 1
[    0.026831] PCI: CLS 0 bytes, default 64
[    0.028895] workingset: timestamp_bits=46 max_order=20 bucket_order=0
[    0.030711] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.030717] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.031244] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    0.033314] armada-ap806-pinctrl f06f4000.system-controller:pinctrl: registered pinctrl driver
[    0.033692] armada-cp110-pinctrl f2440000.system-controller:pinctrl: registered pinctrl driver
[    0.033935] armada-cp110-pinctrl f4440000.system-controller:pinctrl: registered pinctrl driver
[    0.037018] mv_xor_v2 f0400000.xor: Marvell Version 2 XOR driver
[    0.037369] mv_xor_v2 f0420000.xor: Marvell Version 2 XOR driver
[    0.037720] mv_xor_v2 f0440000.xor: Marvell Version 2 XOR driver
[    0.038064] mv_xor_v2 f0460000.xor: Marvell Version 2 XOR driver
[    0.038457] mv_xor_v2 f26a0000.xor: Marvell Version 2 XOR driver
[    0.038811] mv_xor_v2 f26c0000.xor: Marvell Version 2 XOR driver
[    0.039190] mv_xor_v2 f46a0000.xor: Marvell Version 2 XOR driver
[    0.039544] mv_xor_v2 f46c0000.xor: Marvell Version 2 XOR driver
[    0.039668] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[    0.040689] printk: console [ttyS0] disabled
[    0.060866] f0512000.serial: ttyS0 at MMIO 0xf0512000 (irq = 16, base_baud = 12500000) is a 16550A
[    0.761366] printk: console [ttyS0] enabled
[    0.786251] f2702100.serial: ttyS1 at MMIO 0xf2702100 (irq = 35, base_baud = 15625000) is a 16550A
[    0.815766] f4702000.serial: ttyS2 at MMIO 0xf4702000 (irq = 36, base_baud = 15625000) is a 16550A
[    0.825181] omap_rng f2760000.trng: Random Number Generator ver. 203b34c
[    0.825495] random: crng init done
[    0.832072] omap_rng f4760000.trng: Random Number Generator ver. 203b34c
[    0.843893] loop: module loaded
[    0.847084] Loading iSCSI transport class v2.0-870.
[    0.852907] ahci f2540000.sata: supply ahci not found, using dummy regulator
[    0.860073] ahci f2540000.sata: supply phy not found, using dummy regulator
[    0.867218] platform f2540000.sata:sata-port@0: supply target not found, using dummy regulator
[    0.876052] platform f2540000.sata:sata-port@1: supply target not found, using dummy regulator
[    0.885025] ahci f4540000.sata: supply ahci not found, using dummy regulator
[    0.892149] ahci f4540000.sata: supply phy not found, using dummy regulator
[    0.899304] platform f4540000.sata:sata-port@0: supply target not found, using dummy regulator
[    0.909057] spi-nor spi4.0: w25q32 (4096 Kbytes)
[    0.915637] hwmon hwmon0: temp1_input not attached to any thermal zone
[    0.925370] mv88x3310 f212a600.mdio-mii:00: Firmware version 0.2.1.0
[    0.932478] hwmon hwmon1: temp1_input not attached to any thermal zone
[    0.942651] mv88x3310 f212a600.mdio-mii:08: Firmware version 0.2.1.0
[    0.949755] hwmon hwmon2: temp1_input not attached to any thermal zone
[    0.957435] mvpp2 f2000000.ethernet: using 8 per-cpu buffers
[    0.971576] mvpp2 f4000000.ethernet: using 8 per-cpu buffers
[    0.984273] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.990830] ehci-pci: EHCI PCI platform driver
[    0.995350] ehci-platform: EHCI generic platform driver
[    1.000707] ehci-orion: EHCI orion driver
[    1.005012] xhci-hcd f2500000.usb3: xHCI Host Controller
[    1.010359] xhci-hcd f2500000.usb3: new USB bus registered, assigned bus number 1
[    1.017938] xhci-hcd f2500000.usb3: hcc params 0x0a000990 hci version 0x100 quirks 0x0000000000010010
[    1.027226] xhci-hcd f2500000.usb3: irq 39, io mem 0xf2500000
[    1.033280] hub 1-0:1.0: USB hub found
[    1.037067] hub 1-0:1.0: 1 port detected
[    1.041109] xhci-hcd f2500000.usb3: xHCI Host Controller
[    1.046458] xhci-hcd f2500000.usb3: new USB bus registered, assigned bus number 2
[    1.053975] xhci-hcd f2500000.usb3: Host supports USB 3.0 SuperSpeed
[    1.060388] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.068693] hub 2-0:1.0: USB hub found
[    1.072469] hub 2-0:1.0: 1 port detected
[    1.076661] xhci-hcd f2510000.usb3: xHCI Host Controller
[    1.082001] xhci-hcd f2510000.usb3: new USB bus registered, assigned bus number 3
[    1.089580] xhci-hcd f2510000.usb3: hcc params 0x0a000990 hci version 0x100 quirks 0x0000000000010010
[    1.098864] xhci-hcd f2510000.usb3: irq 40, io mem 0xf2510000
[    1.104902] hub 3-0:1.0: USB hub found
[    1.108679] hub 3-0:1.0: 1 port detected
[    1.112715] xhci-hcd f2510000.usb3: xHCI Host Controller
[    1.118060] xhci-hcd f2510000.usb3: new USB bus registered, assigned bus number 4
[    1.125584] xhci-hcd f2510000.usb3: Host supports USB 3.0 SuperSpeed
[    1.131996] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.140297] hub 4-0:1.0: USB hub found
[    1.144073] hub 4-0:1.0: 1 port detected
[    1.148453] usbcore: registered new interface driver usb-storage
[    1.154733] armada38x-rtc f4284000.rtc: registered as rtc0
[    1.160261] armada38x-rtc f4284000.rtc: setting system clock to 2093-05-28T21:29:22 UTC (3894384562)
[    1.169498] i2c /dev entries driver
[    1.175115] sdhci: Secure Digital Host Controller Interface driver
[    1.181331] sdhci: Copyright(c) Pierre Ossman
[    1.186049] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.194740] NET: Registered protocol family 10
[    1.200082] Segment Routing with IPv6
[    1.203792] NET: Registered protocol family 17
[    1.208284] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    1.219682] mmc0: SDHCI controller on f06e0000.sdhci [f06e0000.sdhci] using ADMA 64-bit
[    1.229497] 8021q: 802.1Q VLAN Support v1.8
[    1.229523] mmc1: SDHCI controller on f2780000.sdhci [f2780000.sdhci] using ADMA 64-bit
[    1.237641] armada8k-pcie f2600000.pcie: host bridge /cp0/pcie@f2600000 ranges:
[    1.249117] armada8k-pcie f2600000.pcie:      MEM 0x00c0000000..0x00dfffffff -> 0x00c0000000
[    1.257665] armada8k-pcie f2600000.pcie: Link up
[    1.262350] armada8k-pcie f2600000.pcie: PCI host bridge to bus 0000:00
[    1.269008] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.274529] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff]
[    1.277980] mmc1: new high speed SDHC card at address 0007
[    1.281468] pci 0000:00:00.0: [11ab:0110] type 01 class 0x060400
[    1.287490] mmcblk1: mmc1:0007 SD08G 7.42 GiB
[    1.293012] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x000fffff]
[    1.299039]  mmcblk1: p1 p2
[    1.303837] pci 0000:00:00.0: supports D1 D2
[    1.310863] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[    1.317848] pci 0000:01:00.0: [10b5:8606] type 01 class 0x060400
[    1.323960] pci 0000:01:00.0: reg 0x10: [mem 0xf6000000-0xf601ffff]
[    1.330839] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    1.338442] pci 0000:02:01.0: [10b5:8606] type 01 class 0x060400
[    1.345078] pci 0000:02:01.0: PME# supported from D0 D3hot D3cold
[    1.351646] pci 0000:02:04.0: [10b5:8606] type 01 class 0x060400
[    1.358281] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[    1.364779] pci 0000:02:05.0: [10b5:8606] type 01 class 0x060400
[    1.371408] pci 0000:02:05.0: PME# supported from D0 D3hot D3cold
[    1.377940] pci 0000:02:07.0: [10b5:8606] type 01 class 0x060400
[    1.378787] mmc0: new high speed MMC card at address 0001
[    1.384574] pci 0000:02:07.0: PME# supported from D0 D3hot D3cold
[    1.389732] mmcblk0: mmc0:0001 8GME4R 7.28 GiB
[    1.395941] pci 0000:02:09.0: [10b5:8606] type 01 class 0x060400
[    1.400226] mmcblk0boot0: mmc0:0001 8GME4R partition 1 4.00 MiB
[    1.406718] pci 0000:02:09.0: PME# supported from D0 D3hot D3cold
[    1.412329] mmcblk0boot1: mmc0:0001 8GME4R partition 2 4.00 MiB
[    1.419205] pci 0000:02:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    1.424165] mmcblk0rpmb: mmc0:0001 8GME4R partition 3 512 KiB, chardev (248:0)
[    1.432198] pci 0000:02:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    1.447485] pci 0000:02:05.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    1.455557] pci 0000:02:07.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    1.463624] pci 0000:02:09.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    1.471903] pci_bus 0000:03: busn_res: can not insert [bus 03-02] under [bus 02] (conflicts with (null) [bus 02])
[    1.483102] pci_bus 0000:03: busn_res: [bus 03-02] end is updated to 03
[    1.489749] pci_bus 0000:03: busn_res: can not insert [bus 03] under [bus 02] (conflicts with (null) [bus 02])
[    1.499803] pci 0000:02:01.0: devices behind bridge are unusable because [bus 03] cannot be assigned for them
[    1.509973] pci_bus 0000:04: busn_res: can not insert [bus 04-02] under [bus 02] (conflicts with (null) [bus 02])
[    1.521157] pci_bus 0000:04: busn_res: [bus 04-02] end is updated to 04
[    1.527810] pci_bus 0000:04: busn_res: can not insert [bus 04] under [bus 02] (conflicts with (null) [bus 02])
[    1.537864] pci 0000:02:04.0: devices behind bridge are unusable because [bus 04] cannot be assigned for them
[    1.548032] pci_bus 0000:05: busn_res: can not insert [bus 05-02] under [bus 02] (conflicts with (null) [bus 02])
[    1.559212] pci_bus 0000:05: busn_res: [bus 05-02] end is updated to 05
[    1.565859] pci_bus 0000:05: busn_res: can not insert [bus 05] under [bus 02] (conflicts with (null) [bus 02])
[    1.575912] pci 0000:02:05.0: devices behind bridge are unusable because [bus 05] cannot be assigned for them
[    1.586082] pci_bus 0000:06: busn_res: can not insert [bus 06-02] under [bus 02] (conflicts with (null) [bus 02])
[    1.597261] pci_bus 0000:06: busn_res: [bus 06-02] end is updated to 06
[    1.603904] pci_bus 0000:06: busn_res: can not insert [bus 06] under [bus 02] (conflicts with (null) [bus 02])
[    1.613956] pci 0000:02:07.0: devices behind bridge are unusable because [bus 06] cannot be assigned for them
[    1.624121] pci_bus 0000:07: busn_res: can not insert [bus 07-02] under [bus 02] (conflicts with (null) [bus 02])
[    1.635300] pci_bus 0000:07: busn_res: [bus 07-02] end is updated to 07
[    1.641944] pci_bus 0000:07: busn_res: can not insert [bus 07] under [bus 02] (conflicts with (null) [bus 02])
[    1.652001] pci 0000:02:09.0: devices behind bridge are unusable because [bus 07] cannot be assigned for them
[    1.661966] pci 0000:01:00.0: bridge has subordinate 02 but max busn 07
[    1.668663] pci 0000:00:00.0: BAR 0: assigned [mem 0xc0000000-0xc00fffff]
[    1.675487] pci 0000:00:00.0: BAR 8: assigned [mem 0xc0100000-0xc01fffff]
[    1.682306] pci 0000:01:00.0: BAR 0: assigned [mem 0xc0100000-0xc011ffff]
[    1.689139] pci 0000:02:01.0: PCI bridge to [bus 03]
[    1.694181] pci 0000:02:04.0: PCI bridge to [bus 04]
[    1.699220] pci 0000:02:05.0: PCI bridge to [bus 05]
[    1.704261] pci 0000:02:07.0: PCI bridge to [bus 06]
[    1.709299] pci 0000:02:09.0: PCI bridge to [bus 07]
[    1.714341] pci 0000:01:00.0: PCI bridge to [bus 02]
[    1.719379] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.724632] pci 0000:00:00.0:   bridge window [mem 0xc0100000-0xc01fffff]
[    1.731918] pcieport 0000:00:00.0: AER: enabled with IRQ 47
[    1.743415] ahci f2540000.sata: supply ahci not found, using dummy regulator
[    1.750568] ahci f2540000.sata: supply phy not found, using dummy regulator
[    1.757649] platform f2540000.sata:sata-port@0: supply target not found, using dummy regulator
[    1.766444] platform f2540000.sata:sata-port@1: supply target not found, using dummy regulator
[    1.776409] ahci f2540000.sata: masking port_map 0x3 -> 0x3
[    1.782064] ahci f2540000.sata: AHCI 0001.0000 32 slots 2 ports 6 Gbps 0x3 impl platform mode
[    1.790646] ahci f2540000.sata: flags: 64bit ncq sntf led only pmp fbs pio slum part sxs
[    1.799732] scsi host0: ahci
[    1.803395] scsi host1: ahci
[    1.806606] ata1: SATA max UDMA/133 mmio [mem 0xf2540000-0xf256ffff] port 0x100 irq 54
[    1.814592] ata2: SATA max UDMA/133 mmio [mem 0xf2540000-0xf256ffff] port 0x180 irq 54
[    1.822833] ahci f4540000.sata: supply ahci not found, using dummy regulator
[    1.829987] ahci f4540000.sata: supply phy not found, using dummy regulator
[    1.837029] platform f4540000.sata:sata-port@0: supply target not found, using dummy regulator
[    1.846138] platform f4540000.sata:sata-port@1: supply target not found, using dummy regulator
[    1.857136] ahci f4540000.sata: masking port_map 0x3 -> 0x3
[    1.862789] ahci f4540000.sata: AHCI 0001.0000 32 slots 2 ports 6 Gbps 0x3 impl platform mode
[    1.871361] ahci f4540000.sata: flags: 64bit ncq sntf led only pmp fbs pio slum part sxs
[    1.880095] scsi host2: ahci
[    1.883272] scsi host3: ahci
[    1.886267] ata3: SATA max UDMA/133 mmio [mem 0xf4540000-0xf456ffff] port 0x100 irq 55
[    1.894232] ata4: SATA max UDMA/133 mmio [mem 0xf4540000-0xf456ffff] port 0x180 irq 55
[    1.902785] mvpp2 f2000000.ethernet: using 8 per-cpu buffers
[    1.931823] mvpp2 f2000000.ethernet eth0: Using random mac address ae:1b:4c:72:f6:80
[    1.949962] mvpp2 f4000000.ethernet: using 8 per-cpu buffers
[    1.977441] mvpp2 f4000000.ethernet eth1: Using random mac address ce:06:cc:f9:95:ed
[    1.988245] mvpp2 f4000000.ethernet eth2: Using random mac address 42:71:df:ac:b2:08
[    1.999044] mvpp2 f4000000.ethernet eth3: Using random mac address 32:12:c0:b6:96:31
[    2.029148] xhci-hcd f4500000.usb3: xHCI Host Controller
[    2.034501] xhci-hcd f4500000.usb3: new USB bus registered, assigned bus number 5
[    2.042071] xhci-hcd f4500000.usb3: hcc params 0x0a000990 hci version 0x100 quirks 0x0000000000010010
[    2.051361] xhci-hcd f4500000.usb3: irq 41, io mem 0xf4500000
[    2.057470] hub 5-0:1.0: USB hub found
[    2.061249] hub 5-0:1.0: 1 port detected
[    2.065314] xhci-hcd f4500000.usb3: xHCI Host Controller
[    2.070653] xhci-hcd f4500000.usb3: new USB bus registered, assigned bus number 6
[    2.078180] xhci-hcd f4500000.usb3: Host supports USB 3.0 SuperSpeed
[    2.084610] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[    2.092899] hub 6-0:1.0: USB hub found
[    2.096705] hub 6-0:1.0: 1 port detected
[    2.145679] ata1: SATA link down (SStatus 0 SControl 300)
[    2.156231] ata2: SATA link down (SStatus 0 SControl 300)
[    2.235653] ata3: SATA link down (SStatus 0 SControl 300)
[    2.241136] ata4: SATA link down (SStatus 0 SControl 300)
[    2.258207] VFS: Mounted root (squashfs filesystem) readonly on device 179:2.
[    2.265814] Freeing unused kernel memory: 448K
[    2.284272] Run /sbin/init as init process
[    2.477692] init: Console is alive
[    2.662290] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    2.677411] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    2.693277] init: - preinit -
[    3.213428] mvpp2 f2000000.ethernet eth0: PHY [f212a600.mdio-mii:00] driver [mv88x3310] (irq=POLL)
[    3.231528] mvpp2 f2000000.ethernet eth0: configuring for phy/10gbase-r link mode
Press the [f] key and hit [enter] to enter failsafe mode
Press the [1], [2], [3] or [4] key and hit [enter] to select the debug level
[    7.893112] F2FS-fs (loop0): Mounted with checkpoint version = 4d1cb336
[    7.901063] mount_root: switching to f2fs overlay
[    7.906465] overlayfs: "xino" feature enabled using 32 upper inode bits.
[    8.053922] EXT4-fs (mmcblk1p1): mounted filesystem without journal. Opts: (null)
[    8.075389] urandom-seed: Seeding with /etc/urandom.seed
[    8.163717] procd: - early -
[    8.734611] procd: - ubus -
[    8.792219] procd: - init -
Please press Enter to activate this console.
[    9.050000] kmodloader: loading kernel modules from /etc/modules.d/*
[    9.053680] urngd: v1.0.2 started.
[    9.061542] i2c i2c-1: Added multiplexed i2c bus 2
[    9.066534] i2c i2c-1: Added multiplexed i2c bus 3
[    9.071479] i2c i2c-1: Added multiplexed i2c bus 4
[    9.076362] i2c i2c-1: Added multiplexed i2c bus 5
[    9.081227] i2c i2c-1: Added multiplexed i2c bus 6
[    9.086106] i2c i2c-1: Added multiplexed i2c bus 7
[    9.090972] i2c i2c-1: Added multiplexed i2c bus 8
[    9.095848] i2c i2c-1: Added multiplexed i2c bus 9
[    9.100663] pca954x 1-0070: registered 8 multiplexed busses for I2C switch pca9548
[    9.108786] sfp sfp-eth0: Host maximum power 2.0W
[    9.114625] sfp sfp-eth1: Host maximum power 2.0W
[    9.120414] sfp sfp-eth3: Host maximum power 2.0W
[    9.139286] PPP generic driver version 2.4.2
[    9.144305] NET: Registered protocol family 24
[    9.151501] kmodloader: done loading kernel modules from /etc/modules.d/*
[   13.143624] mvpp2 f2000000.ethernet eth0: PHY [f212a600.mdio-mii:00] driver [mv88x3310] (irq=POLL)
[   13.161696] mvpp2 f2000000.ethernet eth0: configuring for phy/10gbase-r link mode
[   13.172030] br-lan: port 1(eth0) entered blocking state
[   13.177345] br-lan: port 1(eth0) entered disabled state
[   13.182907] device eth0 entered promiscuous mode
[   13.199524] mvpp2 f4000000.ethernet eth1: PHY [f212a600.mdio-mii:08] driver [mv88x3310] (irq=POLL)
[   13.217370] mvpp2 f4000000.ethernet eth1: configuring for phy/10gbase-r link mode
[   13.228473] br-lan: port 2(eth1) entered blocking state
[   13.233730] br-lan: port 2(eth1) entered disabled state
[   13.239275] device eth1 entered promiscuous mode
[   13.244005] br-lan: port 2(eth1) entered blocking state
[   13.249282] br-lan: port 2(eth1) entered forwarding state
[   13.254796] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[   13.265413] mvpp2 f4000000.ethernet eth3: configuring for inband/2500base-x link mode
[   13.274120] br-lan: port 3(eth3) entered blocking state
[   13.279402] br-lan: port 3(eth3) entered disabled state
[   13.284950] device eth3 entered promiscuous mode
[   13.289689] br-lan: port 3(eth3) entered blocking state
[   13.294965] br-lan: port 3(eth3) entered forwarding state
[   13.305332] mvpp2 f4000000.ethernet eth2: PHY [f212a200.mdio-mii:00] driver [Marvell 88E1510] (irq=POLL)
[   13.316107] mvpp2 f4000000.ethernet eth2: configuring for phy/sgmii link mode
[   14.255030] br-lan: port 2(eth1) entered disabled state
[   14.261857] br-lan: port 3(eth3) entered disabled state

And the output of lspci -vvv:

00:00.0 PCI bridge: Marvell Technology Group Ltd. 88F60x0/88F70x0/88F80x0/CN913x ARM SoC (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 47
        Region 0: Memory at c0000000 (32-bit, non-prefetchable) [size=1M]
        Bus: primary=00, secondary=01, subordinate=ff, sec-latency=0
        I/O behind bridge: f000-0fff [disabled] [16-bit]
        Memory behind bridge: c0100000-c01fffff [size=1M] [32-bit]
        Prefetchable memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI+ D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
                Address: 0000000000000000  Data: 0000
                Masking: 00000000  Pending: 00000000
        Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- RBE+
                DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <512ns, L1 <16us
                        ClockPM- Surprise- LLActRep+ BwNot- ASPMOptComp+
                LnkCtl: ASPM Disabled; RCB 128 bytes, Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1
                        TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
                RootCap: CRSVisible-
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible-
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP+ LTR+
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt+ EETLPPrefix+, MaxEETLPPrefixes 4
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- LN System CLS Not Supported, TPHComp+ ExtTPHComp- ARIFwd+
                         AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, ARIFwd-
                         AtomicOpsCtl: ReqEn- EgressBlck-
                LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
                LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [b0] MSI-X: Enable- Count=1 Masked-
                Vector table: BAR=0 offset=00000000
                PBA: BAR=2 offset=00000000
        Capabilities: [d0] Vital Product Data
                Not readable
        Capabilities: [100 v2] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
                RootCmd: CERptEn+ NFERptEn+ FERptEn+
                RootSta: CERcvd- MultCERcvd- UERcvd- MultUERcvd-
                         FirstFatal- NonFatalMsg- FatalMsg- IntMsg 31
                ErrorSrc: ERR_COR: 0000 ERR_FATAL/NONFATAL: 0000
        Capabilities: [158 v1] Secondary PCI Express
                LnkCtl3: LnkEquIntrruptEn- PerformEqu-
                LaneErrStat: 0
        Capabilities: [1b8 v1] Transaction Processing Hints
                Device specific mode supported
                No steering table available
        Capabilities: [24c v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=10us PortTPowerOnTime=10us
                L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                           T_CommonMode=0us LTR1.2_Threshold=0ns
                L1SubCtl2: T_PwrOn=10us
        Kernel driver in use: pcieport
lspci: Unable to load libkmod resources: error -12

01:00.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba) (prog-if 00 [Normal decode])
        Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 32 bytes
        Interrupt: pin A routed to IRQ 48
        Region 0: Memory at c0100000 (32-bit, non-prefetchable) [size=128K]
        Bus: primary=01, secondary=02, subordinate=02, sec-latency=0
        I/O behind bridge: 0000f000-00000fff [disabled] [32-bit]
        Memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable+ Count=1/4 Maskable+ 64bit+
                Address: 00000000f0280040  Data: 00a8
                Masking: 00000001  Pending: 00000000
        Capabilities: [68] Express (v2) Upstream Port, MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ SlotPowerLimit 0W
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr+ NonFatalErr+ FatalErr- UnsupReq+ AuxPwr- TransPend-
                LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <2us
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1
                        TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS-
                         AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled,
                         AtomicOpsCtl: EgressBlck-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Capabilities: [100 v1] Device Serial Number ba-86-01-10-b5-df-0e-00
        Capabilities: [fb4 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 14, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 40000001 0000000f c0000000 400028f0
        Capabilities: [138 v1] Power Budgeting <?>
        Capabilities: [148 v1] Virtual Channel
                Caps:   LPEVC=1 RefClk=100ns PATEntryBits=4
                Arb:    Fixed+ WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=06 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32+ WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=WRR32 TC/VC=ff
                        Status: NegoPending- InProgress-
                        Port Arbitration Table <?>
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                        Status: NegoPending+ InProgress-
        Capabilities: [448 v1] Vendor Specific Information: ID=0000 Rev=0 Len=0cc <?>
        Capabilities: [950 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
        Kernel driver in use: pcieport

02:01.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba) (prog-if 00 [Normal decode])
        Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 49
        Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
        I/O behind bridge: 0000f000-00000fff [disabled] [32-bit]
        Memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable+ Count=1/4 Maskable+ 64bit+
                Address: 00000000f0280040  Data: 00a9
                Masking: 00000001  Pending: 00000000
        Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- RBE+
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #1, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 <4us
                        ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0
                        TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #1, PowerLimit 25W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- ARIFwd+
                         AtomicOpsCap: Routing-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, ARIFwd-
                         AtomicOpsCtl: EgressBlck-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Capabilities: [100 v1] Device Serial Number ba-86-01-10-b5-df-0e-00
        Capabilities: [fb4 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
        Capabilities: [148 v1] Virtual Channel
                Caps:   LPEVC=1 RefClk=100ns PATEntryBits=1
                Arb:    Fixed+ WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending+ InProgress-
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                        Status: NegoPending+ InProgress-
        Capabilities: [520 v1] Access Control Services
                ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        Capabilities: [950 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
        Kernel driver in use: pcieport

[more below]

02:04.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba) (prog-if 00 [Normal decode])
        Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 50
        Bus: primary=02, secondary=04, subordinate=04, sec-latency=0
        I/O behind bridge: 0000f000-00000fff [disabled] [32-bit]
        Memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable+ Count=1/4 Maskable+ 64bit+
                Address: 00000000f0280040  Data: 00aa
                Masking: 00000001  Pending: 00000000
        Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- RBE+
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #4, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 <4us
                        ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0
                        TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #4, PowerLimit 25W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- ARIFwd+
                         AtomicOpsCap: Routing-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, ARIFwd-
                         AtomicOpsCtl: EgressBlck-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Capabilities: [100 v1] Device Serial Number ba-86-01-10-b5-df-0e-00
        Capabilities: [fb4 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
        Capabilities: [148 v1] Virtual Channel
                Caps:   LPEVC=1 RefClk=100ns PATEntryBits=1
                Arb:    Fixed+ WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending+ InProgress-
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                        Status: NegoPending+ InProgress-
        Capabilities: [520 v1] Access Control Services
                ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        Capabilities: [950 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
        Kernel driver in use: pcieport

02:05.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba) (prog-if 00 [Normal decode])
        Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 51
        Bus: primary=02, secondary=05, subordinate=05, sec-latency=0
        I/O behind bridge: 0000f000-00000fff [disabled] [32-bit]
        Memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable+ Count=1/4 Maskable+ 64bit+
                Address: 00000000f0280040  Data: 00ab
                Masking: 00000001  Pending: 00000000
        Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- RBE+
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #5, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 <4us
                        ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0
                        TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #5, PowerLimit 25W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- ARIFwd+
                         AtomicOpsCap: Routing-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, ARIFwd-
                         AtomicOpsCtl: EgressBlck-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Capabilities: [100 v1] Device Serial Number ba-86-01-10-b5-df-0e-00
        Capabilities: [fb4 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
        Capabilities: [148 v1] Virtual Channel
                Caps:   LPEVC=1 RefClk=100ns PATEntryBits=1
                Arb:    Fixed+ WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending+ InProgress-
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                        Status: NegoPending+ InProgress-
        Capabilities: [520 v1] Access Control Services
                ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        Capabilities: [950 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
        Kernel driver in use: pcieport

02:07.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba) (prog-if 00 [Normal decode])
        Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 52
        Bus: primary=02, secondary=06, subordinate=06, sec-latency=0
        I/O behind bridge: 0000f000-00000fff [disabled] [32-bit]
        Memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable+ Count=1/4 Maskable+ 64bit+
                Address: 00000000f0280040  Data: 00ac
                Masking: 00000001  Pending: 00000000
        Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- RBE+
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #7, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 <4us
                        ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0
                        TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #7, PowerLimit 25W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- ARIFwd+
                         AtomicOpsCap: Routing-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, ARIFwd-
                         AtomicOpsCtl: EgressBlck-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Capabilities: [100 v1] Device Serial Number ba-86-01-10-b5-df-0e-00
        Capabilities: [fb4 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
        Capabilities: [148 v1] Virtual Channel
                Caps:   LPEVC=1 RefClk=100ns PATEntryBits=1
                Arb:    Fixed+ WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending+ InProgress-
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                        Status: NegoPending+ InProgress-
        Capabilities: [520 v1] Access Control Services
                ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        Capabilities: [950 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
        Kernel driver in use: pcieport

02:09.0 PCI bridge: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba) (prog-if 00 [Normal decode])
        Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 53
        Bus: primary=02, secondary=07, subordinate=07, sec-latency=0
        I/O behind bridge: 0000f000-00000fff [disabled] [32-bit]
        Memory behind bridge: fff00000-000fffff [disabled] [32-bit]
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable+ Count=1/4 Maskable+ 64bit+
                Address: 00000000f0280040  Data: 00ad
                Masking: 00000001  Pending: 00000000
        Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag- RBE+
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #9, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <2us
                        ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp-
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x1
                        TrErr- Train- SlotClk- DLActive+ BWMgmt- ABWMgmt+
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #9, PowerLimit 25W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- ARIFwd+
                         AtomicOpsCap: Routing-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, ARIFwd-
                         AtomicOpsCtl: EgressBlck-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port PCI Express Gen 2 (5.0 GT/s) Switch
        Capabilities: [100 v1] Device Serial Number ba-86-01-10-b5-df-0e-00
        Capabilities: [fb4 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
        Capabilities: [148 v1] Virtual Channel
                Caps:   LPEVC=1 RefClk=100ns PATEntryBits=1
                Arb:    Fixed+ WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending- InProgress-
                VC1:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable- ID=1 ArbSelect=Fixed TC/VC=00
                        Status: NegoPending+ InProgress-
        Capabilities: [520 v1] Access Control Services
                ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl+ DirectTrans+
                ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        Capabilities: [950 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
        Kernel driver in use: pcieport

As a side note, the Width for the connected card can be seen in the output of lspci -s 02:09.0 -vvv | grep Width

LnkCap: Port #9, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <1us, L1 <2us
lspci: Unable to load libkmod resources: error -12
                LnkSta: Speed 5GT/s, Width x1

And it seems that a similar problem was solved for the LX2160A RDB by just using the u-boot upstream code:

I also tried building the binary with mainline u-boot and it did not solve the problem.

Is the issue you aren’t able to see the devices in u-boot or in Linux? The u-boot patch is just bringing over a patch for Linux that already exists.

I can’t see them in u-boot (bus 2):

=> pci 0
Scanning PCI devices on bus 0
BusDevFun  VendorId   DeviceId   Device Class       Sub-Class
_____________________________________________________________
00.00.00   0x11ab     0x0110     Bridge device           0x04
=> pci 1
Scanning PCI devices on bus 1
BusDevFun  VendorId   DeviceId   Device Class       Sub-Class
_____________________________________________________________
01.00.00   0x10b5     0x8606     Bridge device           0x04
=> pci 2
Scanning PCI devices on bus 2
BusDevFun  VendorId   DeviceId   Device Class       Sub-Class
_____________________________________________________________

The PCIe switch is there on bus 1, but nothing under it appears (bus 2)

The PCIe switch header if necessary:

=> pci header 1.0.0
  vendor ID =                   0x10b5
  device ID =                   0x8606
  command register ID =         0x0007
  status register =             0x0010
  revision ID =                 0xba
  class code =                  0x06 (Bridge device)
  sub class code =              0x04
  programming interface =       0x00
  cache line =                  0x08
  latency time =                0x00
  header type =                 0x01
  BIST =                        0x00
  base address 0 =              0xf6000000
  base address 1 =              0x00000000
  primary bus number =          0x01
  secondary bus number =        0x02
  subordinate bus number =      0x02
  secondary latency timer =     0x00
  IO base =                     0x01
  IO limit =                    0xf1
  secondary status =            0x0000
  memory base =                 0xf610
  memory limit =                0xf600
  prefetch memory base =        0x1001
  prefetch memory limit =       0x0001
  prefetch memory base upper =  0x00000000
  prefetch memory limit upper = 0x00000000
  IO base upper 16 bits =       0xf901
  IO limit upper 16 bits =      0xf900
  expansion ROM base address =  0x00000000
  interrupt line =              0x00
  interrupt pin =               0x01
  bridge control =              0x0000

Thanks for the explanation. Now it makes sense to me

Hi again,

Is there any chance of this getting fixed? Or is an update in this regard unlikely?

I just want to know if I should permanently change the design of my solution and reduce the expectations about the deployment of my boards.