LX2 honeycomb linux reboot fails with LSDK-21.08 changes

NXP LX2160
1

I have a HoneyComb with 1 TB SSD. When I flash the HoneyComb with the official SolidRun image lx2160acex7_2000_700_3200_8_5_2-bc46e34.img.xz, I am able to reboot the HoneyComb from linux by typing “reboot” at the prompt without issues.

But when I flash the HoneyComb with the latest lx2160a_build repo (a393e2e73e833227f047cf4c718c023b894988e8), when I type “reboot” at the linux command prompt, it reboots but gets stuck a bit before the linux password prompt. Note that cold boots work without problems.

I’ve found that if I use the previous commit for the lx2160a_build repo (bc46e34842b584bcf1042263b60dc300c51dd150) the reboot command works as expected.

I’ve compared cold boots of both the official SolidRun release and my build of the latest lx2160a_build and I see the following lines only in the latest version:
libfdt fdt_check_header(): FDT_ERR_BADMAGIC
Scanning disk esdhc@2140000.blk…
Scanning disk esdhc@2150000.blk…
Found 4 disks
No EFI system partition
ERROR: invalid device tree
…
[] optee: probe of firmware:optee failed with error -22

When I do a linux reboot with the latest version, I see it get stuck at the following place:
[] fsl_mc_dprc dprc.1: DPRC device bound to driver
[] pcieport 0000:00:00.0: PME: Signaling with IRQ 37
[] pcieport 0001:00:00.0: PME: Signaling with IRQ 38
[] fsl_dpaa2_eth dpni.0 (unnamed net_device) (uninitialized): PHY [0x0000000008b96000:01] driver [Qualcomm Atheros AR8035] (irq=POLL)
[] fsl_dpaa2_eth dpni.0: Probed interface eth0
[] ALSA device list:
[ 6.123335] No soundcards found.
[ 64.695421] nvme nvme0: I/O 28 QID 0 timeout, completion polled
[ 126.135416] nvme nvme0: I/O 20 QID 0 timeout, completion polled
[ 126.141366] nvme nvme0: missing or invalid SUBNQN field.
[ 126.146759] nvme nvme0: Shutdown timeout set to 8 seconds
[ 177.783481] random: crng init done
[ 187.575424] nvme nvme0: I/O 29 QID 0 timeout, completion polled
[ 249.015413] nvme nvme0: I/O 21 QID 0 timeout, completion polled
[ 310.455413] nvme nvme0: I/O 28 QID 0 timeout, completion polled
[ 371.895415] nvme nvme0: I/O 22 QID 0 timeout, completion polled
[ 433.335408] nvme nvme0: I/O 29 QID 0 timeout, completion polled

Do you know what might be causing this?

2

This seems to be an issue with the NVMe initialization on a warm reboot. I will have to try and reproduce the issue. If possible could you please post a full terminal log of the reboot from bootloader to the Linux failure?

Thanks

3 
Here's the the first part from the reboot: 
reboot
         Stopping Sessio[  OK  ] Removed slice system-modprobe.slice.
[  OK  ] Stopped target Graphical Interface.
...
[  OK  ] Reached target Reboot.
[218488.313867] watchdog: watchdog0: watchdog did not stop!
[218490.592145] reboot: Restarting system
NOTICE:  BL2: v2.4(release):LSDK-21.08-4-g4a22e6a
NOTICE:  BL2: Built : 18:01:10, Jan 28 2022
NOTICE:  UDIMM KHX3200C20S4/16GX
NOTICE:  DDR PMU Hardware version-0x1210
NOTICE:  DDR PMU Firmware vision-0x1001 (vA-2019.04)
NOTICE:  DDR4 UDIMM with 2-rank 64-bit bus (x8)

NOTICE:  32 GB DDR4, 64-bit, CL=20, ECC off, 256B, CS0+CS1
NOTICE:  BL2: Booting BL31
NOTICE:  BL31: v2.4(release):LSDK-21.08-4-g4a22e6a
NOTICE:  BL31: Built : 18:01:10, Jan 28 2022
NOTICE:  Welcome to lx2160acex7 BL31 Phase


U-Boot 2021.04-00029-g01ae22d4 (Jan 28 2022 - 18:00:55 +0000)

SoC:  LX2160ACE Rev2.0 (0x87360020)
Clock Configuration:
       CPU0(A72):2000 MHz  CPU1(A72):2000 MHz  CPU2(A72):2000 MHz
       CPU3(A72):2000 MHz  CPU4(A72):2000 MHz  CPU5(A72):2000 MHz
       CPU6(A72):2000 MHz  CPU7(A72):2000 MHz  CPU8(A72):2000 MHz
       CPU9(A72):2000 MHz  CPU10(A72):2000 MHz  CPU11(A72):2000 MHz
       CPU12(A72):2000 MHz  CPU13(A72):2000 MHz  CPU14(A72):2000 MHz
       CPU15(A72):2000 MHz
       Bus:      700  MHz  DDR:      3200 MT/s
Reset Configuration Word (RCW):
       00000000: 50838338 24500050 00000000 00000000
       00000010: 00000000 0e010000 00000000 00000000
       00000020: 10c001a0 00002580 00000000 08000086
       00000030: 09240000 00000001 00000000 00000000
       00000040: 00000000 00000000 00000000 00000000
       00000050: 00000000 00000000 00000000 00000000
       00000060: 00000000 00000000 00027000 00000000
       00000070: 08a80001 00151020
Model: SolidRun LX2160ACEX7 COM express type 7 based board
Board: LX2160ACE Rev2.0-CEX7, SD
SERDES1 Reference: Clock1 = 161.13MHz Clock2 = 100MHz
SERDES2 Reference: Clock1 = 100MHz Clock2 = 100MHz
SERDES3 Reference: Clock1 = 100MHz Clock2 = 100Hz
DRAM:  31.9 GiB
DDR    31.9 GiB (DDR4, 64-bit, CL=20, ECC off)
       DDR Controller Interleaving Mode: 256B
       DDR Chip-Select Interleaving Mode: CS0+CS1
dev_get_priv: null device
dev_get_priv: null device
Using SERDES1 Protocol: 8 (0x8)
Using SERDES2 Protocol: 5 (0x5)
Using SERDES3 Protocol: 2 (0x2)
PCIe1: pcie@3400000 disabled
PCIe2: pcie@3500000 disabled
PCIe3: pcie@3600000 Root Complex: x4 gen3
PCIe4: pcie@3700000 disabled
PCIe5: pcie@3800000 Root Complex: no link
PCIe6: pcie@3900000 disabled
WDT:   Started with servicing (30s timeout)
MMC:   FSL_SDHC: 0, FSL_SDHC: 1
Loading Environment from MMC... *** Warning - bad CRC, using default environment

EEPROM: TlvInfo v1 len=88
In:    serial_pl01x
Out:   serial_pl01x
Err:   serial_pl01x
SEC0:  RNG instantiated
fsl_board_late_init
Net:   eth0: DPMAC17@rgmii-id [PRIME]

MMC read: dev # 0, block # 20480, count 4608 ... 4608 blocks read: OK

MMC read: dev # 0, block # 28672, count 2048 ... 2048 blocks read: OK
crc32+
fsl-mc: Booting Management Complex ... SUCCESS
fsl-mc: Management Complex booted (version: 10.28.1, boot status: 0x1)
Hit any key to stop autoboot:  0
Device: FSL_SDHC
Manufacturer ID: 3
OEM: 5344
Name: SL08G
Bus Speed: 50000000
Mode: SD High Speed (50MHz)
Rd Block Len: 512
SD version 3.0
High Capacity: Yes
Capacity: 7.4 GiB
Bus Width: 4-bit
Erase Group Size: 512 Bytes

MMC read: dev # 0, block # 26624, count 2048 ... 2048 blocks read: OK
starting USB...
Bus usb3@3100000: Register 200017f NbrPorts 2
Starting the controller
USB XHCI 1.00
Bus usb3@3110000: Register 200017f NbrPorts 2
Starting the controller
USB XHCI 1.00
scanning bus usb3@3100000 for devices... 1 USB Device(s) found
scanning bus usb3@3110000 for devices... 4 USB Device(s) found
       scanning usb for storage devices... 0 Storage Device(s) found

Device 0: unknown device
switch to partitions #0, OK
mmc0 is current device
Scanning mmc 0:1...
Scanning disk esdhc@2140000.blk...
Scanning disk esdhc@2150000.blk...
Found 4 disks
No EFI system partition
Releasing fan controller full speed gpio
BootOrder not defined
EFI boot manager: Cannot load any image
switch to partitions #0, OK
mmc1(part 0) is current device
Scanning mmc 1:1...
Found /extlinux/extlinux.conf
Retrieving file: /extlinux/extlinux.conf
331 bytes read in 8 ms (40 KiB/s)
1:      primary kernel
Retrieving file: /boot/Image
41406976 bytes read in 1907 ms (20.7 MiB/s)
append: console=ttyAMA0,115200 earlycon=pl011,mmio32,0x21c0000 default_hugepagesz=1024m hugepagesz=1024m hugepages=2 pci=pcie_bus_perf root=PARTUUID=30303030-01 rw rootwait
Retrieving file: /boot/fsl-lx2160a-clearfog-cx.dtb
40976 bytes read in 16 ms (2.4 MiB/s)
Moving Image from 0x81100000 to 0x81200000, end=83a90000
## Flattened Device Tree blob at 81000000
   Booting using the fdt blob at 0x81000000
   Loading Device Tree to 000000009fff2000, end 000000009ffff00f ... OK
Re-Distributor 0 LPI is already enabled
Releasing fan controller full speed gpio
fsl-mc: Deploying data path layout ... WARNING: Firmware returned an error (GSR: 0x3f)

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd083]
[    0.000000] Linux version 5.10.35-00001-g6217c277d788 (blah@blah) (aarch64-linux-gnu-gcc (Linaro GCC 7.4-2019.02) 7.4.1 20181213 [linaro-7.4-2019.02 revision 56ec6f6b99cc167ff0c2f8e1a2eed33b1edc85d4], GNU ld (Linaro_Binutils-2019.02) 2.28.2.20170706) #1 SMP PREEMPT Fri Jan 28 18:01:39 UTC 2022
[    0.000000] Machine model: SolidRun LX2160A Clearfog CX
[    0.000000] earlycon: pl11 at MMIO32 0x00000000021c0000 (options '')
[    0.000000] printk: bootconsole [pl11] enabled
[    0.000000] efi: UEFI not found.
[    0.000000] cma: Reserved 32 MiB at 0x00000000f9c00000
[    0.000000] NUMA: No NUMA configuration found
[    0.000000] NUMA: Faking a node at [mem 0x0000000080000000-0x000000277fffffff]
[    0.000000] NUMA: NODE_DATA [mem 0x277c3dbb00-0x277c3ddfff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000277fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x00000000fbdfffff]
[    0.000000]   node   0: [mem 0x0000002080000000-0x000000277fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x000000277fffffff]
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 24 pages/cpu s60120 r8192 d29992 u98304
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: EL2 vector hardening
[    0.000000] CPU features: kernel page table isolation forced ON by KASLR
[    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000] CPU features: detected: Spectre-v2
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 7724544
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: console=ttyAMA0,115200 earlycon=pl011,mmio32,0x21c0000 default_hugepagesz=1024m hugepagesz=1024m hugepages=2 pci=pcie_bus_perf root=PARTUUID=30303030-01 rw rootwait
[    0.000000] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.000000] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x00000000f5c00000-0x00000000f9c00000] (64MB)
[    0.000000] Memory: 28546416K/31389696K available (20672K kernel code, 3060K rwdata, 9952K rodata, 6656K init, 1038K bss, 2810512K reserved, 32768K cma-reserved)
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 256 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000006200000
[    0.000000] ITS [mem 0x06020000-0x0603ffff]
[    0.000000] ITS@0x0000000006020000: allocated 65536 Devices @2080080000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: Using preallocated redistributor tables
[    0.000000] GICv3: using LPI property table @0x0000000080000000
[    0.000000] GICv3: CPU0: using reserved LPI pending table @0x0000000080010000
[    0.000000] random: get_random_bytes called from start_kernel+0x32c/0x4f4 with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 25.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x5c409fb33, max_idle_ns: 440795203156 ns
[    0.000001] sched_clock: 56 bits at 25MHz, resolution 39ns, wraps every 4398046511103ns
[    0.008589] Console: colour dummy device 80x25
[    0.013124] Calibrating delay loop (skipped), value calculated using timer frequency.. 50.00 BogoMIPS (lpj=100000)
[    0.023593] pid_max: default: 32768 minimum: 301
[    0.028325] LSM: Security Framework initializing
[    0.033131] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.040870] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.049678] rcu: Hierarchical SRCU implementation.
[    0.054616] Platform MSI: gic-its@6020000 domain created
[    0.060039] PCI/MSI: /interrupt-controller@6000000/gic-its@6020000 domain created
[    0.067639] fsl-mc MSI: gic-its@6020000 domain created
[    0.073499] EFI services will not be available.
[    0.078378] smp: Bringing up secondary CPUs ...
[    0.083259] Detected PIPT I-cache on CPU1
[    0.083280] GICv3: CPU1: found redistributor 1 region 0:0x0000000006220000
[    0.083303] GICv3: CPU1: using reserved LPI pending table @0x0000000080020000
[    0.083337] CPU1: Booted secondary processor 0x0000000001 [0x410fd083]
[    0.083667] Detected PIPT I-cache on CPU2
[    0.083687] GICv3: CPU2: found redistributor 100 region 0:0x0000000006240000
[    0.083710] GICv3: CPU2: using reserved LPI pending table @0x0000000080030000
[    0.083750] CPU2: Booted secondary processor 0x0000000100 [0x410fd083]
[    0.084098] Detected PIPT I-cache on CPU3
[    0.084113] GICv3: CPU3: found redistributor 101 region 0:0x0000000006260000
[    0.084132] GICv3: CPU3: using reserved LPI pending table @0x0000000080040000
[    0.084161] CPU3: Booted secondary processor 0x0000000101 [0x410fd083]
[    0.084482] Detected PIPT I-cache on CPU4
[    0.084503] GICv3: CPU4: found redistributor 200 region 0:0x0000000006280000
[    0.084522] GICv3: CPU4: using reserved LPI pending table @0x0000000080050000
[    0.084557] CPU4: Booted secondary processor 0x0000000200 [0x410fd083]
[    0.084876] Detected PIPT I-cache on CPU5
[    0.084895] GICv3: CPU5: found redistributor 201 region 0:0x00000000062a0000
[    0.084914] GICv3: CPU5: using reserved LPI pending table @0x0000000080060000
[    0.084937] CPU5: Booted secondary processor 0x0000000201 [0x410fd083]
[    0.085245] Detected PIPT I-cache on CPU6
[    0.085268] GICv3: CPU6: found redistributor 300 region 0:0x00000000062c0000
[    0.085289] GICv3: CPU6: using reserved LPI pending table @0x0000000080070000
[    0.085323] CPU6: Booted secondary processor 0x0000000300 [0x410fd083]
[    0.085632] Detected PIPT I-cache on CPU7
[    0.085654] GICv3: CPU7: found redistributor 301 region 0:0x00000000062e0000
[    0.085672] GICv3: CPU7: using reserved LPI pending table @0x0000000080080000
[    0.085691] CPU7: Booted secondary processor 0x0000000301 [0x410fd083]
[    0.086001] Detected PIPT I-cache on CPU8
[    0.086028] GICv3: CPU8: found redistributor 400 region 0:0x0000000006300000
[    0.086040] GICv3: CPU8: using reserved LPI pending table @0x0000000080090000
[    0.086074] CPU8: Booted secondary processor 0x0000000400 [0x410fd083]
[    0.086374] Detected PIPT I-cache on CPU9
[    0.086400] GICv3: CPU9: found redistributor 401 region 0:0x0000000006320000
[    0.086411] GICv3: CPU9: using reserved LPI pending table @0x00000000800a0000
[    0.086430] CPU9: Booted secondary processor 0x0000000401 [0x410fd083]
[    0.086734] Detected PIPT I-cache on CPU10
[    0.086755] GICv3: CPU10: found redistributor 500 region 0:0x0000000006340000
[    0.086767] GICv3: CPU10: using reserved LPI pending table @0x00000000800b0000
[    0.086798] CPU10: Booted secondary processor 0x0000000500 [0x410fd083]
[    0.087114] Detected PIPT I-cache on CPU11
[    0.087132] GICv3: CPU11: found redistributor 501 region 0:0x0000000006360000
[    0.087142] GICv3: CPU11: using reserved LPI pending table @0x00000000800c0000
[    0.087162] CPU11: Booted secondary processor 0x0000000501 [0x410fd083]
[    0.087468] Detected PIPT I-cache on CPU12
[    0.087490] GICv3: CPU12: found redistributor 600 region 0:0x0000000006380000
[    0.087503] GICv3: CPU12: using reserved LPI pending table @0x00000000800d0000
[    0.087535] CPU12: Booted secondary processor 0x0000000600 [0x410fd083]
[    0.087830] Detected PIPT I-cache on CPU13
[    0.087848] GICv3: CPU13: found redistributor 601 region 0:0x00000000063a0000
[    0.087859] GICv3: CPU13: using reserved LPI pending table @0x00000000800e0000
[    0.087879] CPU13: Booted secondary processor 0x0000000601 [0x410fd083]
[    0.088165] Detected PIPT I-cache on CPU14
[    0.088188] GICv3: CPU14: found redistributor 700 region 0:0x00000000063c0000
[    0.088201] GICv3: CPU14: using reserved LPI pending table @0x00000000800f0000
[    0.088228] CPU14: Booted secondary processor 0x0000000700 [0x410fd083]
[    0.088521] Detected PIPT I-cache on CPU15
[    0.088540] GICv3: CPU15: found redistributor 701 region 0:0x00000000063e0000
[    0.088551] GICv3: CPU15: using reserved LPI pending table @0x0000000080100000
[    0.088571] CPU15: Booted secondary processor 0x0000000701 [0x410fd083]
[    0.088611] smp: Brought up 1 node, 16 CPUs
[    0.469338] SMP: Total of 16 processors activated.
[    0.474180] CPU features: detected: 32-bit EL0 Support
[    0.479377] CPU features: detected: CRC32 instructions
[    0.484570] CPU features: detected: 32-bit EL1 Support
[    0.503878] CPU: All CPU(s) started at EL2
[    0.508045] alternatives: patching kernel code
[    0.513270] devtmpfs: initialized
4

And here is the remaining output:

[    0.519199] KASLR enabled
[    0.521923] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.531779] futex hash table entries: 4096 (order: 6, 262144 bytes, linear)
[    0.539219] pinctrl core: initialized pinctrl subsystem
[    0.544952] DMI not present or invalid.
[    0.549075] NET: Registered protocol family 16
[    0.554527] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    0.562323] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.570821] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.578929] audit: initializing netlink subsys (disabled)
[    0.584460] audit: type=2000 audit(0.380:1): state=initialized audit_enabled=0 res=1
[    0.584853] thermal_sys: Registered thermal governor 'step_wise'
[    0.592294] thermal_sys: Registered thermal governor 'power_allocator'
[    0.598775] cpuidle: using governor menu
[    0.609531] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.616537] ASID allocator initialised with 32768 entries
[    0.622539] Serial: AMBA PL011 UART driver
[    0.626716] imx mu driver is registered.
[    0.630690] imx rpmsg driver is registered.
[    0.642020] Machine: SolidRun LX2160A Clearfog CX
[    0.646776] SoC family: QorIQ LX2160A
[    0.650471] SoC ID: svr:0x87360020, Revision: 2.0
[    0.655755] 21c0000.serial: ttyAMA0 at MMIO 0x21c0000 (irq = 25, base_baud = 0) is a SBSA
[    0.664029] printk: console [ttyAMA0] enabled
[    0.664029] printk: console [ttyAMA0] enabled
[    0.672769] printk: bootconsole [pl11] disabled
[    0.672769] printk: bootconsole [pl11] disabled
[    0.682071] 21d0000.serial: ttyAMA1 at MMIO 0x21d0000 (irq = 26, base_baud = 0) is a SBSA
[    0.692414] fsl_mc_bus 80c000000.fsl-mc: MC firmware version: 10.28.1
[    0.701396] fsl_mc_dprc dprc.1: DMA mask not set
[    0.718090] HugeTLB registered 1.00 GiB page size, pre-allocated 2 pages
[    0.724792] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[    0.731486] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.738177] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[    0.745730] cryptd: max_cpu_qlen set to 1000
[    0.818474] raid6: neonx8   gen()  6032 MB/s
[    0.890504] raid6: neonx8   xor()  4135 MB/s
[    0.962538] raid6: neonx4   gen()  5919 MB/s
[    1.034570] raid6: neonx4   xor()  4235 MB/s
[    1.106618] raid6: neonx2   gen()  5162 MB/s
[    1.178638] raid6: neonx2   xor()  4019 MB/s
[    1.250675] raid6: neonx1   gen()  3973 MB/s
[    1.322706] raid6: neonx1   xor()  3182 MB/s
[    1.394744] raid6: int64x8  gen()  3005 MB/s
[    1.466777] raid6: int64x8  xor()  1784 MB/s
[    1.538811] raid6: int64x4  gen()  3527 MB/s
[    1.610836] raid6: int64x4  xor()  1936 MB/s
[    1.682868] raid6: int64x2  gen()  3140 MB/s
[    1.754894] raid6: int64x2  xor()  1690 MB/s
[    1.826931] raid6: int64x1  gen()  2438 MB/s
[    1.898959] raid6: int64x1  xor()  1278 MB/s
[    1.903218] raid6: using algorithm neonx8 gen() 6032 MB/s
[    1.908606] raid6: .... xor() 4135 MB/s, rmw enabled
[    1.913559] raid6: using neon recovery algorithm
[    1.918416] ACPI: Interpreter disabled.
[    1.922959] iommu: Default domain type: Passthrough
[    1.927996] vgaarb: loaded
[    1.930831] SCSI subsystem initialized
[    1.934713] usbcore: registered new interface driver usbfs
[    1.940215] usbcore: registered new interface driver hub
[    1.945532] usbcore: registered new device driver usb
[    1.950773] imx-i2c 2000000.i2c: can't get pinctrl, bus recovery not supported
[    1.958142] i2c i2c-0: IMX I2C adapter registered
[    1.962957] imx-i2c 2020000.i2c: can't get pinctrl, bus recovery not supported
[    1.970217] i2c i2c-1: IMX I2C adapter registered
[    1.974985] imx-i2c 2040000.i2c: can't get pinctrl, bus recovery not supported
[    1.982277] i2c i2c-2: IMX I2C adapter registered
[    1.987190] mc: Linux media interface: v0.10
[    1.991460] videodev: Linux video capture interface: v2.00
[    1.996969] pps_core: LinuxPPS API ver. 1 registered
[    2.001924] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.011056] PTP clock support registered
[    2.015014] EDAC MC: Ver: 3.0.0
[    2.018616] No BMan portals available!
[    2.022507] QMan: Allocated lookup table at (____ptrval____), entry count 65537
[    2.029903] No QMan portals available!
[    2.033780] No USDPAA memory, no 'fsl,usdpaa-mem' in device-tree
[    2.039991] FPGA manager framework
[    2.043417] Advanced Linux Sound Architecture Driver Initialized.
[    2.050070] clocksource: Switched to clocksource arch_sys_counter
[    2.056259] VFS: Disk quotas dquot_6.6.0
[    2.060203] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    2.067150] pnp: PnP ACPI: disabled
[    2.073498] NET: Registered protocol family 2
[    2.078119] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    2.086984] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    2.095863] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[    2.103660] TCP: Hash tables configured (established 262144 bind 65536)
[    2.110368] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    2.117539] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    2.125234] NET: Registered protocol family 1
[    2.129772] RPC: Registered named UNIX socket transport module.
[    2.135694] RPC: Registered udp transport module.
[    2.140390] RPC: Registered tcp transport module.
[    2.145085] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    2.151520] PCI: CLS 0 bytes, default 64
[    2.156270] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    2.164579] kvm [1]: IPA Size Limit: 44 bits
[    2.169452] kvm [1]: vgic-v2@c0e0000
[    2.173034] kvm [1]: GIC system register CPU interface enabled
[    2.179045] kvm [1]: vgic interrupt IRQ9
[    2.183158] kvm [1]: Hyp mode initialized successfully
[    2.190284] workingset: timestamp_bits=42 max_order=23 bucket_order=0
[    2.197136] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    2.203090] NFS: Registering the id_resolver key type
[    2.208144] Key type id_resolver registered
[    2.212317] Key type id_legacy registered
[    2.216331] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    2.223023] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    2.230416] jffs2: version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
[    2.236607] fuse: init (API version 7.32)
[    2.240676] 9p: Installing v9fs 9p2000 file system support
[    2.265652] NET: Registered protocol family 38
[    2.270093] xor: measuring software checksum speed
[    2.275975]    8regs           :  8951 MB/sec
[    2.281407]    32regs          :  9060 MB/sec
[    2.286878]    arm64_neon      :  8769 MB/sec
[    2.291224] xor: using function: 32regs (9060 MB/sec)
[    2.296281] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    2.303721] io scheduler mq-deadline registered
[    2.308246] io scheduler kyber registered
[    2.316266] layerscape-pcie 3600000.pcie: host bridge /soc/pcie@3600000 ranges:
[    2.323581] layerscape-pcie 3600000.pcie:      MEM 0x9040000000..0x907fffffff -> 0x0040000000
[    2.332175] layerscape-pcie 3600000.pcie: PCI host bridge to bus 0000:00
[    2.338869] pci_bus 0000:00: root bus resource [bus 00-ff]
[    2.344348] pci_bus 0000:00: root bus resource [mem 0x9040000000-0x907fffffff] (bus address [0x40000000-0x7fffffff])
[    2.354876] pci 0000:00:00.0: [1957:8d80] type 01 class 0x060400
[    2.360928] pci 0000:00:00.0: supports D1 D2
[    2.365189] pci 0000:00:00.0: PME# supported from D0 D1 D2 D3hot
[    2.372179] pci 0000:01:00.0: [144d:a808] type 00 class 0x010802
[    2.378331] pci 0000:01:00.0: reg 0x10: [mem 0x9040000000-0x9040003fff 64bit]
[    2.387559] pci 0000:00:00.0: BAR 14: assigned [mem 0x9040000000-0x90400fffff]
[    2.394775] pci 0000:01:00.0: BAR 0: assigned [mem 0x9040000000-0x9040003fff 64bit]
[    2.402486] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    2.407703] pci 0000:00:00.0:   bridge window [mem 0x9040000000-0x90400fffff]
[    2.414837] pci 0000:00:00.0: Max Payload Size set to  256/ 256 (was  128), Max Read Rq  256
[    2.423356] pci 0000:01:00.0: Max Payload Size set to  256/ 256 (was  128), Max Read Rq  256
[    2.431906] layerscape-pcie 3800000.pcie: host bridge /soc/pcie@3800000 ranges:
[    2.439228] layerscape-pcie 3800000.pcie:      MEM 0xa040000000..0xa07fffffff -> 0x0040000000
[    2.447829] layerscape-pcie 3800000.pcie: PCI host bridge to bus 0001:00
[    2.454523] pci_bus 0001:00: root bus resource [bus 00-ff]
[    2.460000] pci_bus 0001:00: root bus resource [mem 0xa040000000-0xa07fffffff] (bus address [0x40000000-0x7fffffff])
[    2.470525] pci 0001:00:00.0: [1957:8d80] type 01 class 0x060400
[    2.476594] pci 0001:00:00.0: supports D1 D2
[    2.480855] pci 0001:00:00.0: PME# supported from D0 D1 D2 D3hot
[    2.488319] pci 0001:00:00.0: PCI bridge to [bus 01-ff]
[    2.493551] pci 0001:00:00.0: Max Payload Size set to  256/ 256 (was  128), Max Read Rq  256
[    2.502500] EINJ: ACPI disabled.
[    2.508587] Bus freq driver module loaded
[    2.515465] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    2.522614] SuperH (H)SCI(F) driver initialized
[    2.527329] msm_serial: driver initialized
[    2.532162] arm-smmu 5000000.iommu: probing hardware configuration...
[    2.538598] arm-smmu 5000000.iommu: SMMUv2 with:
[    2.543205] arm-smmu 5000000.iommu:  stage 1 translation
[    2.548507] arm-smmu 5000000.iommu:  stage 2 translation
[    2.553808] arm-smmu 5000000.iommu:  nested translation
[    2.559023] arm-smmu 5000000.iommu:  coherent table walk
[    2.564325] arm-smmu 5000000.iommu:  (IDR0.CTTW overridden by FW configuration)
[    2.571624] arm-smmu 5000000.iommu:  stream matching with 128 register groups
[    2.578750] arm-smmu 5000000.iommu:  64 context banks (0 stage-2 only)
[    2.585279] arm-smmu 5000000.iommu:  Supported page sizes: 0x61311000
[    2.591710] arm-smmu 5000000.iommu:  Stage-1: 48-bit VA -> 48-bit IPA
[    2.598140] arm-smmu 5000000.iommu:  Stage-2: 48-bit IPA -> 48-bit PA
[    2.610239] brd: module loaded
[    2.617587] loop: module loaded
[    2.620867] pci-endpoint-test 0000:00:00.0: Adding to iommu group 0
[    2.627220] pci-endpoint-test 0001:00:00.0: Adding to iommu group 1
[    2.633893] megasas: 07.714.04.00-rc1
[    2.637982] nvme 0000:01:00.0: Adding to iommu group 0
[    2.643234] nvme nvme0: pci function 0000:01:00.0
[    2.648126] imx ahci driver is registered.
[    2.652365] ahci-qoriq 3200000.sata: supply ahci not found, using dummy regulator
[    2.659889] ahci-qoriq 3200000.sata: supply phy not found, using dummy regulator
[    2.667298] ahci-qoriq 3200000.sata: supply target not found, using dummy regulator
[    2.675006] ahci-qoriq 3200000.sata: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl platform mode
[    2.683958] ahci-qoriq 3200000.sata: flags: 64bit ncq sntf pm clo only pmp fbs pio slum part ccc sds apst
[    2.694205] scsi host0: ahci-qoriq
[    2.697685] ata1: SATA max UDMA/133 mmio [mem 0x03200000-0x0320ffff] port 0x100 irq 33
[    2.705653] ahci-qoriq 3210000.sata: supply ahci not found, using dummy regulator
[    2.713170] ahci-qoriq 3210000.sata: supply phy not found, using dummy regulator
[    2.720576] ahci-qoriq 3210000.sata: supply target not found, using dummy regulator
[    2.728273] ahci-qoriq 3210000.sata: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl platform mode
[    2.737224] ahci-qoriq 3210000.sata: flags: 64bit ncq sntf pm clo only pmp fbs pio slum part ccc sds apst
[    2.747114] scsi host1: ahci-qoriq
[    2.750586] ata2: SATA max UDMA/133 mmio [mem 0x03210000-0x0321ffff] port 0x100 irq 34
[    2.758545] ahci-qoriq 3220000.sata: supply ahci not found, using dummy regulator
[    2.766066] ahci-qoriq 3220000.sata: supply phy not found, using dummy regulator
[    2.773471] ahci-qoriq 3220000.sata: supply target not found, using dummy regulator
[    2.781167] ahci-qoriq 3220000.sata: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl platform mode
[    2.790118] ahci-qoriq 3220000.sata: flags: 64bit ncq sntf pm clo only pmp fbs pio slum part ccc sds apst
[    2.800023] scsi host2: ahci-qoriq
[    2.803489] ata3: SATA max UDMA/133 mmio [mem 0x03220000-0x0322ffff] port 0x100 irq 35
[    2.811447] ahci-qoriq 3230000.sata: supply ahci not found, using dummy regulator
[    2.818961] ahci-qoriq 3230000.sata: supply phy not found, using dummy regulator
[    2.826369] ahci-qoriq 3230000.sata: supply target not found, using dummy regulator
[    2.834067] ahci-qoriq 3230000.sata: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl platform mode
[    2.843017] ahci-qoriq 3230000.sata: flags: 64bit ncq sntf pm clo only pmp fbs pio slum part ccc sds apst
[    2.852905] scsi host3: ahci-qoriq
[    2.856372] ata4: SATA max UDMA/133 mmio [mem 0x03230000-0x0323ffff] port 0x100 irq 36
[    2.865353] spi-nor spi0.0: found mt35xu512aba, expected m25p80
[    2.871300] spi-nor spi0.0: mt35xu512aba (65536 Kbytes)
[    2.879379] libphy: Fixed MDIO Bus: probed
[    2.884031] tun: Universal TUN/TAP device driver, 1.6
[    2.889362] thunder_xcv, ver 1.0
[    2.892597] thunder_bgx, ver 1.0
[    2.895832] nicpf, ver 1.0
[    2.898798] libphy: Freescale XGMAC MDIO Bus: probed
[    2.904419] libphy: Freescale XGMAC MDIO Bus: probed
[    2.909443] Freescale FM module, FMD API version 21.1.0
[    2.914714] Freescale FM Ports module
[    2.918368] fsl_mac: fsl_mac: FSL FMan MAC API based driver
[    2.923971] fsl_dpa: FSL DPAA Ethernet driver
[    2.928351] fsl_advanced: FSL DPAA Advanced drivers:
[    2.933306] fsl_proxy: FSL DPAA Proxy initialization driver
[    2.938914] fsl_oh: FSL FMan Offline Parsing port driver
[    2.944516] hclge is initializing
[    2.947835] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    2.955046] hns3: Copyright (c) 2017 Huawei Corporation.
[    2.960368] e1000: Intel(R) PRO/1000 Network Driver
[    2.965236] e1000: Copyright (c) 1999-2006 Intel Corporation.
[    2.970989] e1000e: Intel(R) PRO/1000 Network Driver
[    2.975944] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    2.981871] igb: Intel(R) Gigabit Ethernet Network Driver
[    2.987260] igb: Copyright (c) 2007-2014 Intel Corporation.
[    2.992834] igbvf: Intel(R) Gigabit Virtual Function Network Driver
[    2.999092] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    3.005125] sky2: driver version 1.30
[    3.009161] usbcore: registered new interface driver r8152
[    3.014650] usbcore: registered new interface driver asix
[    3.020051] usbcore: registered new interface driver ax88179_178a
[    3.020218] ata1: SATA link down (SStatus 0 SControl 300)
[    3.026178] usbcore: registered new interface driver cdc_ether
[    3.037369] usbcore: registered new interface driver net1080
[    3.043031] usbcore: registered new interface driver cdc_subset
[    3.048951] usbcore: registered new interface driver zaurus
[    3.054529] usbcore: registered new interface driver cdc_ncm
[    3.060386] VFIO - User Level meta-driver version: 0.3
[    3.066865] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.072191] ata2: SATA link down (SStatus 0 SControl 300)
[    3.073389] ehci-pci: EHCI PCI platform driver
[    3.083220] ehci-platform: EHCI generic platform driver
[    3.088485] ehci-orion: EHCI orion driver
[    3.092521] ehci-exynos: EHCI Exynos driver
[    3.096727] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    3.102905] ohci-pci: OHCI PCI platform driver
[    3.107355] ohci-platform: OHCI generic platform driver
[    3.112612] ohci-exynos: OHCI Exynos driver
[    3.116955] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
[    3.122442] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 1
[    3.124224] ata3: SATA link down (SStatus 0 SControl 300)
[    3.130156] xhci-hcd xhci-hcd.0.auto: hcc params 0x0220f66d hci version 0x100 quirks 0x0000000002010810
[    3.144883] xhci-hcd xhci-hcd.0.auto: irq 31, io mem 0x03100000
[    3.151094] hub 1-0:1.0: USB hub found
[    3.154846] hub 1-0:1.0: 1 port detected
[    3.158872] xhci-hcd xhci-hcd.0.auto: xHCI Host Controller
[    3.164354] xhci-hcd xhci-hcd.0.auto: new USB bus registered, assigned bus number 2
[    3.172004] xhci-hcd xhci-hcd.0.auto: Host supports USB 3.0 SuperSpeed
[    3.176190] ata4: SATA link down (SStatus 0 SControl 300)
[    3.178722] hub 2-0:1.0: USB hub found
[    3.187660] hub 2-0:1.0: 1 port detected
[    3.191730] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
[    3.197213] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 3
[    3.204915] xhci-hcd xhci-hcd.1.auto: hcc params 0x0220f66d hci version 0x100 quirks 0x0000000002010810
[    3.214314] xhci-hcd xhci-hcd.1.auto: irq 32, io mem 0x03110000
[    3.220474] hub 3-0:1.0: USB hub found
[    3.224227] hub 3-0:1.0: 1 port detected
[    3.228242] xhci-hcd xhci-hcd.1.auto: xHCI Host Controller
[    3.233724] xhci-hcd xhci-hcd.1.auto: new USB bus registered, assigned bus number 4
[    3.241375] xhci-hcd xhci-hcd.1.auto: Host supports USB 3.0 SuperSpeed
[    3.248085] hub 4-0:1.0: USB hub found
[    3.251838] hub 4-0:1.0: 1 port detected
[    3.255980] usbcore: registered new interface driver cdc_acm
[    3.261632] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters
[    3.269710] usbcore: registered new interface driver uas
[    3.275046] usbcore: registered new interface driver usb-storage
[    3.281076] usbcore: registered new interface driver usbserial_generic
[    3.287602] usbserial: USB Serial support registered for generic
[    3.293612] usbcore: registered new interface driver ftdi_sio
[    3.299358] usbserial: USB Serial support registered for FTDI USB Serial Device
[    3.306701] usbcore: registered new interface driver usb_serial_simple
[    3.313224] usbserial: USB Serial support registered for carelink
[    3.319314] usbserial: USB Serial support registered for zio
[    3.324970] usbserial: USB Serial support registered for funsoft
[    3.330978] usbserial: USB Serial support registered for flashloader
[    3.337329] usbserial: USB Serial support registered for google
[    3.343249] usbserial: USB Serial support registered for libtransistor
[    3.349773] usbserial: USB Serial support registered for vivopay
[    3.355775] usbserial: USB Serial support registered for moto_modem
[    3.362041] usbserial: USB Serial support registered for motorola_tetra
[    3.368652] usbserial: USB Serial support registered for novatel_gps
[    3.375002] usbserial: USB Serial support registered for hp4x
[    3.380745] usbserial: USB Serial support registered for suunto
[    3.386661] usbserial: USB Serial support registered for siemens_mpi
[    3.394209] ftm-alarm 2800000.timer: registered as rtc1
[    3.399773] i2c /dev entries driver
[    3.404682] i2c i2c-0: Added multiplexed i2c bus 3
[    3.409607] i2c i2c-0: Added multiplexed i2c bus 4
[    3.414530] i2c i2c-0: Added multiplexed i2c bus 5
[    3.419476] i2c i2c-0: Added multiplexed i2c bus 6
[    3.424338] i2c i2c-0: Added multiplexed i2c bus 7
[    3.429199] i2c i2c-0: Added multiplexed i2c bus 8
[    3.434058] i2c i2c-0: Added multiplexed i2c bus 9
[    3.438922] i2c i2c-0: Added multiplexed i2c bus 10
[    3.443795] pca954x 0-0077: registered 8 multiplexed busses for I2C mux pca9547
[    3.455892] amc6821 4-0018: Revision 3
[    3.490690] random: fast init done
[    3.562075] usb 3-1: new high-speed USB device number 2 using xhci-hcd
[    3.759936] hub 3-1:1.0: USB hub found
[    3.763701] hub 3-1:1.0: 4 ports detected
[    3.842093] usb 4-1: new SuperSpeed Gen 1 USB device number 2 using xhci-hcd
[    3.871748] sbsa-gwdt 23a0000.watchdog: Initialized with 30s timeout @ 25000050 Hz, action=0. [enabled]
[    3.883190] qoriq-cpufreq qoriq-cpufreq: Freescale QorIQ CPU frequency scaling driver
[    3.891886] sdhci: Secure Digital Host Controller Interface driver
[    3.898081] sdhci: Copyright(c) Pierre Ossman
[    3.902637] Synopsys Designware Multimedia Card Interface Driver
[    3.908998] sdhci-pltfm: SDHCI platform and OF driver helper
[    3.915779] SMCCC: SOC_ID: ARCH_SOC_ID not implemented, skipping ....
[    3.919973] hub 4-1:1.0: USB hub found
[    3.922362] usbcore: registered new interface driver usbhid
[    3.926142] hub 4-1:1.0: 4 ports detected
[    3.931532] usbhid: USB HID core driver
[    3.938611] mmc0: SDHCI controller on 2140000.esdhc [2140000.esdhc] using ADMA 64-bit
[    3.939905] No fsl,qman node
[    3.941022] mmc1: SDHCI controller on 2150000.esdhc [2150000.esdhc] using ADMA 64-bit
[    3.957860] Freescale USDPAA process driver
[    3.962040] fsl-usdpaa: no region found
[    3.965867] Freescale USDPAA process IRQ driver
[    3.971894] optee: probing for conduit method.
[    3.976333] optee: api uid mismatch
[    3.979828] optee: probe of firmware:optee failed with error -22
[    3.988335] pktgen: Packet Generator for packet performance testing. Version: 2.75
[    3.997461] NET: Registered protocol family 26
[    4.001938] u32 classifier
[    4.004655]     input device check on
[    4.008308]     Actions configured
[    4.012149] Initializing XFRM netlink socket
[    4.016460] NET: Registered protocol family 10
[    4.021260] Segment Routing with IPv6
[    4.024962] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    4.031098] NET: Registered protocol family 17
[    4.035543] NET: Registered protocol family 15
[    4.036651] mmc1: new HS400 MMC card at address 0001
[    4.040008] Bridge firewalling registered
[    4.045269] mmcblk1: mmc1:0001 DG4064 59.2 GiB
[    4.049105] 8021q: 802.1Q VLAN Support v1.8
[    4.053619] mmcblk1boot0: mmc1:0001 DG4064 partition 1 4.00 MiB
[    4.057661] lib80211: common routines for IEEE802.11 drivers
[    4.063702] mmcblk1boot1: mmc1:0001 DG4064 partition 2 4.00 MiB
[    4.075151] 9pnet: Installing 9P2000 support
[    4.075194] mmcblk1rpmb: mmc1:0001 DG4064 partition 3 4.00 MiB, chardev (507:0)
[    4.079437] tsn generic netlink module v1 init...
[    4.087641]  mmcblk1: p1
[    4.091454] Key type dns_resolver registered
[    4.098429] registered taskstats version 1
[    4.103290] Btrfs loaded, crc32c=crc32c-generic
[    4.109491] fsl_mc_dprc dprc.1: Adding to iommu group 2
[    4.116073] mmc0: new ultra high speed SDR50 SDHC card at address aaaa
[    4.122602] usb 3-1.3: new high-speed USB device number 3 using xhci-hcd
[    4.129662] mmcblk0: mmc0:aaaa SL08G 7.40 GiB
[    4.135217]  mmcblk0: p1
[    4.168604] fsl_mc_allocator dpbp.1: Adding to iommu group 2
[    4.174334] fsl_mc_allocator dpbp.0: Adding to iommu group 2
[    4.181062] fsl_mc_allocator dpmcp.35: Adding to iommu group 2
[    4.187458] fsl_mc_allocator dpmcp.34: Adding to iommu group 2
[    4.193850] fsl_mc_allocator dpmcp.33: Adding to iommu group 2
[    4.200242] fsl_mc_allocator dpmcp.32: Adding to iommu group 2
[    4.206644] fsl_mc_allocator dpmcp.31: Adding to iommu group 2
[    4.213045] fsl_mc_allocator dpmcp.30: Adding to iommu group 2
[    4.219437] fsl_mc_allocator dpmcp.29: Adding to iommu group 2
[    4.225831] fsl_mc_allocator dpmcp.28: Adding to iommu group 2
[    4.232224] fsl_mc_allocator dpmcp.27: Adding to iommu group 2
[    4.238628] fsl_mc_allocator dpmcp.26: Adding to iommu group 2
[    4.245025] fsl_mc_allocator dpmcp.25: Adding to iommu group 2
[    4.251416] fsl_mc_allocator dpmcp.24: Adding to iommu group 2
[    4.257809] fsl_mc_allocator dpmcp.23: Adding to iommu group 2
[    4.264204] fsl_mc_allocator dpmcp.22: Adding to iommu group 2
[    4.270601] fsl_mc_allocator dpmcp.21: Adding to iommu group 2
[    4.271934] hub 3-1.3:1.0: USB hub found
[    4.277001] fsl_mc_allocator dpmcp.20: Adding to iommu group 2
[    4.280408] hub 3-1.3:1.0: 4 ports detected
[    4.286750] fsl_mc_allocator dpmcp.19: Adding to iommu group 2
[    4.296755] fsl_mc_allocator dpmcp.18: Adding to iommu group 2
[    4.303146] fsl_mc_allocator dpmcp.17: Adding to iommu group 2
[    4.309541] fsl_mc_allocator dpmcp.16: Adding to iommu group 2
[    4.315941] fsl_mc_allocator dpmcp.15: Adding to iommu group 2
[    4.322347] fsl_mc_allocator dpmcp.14: Adding to iommu group 2
[    4.328739] fsl_mc_allocator dpmcp.13: Adding to iommu group 2
[    4.335133] fsl_mc_allocator dpmcp.12: Adding to iommu group 2
[    4.341529] fsl_mc_allocator dpmcp.11: Adding to iommu group 2
[    4.347923] fsl_mc_allocator dpmcp.10: Adding to iommu group 2
[    4.354323] fsl_mc_allocator dpmcp.9: Adding to iommu group 2
[    4.360631] fsl_mc_allocator dpmcp.8: Adding to iommu group 2
[    4.366939] fsl_mc_allocator dpmcp.7: Adding to iommu group 2
[    4.373250] fsl_mc_allocator dpmcp.6: Adding to iommu group 2
[    4.379558] fsl_mc_allocator dpmcp.5: Adding to iommu group 2
[    4.385866] fsl_mc_allocator dpmcp.4: Adding to iommu group 2
[    4.392174] fsl_mc_allocator dpmcp.3: Adding to iommu group 2
[    4.398488] fsl_mc_allocator dpmcp.2: Adding to iommu group 2
[    4.404794] fsl_mc_allocator dpmcp.1: Adding to iommu group 2
[    4.410602] fsl_mc_allocator dpcon.31: Adding to iommu group 2
[    4.416495] fsl_mc_allocator dpcon.30: Adding to iommu group 2
[    4.422398] fsl_mc_allocator dpcon.29: Adding to iommu group 2
[    4.428292] fsl_mc_allocator dpcon.28: Adding to iommu group 2
[    4.434186] fsl_mc_allocator dpcon.27: Adding to iommu group 2
[    4.440079] fsl_mc_allocator dpcon.26: Adding to iommu group 2
[    4.445981] fsl_mc_allocator dpcon.25: Adding to iommu group 2
[    4.451877] fsl_mc_allocator dpcon.24: Adding to iommu group 2
[    4.457779] fsl_mc_allocator dpcon.23: Adding to iommu group 2
[    4.463674] fsl_mc_allocator dpcon.22: Adding to iommu group 2
[    4.469569] fsl_mc_allocator dpcon.21: Adding to iommu group 2
[    4.475465] fsl_mc_allocator dpcon.20: Adding to iommu group 2
[    4.481360] fsl_mc_allocator dpcon.19: Adding to iommu group 2
[    4.487254] fsl_mc_allocator dpcon.18: Adding to iommu group 2
[    4.493149] fsl_mc_allocator dpcon.17: Adding to iommu group 2
[    4.499044] fsl_mc_allocator dpcon.16: Adding to iommu group 2
[    4.504940] fsl_mc_allocator dpcon.15: Adding to iommu group 2
[    4.510836] fsl_mc_allocator dpcon.14: Adding to iommu group 2
[    4.516731] fsl_mc_allocator dpcon.13: Adding to iommu group 2
[    4.522628] fsl_mc_allocator dpcon.12: Adding to iommu group 2
[    4.528533] fsl_mc_allocator dpcon.11: Adding to iommu group 2
[    4.534429] fsl_mc_allocator dpcon.10: Adding to iommu group 2
[    4.540327] fsl_mc_allocator dpcon.9: Adding to iommu group 2
[    4.546138] fsl_mc_allocator dpcon.8: Adding to iommu group 2
[    4.551950] fsl_mc_allocator dpcon.7: Adding to iommu group 2
[    4.557761] fsl_mc_allocator dpcon.6: Adding to iommu group 2
[    4.563571] fsl_mc_allocator dpcon.5: Adding to iommu group 2
[    4.569382] fsl_mc_allocator dpcon.4: Adding to iommu group 2
[    4.575192] fsl_mc_allocator dpcon.3: Adding to iommu group 2
[    4.581003] fsl_mc_allocator dpcon.2: Adding to iommu group 2
[    4.586816] fsl_mc_allocator dpcon.1: Adding to iommu group 2
[    4.592628] fsl_mc_allocator dpcon.0: Adding to iommu group 2
[    4.598443] fsl_dpaa2_eth dpni.0: Adding to iommu group 2
[    4.674180] fsl_dpaa2_mac dpmac.17: Adding to iommu group 2
[    4.680346] fsl_dpaa2_mac dpmac.10: Adding to iommu group 2
[    4.690813] fsl_dpaa2_mac dpmac.9: Adding to iommu group 2
[    4.700796] fsl_dpaa2_mac dpmac.8: Adding to iommu group 2
[    4.711169] fsl_dpaa2_mac dpmac.7: Adding to iommu group 2
[    4.721455] fsl_dpaa2_mac dpmac.6: Adding to iommu group 2
[    4.731731] fsl_dpaa2_mac dpmac.5: Adding to iommu group 2
[    4.741838] fsl_dpaa2_mac dpmac.4: Adding to iommu group 2
[    4.752115] fsl_dpaa2_mac dpmac.3: Adding to iommu group 2
[    4.762433] fsl_dpaa2_ptp dprtc.0: Adding to iommu group 2
[    4.770128] ptp_qoriq: device tree node missing required elements, try automatic configuration
[    4.778829] pps pps0: new PPS source ptp0
[    4.784520] fsl_mc_dpio dpio.15: Adding to iommu group 2
[    4.793445] fsl_mc_dpio dpio.15: probed
[    4.799372] fsl_mc_dpio dpio.14: Adding to iommu group 2
[    4.808320] fsl_mc_dpio dpio.14: probed
[    4.814344] fsl_mc_dpio dpio.13: Adding to iommu group 2
[    4.823282] fsl_mc_dpio dpio.13: probed
[    4.829201] fsl_mc_dpio dpio.12: Adding to iommu group 2
[    4.838117] fsl_mc_dpio dpio.12: probed
[    4.844030] fsl_mc_dpio dpio.11: Adding to iommu group 2
[    4.852639] fsl_mc_dpio dpio.11: probed
[    4.858564] fsl_mc_dpio dpio.10: Adding to iommu group 2
[    4.867473] fsl_mc_dpio dpio.10: probed
[    4.873332] fsl_mc_dpio dpio.9: Adding to iommu group 2
[    4.882167] fsl_mc_dpio dpio.9: probed
[    4.887993] fsl_mc_dpio dpio.8: Adding to iommu group 2
[    4.896818] fsl_mc_dpio dpio.8: probed
[    4.902658] fsl_mc_dpio dpio.7: Adding to iommu group 2
[    4.911524] fsl_mc_dpio dpio.7: probed
[    4.917446] fsl_mc_dpio dpio.6: Adding to iommu group 2
[    4.926298] fsl_mc_dpio dpio.6: probed
[    4.932124] fsl_mc_dpio dpio.5: Adding to iommu group 2
[    4.940947] fsl_mc_dpio dpio.5: probed
[    4.946786] fsl_mc_dpio dpio.4: Adding to iommu group 2
[    4.955645] fsl_mc_dpio dpio.4: probed
[    4.961570] fsl_mc_dpio dpio.3: Adding to iommu group 2
[    4.970417] fsl_mc_dpio dpio.3: probed
[    4.976248] fsl_mc_dpio dpio.2: Adding to iommu group 2
[    4.985067] fsl_mc_dpio dpio.2: probed
[    4.990908] fsl_mc_dpio dpio.1: Adding to iommu group 2
[    4.999772] fsl_mc_dpio dpio.1: probed
[    5.005699] fsl_mc_dpio dpio.0: Adding to iommu group 2
[    5.014547] fsl_mc_dpio dpio.0: probed
[    5.021943] fsl_mc_dprc dprc.1: DPRC device bound to driver
[    5.027662] pcieport 0000:00:00.0: PME: Signaling with IRQ 37
[    5.033562] pcieport 0001:00:00.0: PME: Signaling with IRQ 38
[    5.275283] fsl_dpaa2_eth dpni.0 (unnamed net_device) (uninitialized): PHY [0x0000000008b96000:01] driver [Qualcomm Atheros AR8035] (irq=POLL)
[    5.289135] fsl_dpaa2_eth dpni.0: Probed interface eth0
[    5.296327] ALSA device list:
[    5.299313]   No soundcards found.
[   64.690128] nvme nvme0: I/O 0 QID 0 timeout, completion polled
5

Thanks. Just to be clear you are booting the same kernel and OS version, the only difference is the bootloader?

6

I’m trying to run the same software (kernel, OS, bootloader) that is in the lx2160a_build (commit a393e2e73e833227f047cf4c718c023b894988e8) without any changes. On a Linux reboot the same boot sequence and software should be used, right?

I flashed the lx2160a_build software both onto the eMMC and the NVMe device (1 TB SSD) based on information from the Quick Start Guide.

7

Most likely you are seeing an issue changing kernel revisions. The kernel code for NVMe support has been changing quite a lot adding more advanced features, however has also triggered additional issues with certain NVMe devices. The errors reported above coincide with issues seen on many NVMe drives and their APST implementation. You can try adding nvme_core.default_ps_max_latency_us=0 to your kernel commandline bootargs and see if it helps with the issues you are seeing.

8

The memory I have is Samsung 970 PRO: MZ-V7P1T0BW (1,024 GB).

Unfortunately the change didn’t seem to work (I tried updating both the bootargs variable and the extlinux.conf). I’ve seen some mentions of being able to upgrade the firmware on the SSDs, but I cannot currently do this since the magician software for upgrading the SSD runs on either Windows or an x86, not for an arm (HoneyComb).

When I do a diff of with and without the parameter change, nothing from the console seems to change except reporting the parameter difference:

Retrieving file: /extlinux/extlinux.conf
369 bytes read in 9 ms (40 KiB/s)
1:      primary kernel
Retrieving file: /boot/Image
41406976 bytes read in 1911 ms (20.7 MiB/s)
append: console=ttyAMA0,115200 earlycon=pl011,mmio32,0x21c0000 default_hugepagesz=1024m hugepagesz=1024m hugepages=2 pci=pcie_bus_perf nvme_core.default_ps_max_latency_us=0 root=PARTUUID=30303030-01 rw rootwait
9

unfortunately this is a pretty common report for the Samsung Pro NVMe devices. As you said Samsung has released an updated firmware to help address some of the issues. This is not necessarily an LX2160a only issue as the bug reports also coincide with other x86_64 motherboards and other NVMe devices as well. Most likely new code has been added between 5.4 and 5.10 kernels which is triggering the issue.

If you would like to test a newer kernel then you can flash one of our SystemReady ES firmware images onto SDHC and then boot a recent generic distro like Fedora 35 or Ubuntu Server 21 to see if the issue has been resolved. You can reference this video for specifics on booting a standard image with the existing UEFI firmware, SolidRun DevCuts - HoneyComb Distro Install - YouTube