mbox series

[v2,0/4] ARM: decompressor: use by-VA cache maintenance for v7 cores

Message ID 20200219094340.16597-1-ardb@kernel.org (mailing list archive)
Headers show
Series ARM: decompressor: use by-VA cache maintenance for v7 cores | expand

Message

Ard Biesheuvel Feb. 19, 2020, 9:43 a.m. UTC 
While making changes to the EFI stub startup code, I noticed that we are
still doing set/way maintenance on the caches when booting on v7 cores.
This works today on VMs by virtue of the fact that KVM traps set/way ops
and cleans the whole address space by VA on behalf of the guest, and on
most v7 hardware, the set/way ops are in fact sufficient when only one
core is running, as there usually is no system cache. But on systems
like SynQuacer, for which 32-bit firmware is available, the current cache
maintenance only pushes the data out to the L3 system cache, where it
is not visible to the CPU once it turns the MMU and caches off.

So instead, switch to the by-VA cache maintenance that the architecture
requires for v7 and later (and ARM1176, as a side effect).

Changes since v1:
- include the EFI patch that was sent out separately before (#1)
- split the preparatory work to pass the region to clean in r0/r1 in a EFI
  specific one and one for the decompressor - this way, the first two patches
  can go on a stable branch that is shared between the ARM tree and the EFI
  tree
- document the meaning of the values in r0/r1 upon entry to cache_clean_flush
- take care to treat the region end address as exclusive
- switch to clean+invalidate to align with the other implementations
- drop some code that manages the stack pointer value before calling 
  cache_clean_flush(), which is no longer necessary
- take care to clean the entire region that is covered by the relocated zImage
  if it needs to relocate itself before decompressing

https://git.kernel.org/pub/scm/linux/kernel/git/ardb/linux.git/log/?h=arm32-efi-cache-ops

Cc: Russell King <linux@armlinux.org.uk>
Cc: Marc Zyngier <maz@kernel.org>
Cc: Nicolas Pitre <nico@fluxnic.net>
Cc: Catalin Marinas <catalin.marinas@arm.com>
Cc: Tony Lindgren <tony@atomide.com>

Ard Biesheuvel (4):
  efi/arm: work around missing cache maintenance in decompressor
    handover
  efi/arm: pass start and end addresses to cache_clean_flush()
  ARM: decompressor: prepare cache_clean_flush for doing by-VA
    maintenance
  ARM: decompressor: switch to by-VA cache maintenance for v7 cores

 arch/arm/boot/compressed/head.S | 133 +++++++++++---------
 1 file changed, 74 insertions(+), 59 deletions(-)

Comments

Ard Biesheuvel Feb. 20, 2020, 6:08 p.m. UTC | #1 
(+ Arnd)

On Wed, 19 Feb 2020 at 10:43, Ard Biesheuvel <ardb@kernel.org> wrote:
>
> While making changes to the EFI stub startup code, I noticed that we are
> still doing set/way maintenance on the caches when booting on v7 cores.
> This works today on VMs by virtue of the fact that KVM traps set/way ops
> and cleans the whole address space by VA on behalf of the guest, and on
> most v7 hardware, the set/way ops are in fact sufficient when only one
> core is running, as there usually is no system cache. But on systems
> like SynQuacer, for which 32-bit firmware is available, the current cache
> maintenance only pushes the data out to the L3 system cache, where it
> is not visible to the CPU once it turns the MMU and caches off.
>
> So instead, switch to the by-VA cache maintenance that the architecture
> requires for v7 and later (and ARM1176, as a side effect).
>
> Changes since v1:
> - include the EFI patch that was sent out separately before (#1)
> - split the preparatory work to pass the region to clean in r0/r1 in a EFI
>   specific one and one for the decompressor - this way, the first two patches
>   can go on a stable branch that is shared between the ARM tree and the EFI
>   tree
> - document the meaning of the values in r0/r1 upon entry to cache_clean_flush
> - take care to treat the region end address as exclusive
> - switch to clean+invalidate to align with the other implementations
> - drop some code that manages the stack pointer value before calling
>   cache_clean_flush(), which is no longer necessary
> - take care to clean the entire region that is covered by the relocated zImage
>   if it needs to relocate itself before decompressing
>
> https://git.kernel.org/pub/scm/linux/kernel/git/ardb/linux.git/log/?h=arm32-efi-cache-ops
>

Adding my own data point here: with these patches, I can reproducibly
boot on the SynQuacer platform (24x Cortex-A53 + GICv3 + L3 system
cache) until the point where /init is loaded, after which it hangs
(see below), whereas without them, it always crashes early with weird,
unreproducible errors, if it even makes it far enough through the
decompressor to produce any earlycon output.

There is some other weird stuff going on, but this is unlikely to be
related to cache maintenance:
- multiple occurrences of
   OF: translation of DMA address(0) to CPU address failed node(...)
- /cpus/cpu@0: unsupported enable-method property: psci

Then, there is not enough vmalloc space to map the config space of
both PCIe RCs.

Also, due to the fact that this platform sadly honours the ARM
recommendation on memory maps, it seems there is no way to make useful
use of any memory beyond 2 GB, given that the hole between the lower 2
GB and the upper <30 GB eats up all the lowmem by being covered by the
memmap[] array. (Note that this platform supports up to 64 GB, in
which case another hole of 480 GB is created, so there is no way we
can even boot with that much memory reported to the kernel)


Shell> initrd initrd.gz
Shell> zImage
EFI stub: Booting Linux Kernel...
EFI stub: Using DTB from configuration table
EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
EFI stub: Exiting boot services and installing virtual address map...
[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Linux version 5.6.0-rc1-00084-g8602a0ff0200-dirty
(ardbie01@e123331-lin) (gcc version 7.4.0 (Ubuntu/Linaro
7.4.0-1ubuntu1~18.04.1)) #286 SMP Thu Feb 20 17:49:59 CET 2020
[    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=70c5383d
[    0.000000] CPU: div instructions available: patching division code
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing
instruction cache
[    0.000000] OF: fdt: Machine model: Socionext Developer Box
[    0.000000] Memory policy: Data cache writealloc
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi:  SMBIOS 3.0=0xffa1c000  MEMATTR=0xfd0b4010
ESRT=0xfdfbb910  MEMRESERVE=0xf8f2d010
[    0.000000] OF: fdt: Ignoring memory block 0x880000000 - 0x1000000000
[    0.000000] esrt: Reserving ESRT space from 0x00000000fdfbb910 to
0x00000000fdfbb948.
[    0.000000] cma: Reserved 64 MiB at 0x00000000f9000000
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.0
[    0.000000] percpu: Embedded 20 pages/cpu s49356 r8192 d24372 u81920
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 522368
[    0.000000] Kernel command line: zImage
[    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] printk: log_buf_len total cpu_extra contributions: 94208 bytes
[    0.000000] printk: log_buf_len min size: 131072 bytes
[    0.000000] printk: log_buf_len: 262144 bytes
[    0.000000] printk: early log buf free: 128828(98%)
[    0.000000] Dentry cache hash table entries: 131072 (order: 7,
524288 bytes, linear)
[    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144
bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0xaa90c000-0xae90c000] (64MB)
[    0.000000] Memory: 1886672K/2097152K available (10240K kernel
code, 1811K rwdata, 5392K rodata, 2048K init, 414K bss, 144944K
reserved, 65536K cma-reserved, 1233168K highmem)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay
is 10 jiffies.
[    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[    0.000000] GICv3: 640 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: no VLPI support, no direct LPI support, no RVPEID support
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000030400000
[    0.000000] ITS [mem 0x30020000-0x3003ffff]
[    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
[    0.000000] ITS@0x0000000030020000: allocated 524288 Devices
@aa400000 (flat, esz 8, psz 64K, shr 0)
[    0.000000] ITS: using cache flushing for cmd queue
[    0.000000] GICv3: using LPI property table @0x00000000aa080000
[    0.000000] GIC: using cache flushing for LPI property table
[    0.000000] GICv3: CPU0: using allocated LPI pending table
@0x00000000aa090000
[    0.000000] random: get_random_bytes called from
start_kernel+0x469/0x5ca with crng_init=0
[    0.000000] arch_timer: cp15 and mmio timer(s) running at 100.00MHz
(virt/phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
max_cycles: 0x171024e7e0, max_idle_ns: 440795205315 ns
[    0.000004] sched_clock: 56 bits at 100MHz, resolution 10ns, wraps
every 4398046511100ns
[    0.000013] Switching to timer-based delay loop, resolution 10ns
[    0.000890] Console: colour dummy device 80x30
[    0.001344] printk: console [tty0] enabled
[    0.001389] Calibrating delay loop (skipped), value calculated
using timer frequency.. 200.00 BogoMIPS (lpj=1000000)
[    0.001410] pid_max: default: 32768 minimum: 301
[    0.001561] Mount-cache hash table entries: 2048 (order: 1, 8192
bytes, linear)
[    0.001581] Mountpoint-cache hash table entries: 2048 (order: 1,
8192 bytes, linear)
[    0.002112] CPU: Testing write buffer coherency: ok
[    0.002637] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.002926] Setting up static identity map for 0x80400000 - 0x80400160
[    0.003448] rcu: Hierarchical SRCU implementation.
[    0.003601] Platform MSI: gic-its@30020000 domain created
[    0.003669] PCI/MSI:
/interrupt-controller@30000000/gic-its@30020000 domain created
[    0.004751] Remapping and enabling EFI services.
[    0.005305] smp: Bringing up secondary CPUs ...
[    0.005895] GICv3: CPU1: found redistributor 1 region 0:0x0000000030420000
[    0.005919] GICv3: CPU1: using allocated LPI pending table
@0x00000000aa0a0000
[    0.005940] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
[    0.011149] GICv3: CPU2: found redistributor 100 region 0:0x0000000030440000
[    0.011179] GICv3: CPU2: using allocated LPI pending table
@0x00000000aa0b0000
[    0.011203] CPU2: thread -1, cpu 0, socket 1, mpidr 80000100
[    0.014242] GICv3: CPU3: found redistributor 101 region 0:0x0000000030460000
[    0.014264] GICv3: CPU3: using allocated LPI pending table
@0x00000000aa0c0000
[    0.014284] CPU3: thread -1, cpu 1, socket 1, mpidr 80000101
[    0.019622] GICv3: CPU4: found redistributor 200 region 0:0x0000000030480000
[    0.019650] GICv3: CPU4: using allocated LPI pending table
@0x00000000aa0d0000
[    0.019675] CPU4: thread -1, cpu 0, socket 2, mpidr 80000200
[    0.022737] GICv3: CPU5: found redistributor 201 region 0:0x00000000304a0000
[    0.022759] GICv3: CPU5: using allocated LPI pending table
@0x00000000aa0e0000
[    0.022777] CPU5: thread -1, cpu 1, socket 2, mpidr 80000201
[    0.028146] GICv3: CPU6: found redistributor 300 region 0:0x00000000304c0000
[    0.028174] GICv3: CPU6: using allocated LPI pending table
@0x00000000aa0f0000
[    0.028196] CPU6: thread -1, cpu 0, socket 3, mpidr 80000300
[    0.031213] GICv3: CPU7: found redistributor 301 region 0:0x00000000304e0000
[    0.031239] GICv3: CPU7: using allocated LPI pending table
@0x00000000aa100000
[    0.031256] CPU7: thread -1, cpu 1, socket 3, mpidr 80000301
[    0.036606] GICv3: CPU8: found redistributor 400 region 0:0x0000000030500000
[    0.036634] GICv3: CPU8: using allocated LPI pending table
@0x00000000aa110000
[    0.036657] CPU8: thread -1, cpu 0, socket 4, mpidr 80000400
[    0.039719] GICv3: CPU9: found redistributor 401 region 0:0x0000000030520000
[    0.039740] GICv3: CPU9: using allocated LPI pending table
@0x00000000aa120000
[    0.039757] CPU9: thread -1, cpu 1, socket 4, mpidr 80000401
[    0.045156] GICv3: CPU10: found redistributor 500 region 0:0x0000000030540000
[    0.045187] GICv3: CPU10: using allocated LPI pending table
@0x00000000aa130000
[    0.045210] CPU10: thread -1, cpu 0, socket 5, mpidr 80000500
[    0.048241] GICv3: CPU11: found redistributor 501 region 0:0x0000000030560000
[    0.048263] GICv3: CPU11: using allocated LPI pending table
@0x00000000aa140000
[    0.048282] CPU11: thread -1, cpu 1, socket 5, mpidr 80000501
[    0.053651] GICv3: CPU12: found redistributor 600 region 0:0x0000000030580000
[    0.053681] GICv3: CPU12: using allocated LPI pending table
@0x00000000aa150000
[    0.053706] CPU12: thread -1, cpu 0, socket 6, mpidr 80000600
[    0.056742] GICv3: CPU13: found redistributor 601 region 0:0x00000000305a0000
[    0.056765] GICv3: CPU13: using allocated LPI pending table
@0x00000000aa160000
[    0.056785] CPU13: thread -1, cpu 1, socket 6, mpidr 80000601
[    0.062113] GICv3: CPU14: found redistributor 700 region 0:0x00000000305c0000
[    0.062144] GICv3: CPU14: using allocated LPI pending table
@0x00000000aa170000
[    0.062166] CPU14: thread -1, cpu 0, socket 7, mpidr 80000700
[    0.065238] GICv3: CPU15: found redistributor 701 region 0:0x00000000305e0000
[    0.065263] GICv3: CPU15: using allocated LPI pending table
@0x00000000aa180000
[    0.065282] CPU15: thread -1, cpu 1, socket 7, mpidr 80000701
[    0.070661] GICv3: CPU16: found redistributor 800 region 0:0x0000000030600000
[    0.070691] GICv3: CPU16: using allocated LPI pending table
@0x00000000aa190000
[    0.070716] CPU16: thread -1, cpu 0, socket 8, mpidr 80000800
[    0.073748] GICv3: CPU17: found redistributor 801 region 0:0x0000000030620000
[    0.073774] GICv3: CPU17: using allocated LPI pending table
@0x00000000aa1a0000
[    0.073794] CPU17: thread -1, cpu 1, socket 8, mpidr 80000801
[    0.079132] GICv3: CPU18: found redistributor 900 region 0:0x0000000030640000
[    0.079163] GICv3: CPU18: using allocated LPI pending table
@0x00000000aa1b0000
[    0.079187] CPU18: thread -1, cpu 0, socket 9, mpidr 80000900
[    0.082216] GICv3: CPU19: found redistributor 901 region 0:0x0000000030660000
[    0.082239] GICv3: CPU19: using allocated LPI pending table
@0x00000000aa1c0000
[    0.082257] CPU19: thread -1, cpu 1, socket 9, mpidr 80000901
[    0.087755] GICv3: CPU20: found redistributor a00 region 0:0x0000000030680000
[    0.087788] GICv3: CPU20: using allocated LPI pending table
@0x00000000aa1d0000
[    0.087811] CPU20: thread -1, cpu 0, socket 10, mpidr 80000a00
[    0.090897] GICv3: CPU21: found redistributor a01 region 0:0x00000000306a0000
[    0.090922] GICv3: CPU21: using allocated LPI pending table
@0x00000000aa1e0000
[    0.090939] CPU21: thread -1, cpu 1, socket 10, mpidr 80000a01
[    0.096296] GICv3: CPU22: found redistributor b00 region 0:0x00000000306c0000
[    0.096329] GICv3: CPU22: using allocated LPI pending table
@0x00000000aa1f0000
[    0.096353] CPU22: thread -1, cpu 0, socket 11, mpidr 80000b00
[    0.099356] GICv3: CPU23: found redistributor b01 region 0:0x00000000306e0000
[    0.099381] GICv3: CPU23: using allocated LPI pending table
@0x00000000aa200000
[    0.099400] CPU23: thread -1, cpu 1, socket 11, mpidr 80000b01
[    0.099506] smp: Brought up 1 node, 24 CPUs
[    0.100163] SMP: Total of 24 processors activated (4800.00 BogoMIPS).
[    0.100175] CPU: All CPU(s) started in SVC mode.
[    0.101193] devtmpfs: initialized
[    0.103698] VFP support v0.3: implementor 41 architecture 3 part 40
variant 3 rev 4
[    0.103980] clocksource: jiffies: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.104009] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
[    0.106670] pinctrl core: initialized pinctrl subsystem
[    0.107566] thermal_sys: Registered thermal governor 'step_wise'
[    0.107754] SMBIOS 3.3.0 present.
[    0.107788] DMI: Socionext SynQuacer E-series DeveloperBox, BIOS
build #1 Feb 20 2020
[    0.108185] NET: Registered protocol family 16
[    0.109556] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.110957] cpuidle: using governor menu
[    0.111063] No ATAGs?
[    0.111467] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4
watchpoint registers.
[    0.111490] hw-breakpoint: maximum watchpoint size is 8 bytes.
[    0.112874] Serial: AMBA PL011 UART driver
[    0.114349] OF: translation of DMA address(0) to CPU address failed
node(/uart@2a400000)
[    0.114421] 2a400000.uart: ttyAMA0 at MMIO 0x2a400000 (irq = 22,
base_baud = 0) is a PL011 rev3
[    1.117194] printk: console [ttyAMA0] enabled
[    1.135592] AT91: Could not find identification node
[    1.136261] iommu: Default domain type: Translated
[    1.146225] vgaarb: loaded
[    1.149407] SCSI subsystem initialized
[    1.153506] usbcore: registered new interface driver usbfs
[    1.159042] usbcore: registered new interface driver hub
[    1.164477] usbcore: registered new device driver usb
[    1.169950] pps_core: LinuxPPS API ver. 1 registered
[    1.174911] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
Rodolfo Giometti <giometti@linux.it>
[    1.184062] PTP clock support registered
[    1.188042] EDAC MC: Ver: 3.0.0
[    1.191660] Registered efivars operations
[    1.196838] clocksource: Switched to clocksource arch_sys_counter
[    2.103835] NET: Registered protocol family 2
[    2.108658] tcp_listen_portaddr_hash hash table entries: 512
(order: 0, 6144 bytes, linear)
[    2.117044] TCP established hash table entries: 8192 (order: 3,
32768 bytes, linear)
[    2.124854] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    2.132103] TCP: Hash tables configured (established 8192 bind 8192)
[    2.138585] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    2.145223] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    2.152446] NET: Registered protocol family 1
[    2.157108] RPC: Registered named UNIX socket transport module.
[    2.163026] RPC: Registered udp transport module.
[    2.167746] RPC: Registered tcp transport module.
[    2.172445] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    2.178897] PCI: CLS 0 bytes, default 64
[    2.183052] Trying to unpack rootfs image as initramfs...
[    3.413006] Freeing initrd memory: 22816K
[    3.418665] Initialise system trusted keyrings
[    3.423276] workingset: timestamp_bits=30 max_order=19 bucket_order=0
[    3.434628] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    3.441097] NFS: Registering the id_resolver key type
[    3.446175] Key type id_resolver registered
[    3.450375] Key type id_legacy registered
[    3.454388] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    3.461111] ntfs: driver 2.1.32 [Flags: R/O].
[    3.465747] Key type asymmetric registered
[    3.469857] Asymmetric key parser 'x509' registered
[    3.474765] bounce: pool size: 64 pages
[    3.478629] Block layer SCSI generic (bsg) driver version 0.4
loaded (major 247)
[    3.486027] io scheduler mq-deadline registered
[    3.490564] io scheduler kyber registered
[    3.500170] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    3.508318] pci-host-generic 60000000.pcie: host bridge
/pcie@60000000 ranges:
[    3.515556] pci-host-generic 60000000.pcie:       IO
0x0067f00000..0x0067f0ffff -> 0x0000000000
[    3.524276] pci-host-generic 60000000.pcie:      MEM
0x0068000000..0x006fffffff -> 0x0068000000
[    3.532987] pci-host-generic 60000000.pcie:      MEM
0x3e00000000..0x3effffffff -> 0x3e00000000
[    3.543045] pci-host-generic 60000000.pcie: ECAM at [mem
0x60000000-0x67efffff] for [bus 00-7e]
[    3.551873] pci-host-generic 60000000.pcie: PCI host bridge to bus 0000:00
[    3.558764] pci_bus 0000:00: root bus resource [bus 00-7e]
[    3.564250] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
[    3.570438] pci_bus 0000:00: root bus resource [mem 0x68000000-0x6fffffff]
[    3.577322] pci_bus 0000:00: root bus resource [mem
0x3e00000000-0x3effffffff]
[    3.584574] pci 0000:00:00.0: [1b21:1184] type 01 class 0x060400
[    3.590646] pci 0000:00:00.0: enabling Extended Tags
[    3.595677] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    3.602874] PCI: bus0: Fast back to back transfers disabled
[    3.608585] pci 0000:01:01.0: [1b21:1184] type 01 class 0x060400
[    3.614645] pci 0000:01:01.0: enabling Extended Tags
[    3.619672] pci 0000:01:01.0: PME# supported from D0 D3hot D3cold
[    3.625969] pci 0000:01:03.0: [1b21:1184] type 01 class 0x060400
[    3.632040] pci 0000:01:03.0: enabling Extended Tags
[    3.637066] pci 0000:01:03.0: PME# supported from D0 D3hot D3cold
[    3.643363] pci 0000:01:05.0: [1b21:1184] type 01 class 0x060400
[    3.649431] pci 0000:01:05.0: enabling Extended Tags
[    3.654449] pci 0000:01:05.0: PME# supported from D0 D3hot D3cold
[    3.660753] pci 0000:01:07.0: [1b21:1184] type 01 class 0x060400
[    3.666822] pci 0000:01:07.0: enabling Extended Tags
[    3.671844] pci 0000:01:07.0: PME# supported from D0 D3hot D3cold
[    3.678832] PCI: bus1: Fast back to back transfers disabled
[    3.684517] pci 0000:02:00.0: [1b21:0612] type 00 class 0x010601
[    3.690564] pci 0000:02:00.0: reg 0x10: [io  0x0028-0x002f]
[    3.696147] pci 0000:02:00.0: reg 0x14: [io  0x0034-0x0037]
[    3.701738] pci 0000:02:00.0: reg 0x18: [io  0x0020-0x0027]
[    3.707329] pci 0000:02:00.0: reg 0x1c: [io  0x0030-0x0033]
[    3.712912] pci 0000:02:00.0: reg 0x20: [io  0x0000-0x001f]
[    3.718503] pci 0000:02:00.0: reg 0x24: [mem 0x68100000-0x681001ff]
[    3.724781] pci 0000:02:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[    3.732590] PCI: bus2: Fast back to back transfers disabled
[    3.738174] pci_bus 0000:02: busn_res: [bus 02-7e] end is updated to 02
[    3.745751] PCI: bus3: Fast back to back transfers enabled
[    3.751247] pci_bus 0000:03: busn_res: [bus 03-7e] end is updated to 03
[    3.757969] pci 0000:04:00.0: [1912:0014] type 00 class 0x0c0330
[    3.764012] pci 0000:04:00.0: reg 0x10: [mem 0x68000000-0x68001fff 64bit]
[    3.770943] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    3.807778] PCI: bus4: Fast back to back transfers disabled
[    3.813353] pci_bus 0000:04: busn_res: [bus 04-7e] end is updated to 04
[    3.820943] PCI: bus5: Fast back to back transfers enabled
[    3.826430] pci_bus 0000:05: busn_res: [bus 05-7e] end is updated to 05
[    3.833058] pci_bus 0000:01: busn_res: [bus 01-7e] end is updated to 05
[    3.839709] pci 0000:00:00.0: BAR 8: assigned [mem 0x68000000-0x681fffff]
[    3.846498] pci 0000:00:00.0: BAR 7: assigned [io  0x1000-0x1fff]
[    3.852603] pci 0000:01:01.0: BAR 8: assigned [mem 0x68000000-0x680fffff]
[    3.859402] pci 0000:01:05.0: BAR 8: assigned [mem 0x68100000-0x681fffff]
[    3.866190] pci 0000:01:01.0: BAR 7: assigned [io  0x1000-0x1fff]
[    3.872294] pci 0000:02:00.0: BAR 6: assigned [mem
0x68000000-0x6800ffff pref]
[    3.879529] pci 0000:02:00.0: BAR 5: assigned [mem 0x68010000-0x680101ff]
[    3.886321] pci 0000:02:00.0: BAR 4: assigned [io  0x1000-0x101f]
[    3.892425] pci 0000:02:00.0: BAR 0: assigned [io  0x1020-0x1027]
[    3.898529] pci 0000:02:00.0: BAR 2: assigned [io  0x1028-0x102f]
[    3.904627] pci 0000:02:00.0: BAR 1: assigned [io  0x1030-0x1033]
[    3.910730] pci 0000:02:00.0: BAR 3: assigned [io  0x1034-0x1037]
[    3.916834] pci 0000:01:01.0: PCI bridge to [bus 02]
[    3.921799] pci 0000:01:01.0:   bridge window [io  0x1000-0x1fff]
[    3.927903] pci 0000:01:01.0:   bridge window [mem 0x68000000-0x680fffff]
[    3.934697] pci 0000:01:03.0: PCI bridge to [bus 03]
[    3.939682] pci 0000:04:00.0: BAR 0: assigned [mem
0x68100000-0x68101fff 64bit]
[    3.947012] pci 0000:01:05.0: PCI bridge to [bus 04]
[    3.951979] pci 0000:01:05.0:   bridge window [mem 0x68100000-0x681fffff]
[    3.958780] pci 0000:01:07.0: PCI bridge to [bus 05]
[    3.963754] pci 0000:00:00.0: PCI bridge to [bus 01-05]
[    3.968985] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
[    3.975081] pci 0000:00:00.0:   bridge window [mem 0x68000000-0x681fffff]
[    3.981914] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    3.990313] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    3.998662] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    4.007005] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    4.015339] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    4.023694] pci 0000:04:00.0: enabling device (0140 -> 0142)
[    4.029447] OF: translation of DMA address(0) to CPU address failed
node(/pcie@70000000)
[    4.037570] pci-host-generic 70000000.pcie: host bridge
/pcie@70000000 ranges:
[    4.044805] pci-host-generic 70000000.pcie:       IO
0x0077f00000..0x0077f0ffff -> 0x0000000000
[    4.053523] pci-host-generic 70000000.pcie:      MEM
0x0078000000..0x007fffffff -> 0x0078000000
[    4.062236] pci-host-generic 70000000.pcie:      MEM
0x3f00000000..0x3fffffffff -> 0x3f00000000
[    4.071308] vmap allocation for size 1052672 failed: use
vmalloc=<size> to increase size
[    4.079411] pci-host-generic 70000000.pcie: ECAM ioremap failed
[    4.085525] pci-host-generic: probe of 70000000.pcie failed with error -12
[    4.126494] Serial: 8250/16550 driver, 5 ports, IRQ sharing enabled
[    4.134170] OF: translation of DMA address(0) to CPU address failed
node(/uart@51040000)
[    4.142748] 51040000.uart: ttyS1 at MMIO 0x51040000 (irq = 23,
base_baud = 3906250) is a 16550A
[    4.152099] SuperH (H)SCI(F) driver initialized
[    4.156953] msm_serial: driver initialized
[    4.161103] STMicroelectronics ASC driver initialized
[    4.166594] STM32 USART driver initialized
[    4.178363] brd: module loaded
[    4.192943] loop: module loaded
[    4.197009] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    4.205330] ahci 0000:02:00.0: SSS flag set, parallel bus scan disabled
[    4.212015] ahci 0000:02:00.0: AHCI 0001.0200 32 slots 2 ports 6
Gbps 0x3 impl SATA mode
[    4.220122] ahci 0000:02:00.0: flags: 64bit ncq sntf stag led clo
pmp pio slum part ccc sxs
[    4.229431] scsi host0: ahci
[    4.232675] scsi host1: ahci
[    4.235694] ata1: SATA max UDMA/133 abar m512@0x68010000 port
0x68010100 irq 35
[    4.243033] ata2: SATA max UDMA/133 abar m512@0x68010000 port
0x68010180 irq 35
[    4.253906] libphy: Fixed MDIO Bus: probed
[    4.258796] CAN device driver interface
[    4.262933] bgmac_bcma: Broadcom 47xx GBit MAC driver loaded
[    4.268942] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[    4.274772] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    4.280739] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k
[    4.287707] igb: Copyright (c) 2007-2014 Intel Corporation.
[    4.294603] pegasus: v0.9.3 (2013/04/25), Pegasus/Pegasus II USB
Ethernet driver
[    4.302042] usbcore: registered new interface driver pegasus
[    4.307736] usbcore: registered new interface driver asix
[    4.313150] usbcore: registered new interface driver ax88179_178a
[    4.319267] usbcore: registered new interface driver cdc_ether
[    4.325122] usbcore: registered new interface driver smsc75xx
[    4.330901] usbcore: registered new interface driver smsc95xx
[    4.336663] usbcore: registered new interface driver net1080
[    4.342350] usbcore: registered new interface driver cdc_subset
[    4.348295] usbcore: registered new interface driver zaurus
[    4.353894] usbcore: registered new interface driver cdc_ncm
[    4.360347] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    4.366891] ehci-pci: EHCI PCI platform driver
[    4.371359] ehci-platform: EHCI generic platform driver
[    4.376646] ehci-orion: EHCI orion driver
[    4.380714] SPEAr-ehci: EHCI SPEAr driver
[    4.384767] ehci-st: EHCI STMicroelectronics driver
[    4.389704] ehci-exynos: EHCI Exynos driver
[    4.393931] ehci-atmel: EHCI Atmel driver
[    4.397991] tegra-ehci: Tegra EHCI driver
[    4.402048] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    4.408245] ohci-pci: OHCI PCI platform driver
[    4.412714] ohci-platform: OHCI generic platform driver
[    4.418003] SPEAr-ohci: OHCI SPEAr driver
[    4.422057] ohci-st: OHCI STMicroelectronics driver
[    4.426995] ohci-atmel: OHCI Atmel driver
[    4.431085] OF: translation of DMA address(0) to CPU address failed
node(/pcie@60000000)
[    4.439259] xhci_hcd 0000:04:00.0: xHCI Host Controller
[    4.444497] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
bus number 1
[    4.457324] xhci_hcd 0000:04:00.0: hcc params 0x014051cf hci
version 0x100 quirks 0x0000000100000410
[    4.467671] hub 1-0:1.0: USB hub found
[    4.471449] hub 1-0:1.0: 4 ports detected
[    4.475927] xhci_hcd 0000:04:00.0: xHCI Host Controller
[    4.481175] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
bus number 2
[    4.488585] xhci_hcd 0000:04:00.0: Host supports USB 3.0 SuperSpeed
[    4.494924] usb usb2: We don't know the algorithms for LPM for this
host, disabling LPM.
[    4.503372] hub 2-0:1.0: USB hub found
[    4.507155] hub 2-0:1.0: 4 ports detected
[    4.511847] usbcore: registered new interface driver usb-storage
[    4.519900] i2c /dev entries driver
[    4.528493] /cpus/cpu@0: unsupported enable-method property: psci
[    4.537114] sdhci: Secure Digital Host Controller Interface driver
[    4.543297] sdhci: Copyright(c) Pierre Ossman
[    4.548328] Synopsys Designware Multimedia Card Interface Driver
[    4.554829] sdhci-pltfm: SDHCI platform and OF driver helper
[    4.562104] ledtrig-cpu: registered to indicate activity on CPUs
[    4.568594] usbcore: registered new interface driver usbhid
[    4.574168] usbhid: USB HID core driver
[    4.579546] drop_monitor: Initializing network drop monitor service
[    4.586552] NET: Registered protocol family 10
[    4.591887] Segment Routing with IPv6
[    4.595614] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    4.602085] NET: Registered protocol family 17
[    4.606537] can: controller area network core (rev 20170425 abi 9)
[    4.612780] NET: Registered protocol family 29
[    4.617248] can: raw protocol (rev 20170425)
[    4.621524] can: broadcast manager protocol (rev 20170425 t)
[    4.627198] can: netlink gateway (rev 20190810) max_hops=1
[    4.632967] Key type dns_resolver registered
[    4.637328] Registering SWP/SWPB emulation handler
[    4.642410] Loading compiled-in X.509 certificates
[    4.688987] OF: translation of DMA address(0) to CPU address failed
node(/gpio-keys)
[    4.696780] irq: no irq domain found for interrupt-controller@510c0000 !
[    4.703556] gpio-keys gpio-keys: Found button without gpio or irq
[    4.709673] gpio-keys: probe of gpio-keys failed with error -22
[    4.715621] hctosys: unable to open rtc device (rtc0)
[    4.721044] uart-pl011 2a400000.uart: no DMA platform data
[    4.746912] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    4.754022] ata1.00: ATA-10: WDC WD10EZEX-22MFCA0, 01.01A01, max UDMA/133
[    4.760826] ata1.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    4.768960] ata1.00: configured for UDMA/133
[    4.773637] scsi 0:0:0:0: Direct-Access     ATA      WDC
WD10EZEX-22M 1A01 PQ: 0 ANSI: 5
[    4.782675] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks:
(1.00 TB/932 GiB)
[    4.790362] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    4.795635] sd 0:0:0:0: [sda] Write Protect is off
[    4.800505] sd 0:0:0:0: [sda] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[    4.846916] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[    4.865348]  sda: sda1 sda2 sda3 sda4
[    4.871475] sd 0:0:0:0: [sda] Attached SCSI disk
[    4.887962] usb-storage 1-3:1.0: USB Mass Storage device detected
[    4.894715] scsi host2: usb-storage 1-3:1.0
[    5.109059] ata2: SATA link down (SStatus 0 SControl 300)
[    5.117814] Freeing unused kernel memory: 2048K
[    5.122861] Run /init as init process
Robin Murphy Feb. 21, 2020, 1:35 p.m. UTC | #2 
On 20/02/2020 6:08 pm, Ard Biesheuvel wrote:
> (+ Arnd)
> 
> On Wed, 19 Feb 2020 at 10:43, Ard Biesheuvel <ardb@kernel.org> wrote:
>>
>> While making changes to the EFI stub startup code, I noticed that we are
>> still doing set/way maintenance on the caches when booting on v7 cores.
>> This works today on VMs by virtue of the fact that KVM traps set/way ops
>> and cleans the whole address space by VA on behalf of the guest, and on
>> most v7 hardware, the set/way ops are in fact sufficient when only one
>> core is running, as there usually is no system cache. But on systems
>> like SynQuacer, for which 32-bit firmware is available, the current cache
>> maintenance only pushes the data out to the L3 system cache, where it
>> is not visible to the CPU once it turns the MMU and caches off.
>>
>> So instead, switch to the by-VA cache maintenance that the architecture
>> requires for v7 and later (and ARM1176, as a side effect).
>>
>> Changes since v1:
>> - include the EFI patch that was sent out separately before (#1)
>> - split the preparatory work to pass the region to clean in r0/r1 in a EFI
>>    specific one and one for the decompressor - this way, the first two patches
>>    can go on a stable branch that is shared between the ARM tree and the EFI
>>    tree
>> - document the meaning of the values in r0/r1 upon entry to cache_clean_flush
>> - take care to treat the region end address as exclusive
>> - switch to clean+invalidate to align with the other implementations
>> - drop some code that manages the stack pointer value before calling
>>    cache_clean_flush(), which is no longer necessary
>> - take care to clean the entire region that is covered by the relocated zImage
>>    if it needs to relocate itself before decompressing
>>
>> https://git.kernel.org/pub/scm/linux/kernel/git/ardb/linux.git/log/?h=arm32-efi-cache-ops
>>
> 
> Adding my own data point here: with these patches, I can reproducibly
> boot on the SynQuacer platform (24x Cortex-A53 + GICv3 + L3 system
> cache) until the point where /init is loaded, after which it hangs
> (see below), whereas without them, it always crashes early with weird,
> unreproducible errors, if it even makes it far enough through the
> decompressor to produce any earlycon output.
> 
> There is some other weird stuff going on, but this is unlikely to be
> related to cache maintenance:
> - multiple occurrences of
>     OF: translation of DMA address(0) to CPU address failed node(...)

FWIW that implies a "dma-ranges" property in the wrong place in the DT - 
if you copied the now-gone Juno example of placing one directly in the 
root node, that was bogus, sorry.

> - /cpus/cpu@0: unsupported enable-method property: psci

Missing CONFIG_ARM_PSCI_CPUIDLE? That's caught me out on more than one 
occasion since 5.4.

Robin.

> Then, there is not enough vmalloc space to map the config space of
> both PCIe RCs.
> 
> Also, due to the fact that this platform sadly honours the ARM
> recommendation on memory maps, it seems there is no way to make useful
> use of any memory beyond 2 GB, given that the hole between the lower 2
> GB and the upper <30 GB eats up all the lowmem by being covered by the
> memmap[] array. (Note that this platform supports up to 64 GB, in
> which case another hole of 480 GB is created, so there is no way we
> can even boot with that much memory reported to the kernel)
> 
> 
> Shell> initrd initrd.gz
> Shell> zImage
> EFI stub: Booting Linux Kernel...
> EFI stub: Using DTB from configuration table
> EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
> EFI stub: Exiting boot services and installing virtual address map...
> [    0.000000] Booting Linux on physical CPU 0x0
> [    0.000000] Linux version 5.6.0-rc1-00084-g8602a0ff0200-dirty
> (ardbie01@e123331-lin) (gcc version 7.4.0 (Ubuntu/Linaro
> 7.4.0-1ubuntu1~18.04.1)) #286 SMP Thu Feb 20 17:49:59 CET 2020
> [    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=70c5383d
> [    0.000000] CPU: div instructions available: patching division code
> [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing
> instruction cache
> [    0.000000] OF: fdt: Machine model: Socionext Developer Box
> [    0.000000] Memory policy: Data cache writealloc
> [    0.000000] efi: EFI v2.70 by EDK II
> [    0.000000] efi:  SMBIOS 3.0=0xffa1c000  MEMATTR=0xfd0b4010
> ESRT=0xfdfbb910  MEMRESERVE=0xf8f2d010
> [    0.000000] OF: fdt: Ignoring memory block 0x880000000 - 0x1000000000
> [    0.000000] esrt: Reserving ESRT space from 0x00000000fdfbb910 to
> 0x00000000fdfbb948.
> [    0.000000] cma: Reserved 64 MiB at 0x00000000f9000000
> [    0.000000] psci: probing for conduit method from DT.
> [    0.000000] psci: PSCIv1.1 detected in firmware.
> [    0.000000] psci: Using standard PSCI v0.2 function IDs
> [    0.000000] psci: MIGRATE_INFO_TYPE not supported.
> [    0.000000] psci: SMC Calling Convention v1.0
> [    0.000000] percpu: Embedded 20 pages/cpu s49356 r8192 d24372 u81920
> [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 522368
> [    0.000000] Kernel command line: zImage
> [    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
> [    0.000000] printk: log_buf_len total cpu_extra contributions: 94208 bytes
> [    0.000000] printk: log_buf_len min size: 131072 bytes
> [    0.000000] printk: log_buf_len: 262144 bytes
> [    0.000000] printk: early log buf free: 128828(98%)
> [    0.000000] Dentry cache hash table entries: 131072 (order: 7,
> 524288 bytes, linear)
> [    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144
> bytes, linear)
> [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
> [    0.000000] software IO TLB: mapped [mem 0xaa90c000-0xae90c000] (64MB)
> [    0.000000] Memory: 1886672K/2097152K available (10240K kernel
> code, 1811K rwdata, 5392K rodata, 2048K init, 414K bss, 144944K
> reserved, 65536K cma-reserved, 1233168K highmem)
> [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
> [    0.000000] rcu: Hierarchical RCU implementation.
> [    0.000000] rcu:     RCU event tracing is enabled.
> [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay
> is 10 jiffies.
> [    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
> [    0.000000] GICv3: 640 SPIs implemented
> [    0.000000] GICv3: 0 Extended SPIs implemented
> [    0.000000] GICv3: Distributor has no Range Selector support
> [    0.000000] GICv3: 16 PPIs implemented
> [    0.000000] GICv3: no VLPI support, no direct LPI support, no RVPEID support
> [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000030400000
> [    0.000000] ITS [mem 0x30020000-0x3003ffff]
> [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
> [    0.000000] ITS@0x0000000030020000: allocated 524288 Devices
> @aa400000 (flat, esz 8, psz 64K, shr 0)
> [    0.000000] ITS: using cache flushing for cmd queue
> [    0.000000] GICv3: using LPI property table @0x00000000aa080000
> [    0.000000] GIC: using cache flushing for LPI property table
> [    0.000000] GICv3: CPU0: using allocated LPI pending table
> @0x00000000aa090000
> [    0.000000] random: get_random_bytes called from
> start_kernel+0x469/0x5ca with crng_init=0
> [    0.000000] arch_timer: cp15 and mmio timer(s) running at 100.00MHz
> (virt/phys).
> [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
> max_cycles: 0x171024e7e0, max_idle_ns: 440795205315 ns
> [    0.000004] sched_clock: 56 bits at 100MHz, resolution 10ns, wraps
> every 4398046511100ns
> [    0.000013] Switching to timer-based delay loop, resolution 10ns
> [    0.000890] Console: colour dummy device 80x30
> [    0.001344] printk: console [tty0] enabled
> [    0.001389] Calibrating delay loop (skipped), value calculated
> using timer frequency.. 200.00 BogoMIPS (lpj=1000000)
> [    0.001410] pid_max: default: 32768 minimum: 301
> [    0.001561] Mount-cache hash table entries: 2048 (order: 1, 8192
> bytes, linear)
> [    0.001581] Mountpoint-cache hash table entries: 2048 (order: 1,
> 8192 bytes, linear)
> [    0.002112] CPU: Testing write buffer coherency: ok
> [    0.002637] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
> [    0.002926] Setting up static identity map for 0x80400000 - 0x80400160
> [    0.003448] rcu: Hierarchical SRCU implementation.
> [    0.003601] Platform MSI: gic-its@30020000 domain created
> [    0.003669] PCI/MSI:
> /interrupt-controller@30000000/gic-its@30020000 domain created
> [    0.004751] Remapping and enabling EFI services.
> [    0.005305] smp: Bringing up secondary CPUs ...
> [    0.005895] GICv3: CPU1: found redistributor 1 region 0:0x0000000030420000
> [    0.005919] GICv3: CPU1: using allocated LPI pending table
> @0x00000000aa0a0000
> [    0.005940] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
> [    0.011149] GICv3: CPU2: found redistributor 100 region 0:0x0000000030440000
> [    0.011179] GICv3: CPU2: using allocated LPI pending table
> @0x00000000aa0b0000
> [    0.011203] CPU2: thread -1, cpu 0, socket 1, mpidr 80000100
> [    0.014242] GICv3: CPU3: found redistributor 101 region 0:0x0000000030460000
> [    0.014264] GICv3: CPU3: using allocated LPI pending table
> @0x00000000aa0c0000
> [    0.014284] CPU3: thread -1, cpu 1, socket 1, mpidr 80000101
> [    0.019622] GICv3: CPU4: found redistributor 200 region 0:0x0000000030480000
> [    0.019650] GICv3: CPU4: using allocated LPI pending table
> @0x00000000aa0d0000
> [    0.019675] CPU4: thread -1, cpu 0, socket 2, mpidr 80000200
> [    0.022737] GICv3: CPU5: found redistributor 201 region 0:0x00000000304a0000
> [    0.022759] GICv3: CPU5: using allocated LPI pending table
> @0x00000000aa0e0000
> [    0.022777] CPU5: thread -1, cpu 1, socket 2, mpidr 80000201
> [    0.028146] GICv3: CPU6: found redistributor 300 region 0:0x00000000304c0000
> [    0.028174] GICv3: CPU6: using allocated LPI pending table
> @0x00000000aa0f0000
> [    0.028196] CPU6: thread -1, cpu 0, socket 3, mpidr 80000300
> [    0.031213] GICv3: CPU7: found redistributor 301 region 0:0x00000000304e0000
> [    0.031239] GICv3: CPU7: using allocated LPI pending table
> @0x00000000aa100000
> [    0.031256] CPU7: thread -1, cpu 1, socket 3, mpidr 80000301
> [    0.036606] GICv3: CPU8: found redistributor 400 region 0:0x0000000030500000
> [    0.036634] GICv3: CPU8: using allocated LPI pending table
> @0x00000000aa110000
> [    0.036657] CPU8: thread -1, cpu 0, socket 4, mpidr 80000400
> [    0.039719] GICv3: CPU9: found redistributor 401 region 0:0x0000000030520000
> [    0.039740] GICv3: CPU9: using allocated LPI pending table
> @0x00000000aa120000
> [    0.039757] CPU9: thread -1, cpu 1, socket 4, mpidr 80000401
> [    0.045156] GICv3: CPU10: found redistributor 500 region 0:0x0000000030540000
> [    0.045187] GICv3: CPU10: using allocated LPI pending table
> @0x00000000aa130000
> [    0.045210] CPU10: thread -1, cpu 0, socket 5, mpidr 80000500
> [    0.048241] GICv3: CPU11: found redistributor 501 region 0:0x0000000030560000
> [    0.048263] GICv3: CPU11: using allocated LPI pending table
> @0x00000000aa140000
> [    0.048282] CPU11: thread -1, cpu 1, socket 5, mpidr 80000501
> [    0.053651] GICv3: CPU12: found redistributor 600 region 0:0x0000000030580000
> [    0.053681] GICv3: CPU12: using allocated LPI pending table
> @0x00000000aa150000
> [    0.053706] CPU12: thread -1, cpu 0, socket 6, mpidr 80000600
> [    0.056742] GICv3: CPU13: found redistributor 601 region 0:0x00000000305a0000
> [    0.056765] GICv3: CPU13: using allocated LPI pending table
> @0x00000000aa160000
> [    0.056785] CPU13: thread -1, cpu 1, socket 6, mpidr 80000601
> [    0.062113] GICv3: CPU14: found redistributor 700 region 0:0x00000000305c0000
> [    0.062144] GICv3: CPU14: using allocated LPI pending table
> @0x00000000aa170000
> [    0.062166] CPU14: thread -1, cpu 0, socket 7, mpidr 80000700
> [    0.065238] GICv3: CPU15: found redistributor 701 region 0:0x00000000305e0000
> [    0.065263] GICv3: CPU15: using allocated LPI pending table
> @0x00000000aa180000
> [    0.065282] CPU15: thread -1, cpu 1, socket 7, mpidr 80000701
> [    0.070661] GICv3: CPU16: found redistributor 800 region 0:0x0000000030600000
> [    0.070691] GICv3: CPU16: using allocated LPI pending table
> @0x00000000aa190000
> [    0.070716] CPU16: thread -1, cpu 0, socket 8, mpidr 80000800
> [    0.073748] GICv3: CPU17: found redistributor 801 region 0:0x0000000030620000
> [    0.073774] GICv3: CPU17: using allocated LPI pending table
> @0x00000000aa1a0000
> [    0.073794] CPU17: thread -1, cpu 1, socket 8, mpidr 80000801
> [    0.079132] GICv3: CPU18: found redistributor 900 region 0:0x0000000030640000
> [    0.079163] GICv3: CPU18: using allocated LPI pending table
> @0x00000000aa1b0000
> [    0.079187] CPU18: thread -1, cpu 0, socket 9, mpidr 80000900
> [    0.082216] GICv3: CPU19: found redistributor 901 region 0:0x0000000030660000
> [    0.082239] GICv3: CPU19: using allocated LPI pending table
> @0x00000000aa1c0000
> [    0.082257] CPU19: thread -1, cpu 1, socket 9, mpidr 80000901
> [    0.087755] GICv3: CPU20: found redistributor a00 region 0:0x0000000030680000
> [    0.087788] GICv3: CPU20: using allocated LPI pending table
> @0x00000000aa1d0000
> [    0.087811] CPU20: thread -1, cpu 0, socket 10, mpidr 80000a00
> [    0.090897] GICv3: CPU21: found redistributor a01 region 0:0x00000000306a0000
> [    0.090922] GICv3: CPU21: using allocated LPI pending table
> @0x00000000aa1e0000
> [    0.090939] CPU21: thread -1, cpu 1, socket 10, mpidr 80000a01
> [    0.096296] GICv3: CPU22: found redistributor b00 region 0:0x00000000306c0000
> [    0.096329] GICv3: CPU22: using allocated LPI pending table
> @0x00000000aa1f0000
> [    0.096353] CPU22: thread -1, cpu 0, socket 11, mpidr 80000b00
> [    0.099356] GICv3: CPU23: found redistributor b01 region 0:0x00000000306e0000
> [    0.099381] GICv3: CPU23: using allocated LPI pending table
> @0x00000000aa200000
> [    0.099400] CPU23: thread -1, cpu 1, socket 11, mpidr 80000b01
> [    0.099506] smp: Brought up 1 node, 24 CPUs
> [    0.100163] SMP: Total of 24 processors activated (4800.00 BogoMIPS).
> [    0.100175] CPU: All CPU(s) started in SVC mode.
> [    0.101193] devtmpfs: initialized
> [    0.103698] VFP support v0.3: implementor 41 architecture 3 part 40
> variant 3 rev 4
> [    0.103980] clocksource: jiffies: mask: 0xffffffff max_cycles:
> 0xffffffff, max_idle_ns: 19112604462750000 ns
> [    0.104009] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
> [    0.106670] pinctrl core: initialized pinctrl subsystem
> [    0.107566] thermal_sys: Registered thermal governor 'step_wise'
> [    0.107754] SMBIOS 3.3.0 present.
> [    0.107788] DMI: Socionext SynQuacer E-series DeveloperBox, BIOS
> build #1 Feb 20 2020
> [    0.108185] NET: Registered protocol family 16
> [    0.109556] DMA: preallocated 256 KiB pool for atomic coherent allocations
> [    0.110957] cpuidle: using governor menu
> [    0.111063] No ATAGs?
> [    0.111467] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4
> watchpoint registers.
> [    0.111490] hw-breakpoint: maximum watchpoint size is 8 bytes.
> [    0.112874] Serial: AMBA PL011 UART driver
> [    0.114349] OF: translation of DMA address(0) to CPU address failed
> node(/uart@2a400000)
> [    0.114421] 2a400000.uart: ttyAMA0 at MMIO 0x2a400000 (irq = 22,
> base_baud = 0) is a PL011 rev3
> [    1.117194] printk: console [ttyAMA0] enabled
> [    1.135592] AT91: Could not find identification node
> [    1.136261] iommu: Default domain type: Translated
> [    1.146225] vgaarb: loaded
> [    1.149407] SCSI subsystem initialized
> [    1.153506] usbcore: registered new interface driver usbfs
> [    1.159042] usbcore: registered new interface driver hub
> [    1.164477] usbcore: registered new device driver usb
> [    1.169950] pps_core: LinuxPPS API ver. 1 registered
> [    1.174911] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
> Rodolfo Giometti <giometti@linux.it>
> [    1.184062] PTP clock support registered
> [    1.188042] EDAC MC: Ver: 3.0.0
> [    1.191660] Registered efivars operations
> [    1.196838] clocksource: Switched to clocksource arch_sys_counter
> [    2.103835] NET: Registered protocol family 2
> [    2.108658] tcp_listen_portaddr_hash hash table entries: 512
> (order: 0, 6144 bytes, linear)
> [    2.117044] TCP established hash table entries: 8192 (order: 3,
> 32768 bytes, linear)
> [    2.124854] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
> [    2.132103] TCP: Hash tables configured (established 8192 bind 8192)
> [    2.138585] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
> [    2.145223] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
> [    2.152446] NET: Registered protocol family 1
> [    2.157108] RPC: Registered named UNIX socket transport module.
> [    2.163026] RPC: Registered udp transport module.
> [    2.167746] RPC: Registered tcp transport module.
> [    2.172445] RPC: Registered tcp NFSv4.1 backchannel transport module.
> [    2.178897] PCI: CLS 0 bytes, default 64
> [    2.183052] Trying to unpack rootfs image as initramfs...
> [    3.413006] Freeing initrd memory: 22816K
> [    3.418665] Initialise system trusted keyrings
> [    3.423276] workingset: timestamp_bits=30 max_order=19 bucket_order=0
> [    3.434628] squashfs: version 4.0 (2009/01/31) Phillip Lougher
> [    3.441097] NFS: Registering the id_resolver key type
> [    3.446175] Key type id_resolver registered
> [    3.450375] Key type id_legacy registered
> [    3.454388] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
> [    3.461111] ntfs: driver 2.1.32 [Flags: R/O].
> [    3.465747] Key type asymmetric registered
> [    3.469857] Asymmetric key parser 'x509' registered
> [    3.474765] bounce: pool size: 64 pages
> [    3.478629] Block layer SCSI generic (bsg) driver version 0.4
> loaded (major 247)
> [    3.486027] io scheduler mq-deadline registered
> [    3.490564] io scheduler kyber registered
> [    3.500170] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    3.508318] pci-host-generic 60000000.pcie: host bridge
> /pcie@60000000 ranges:
> [    3.515556] pci-host-generic 60000000.pcie:       IO
> 0x0067f00000..0x0067f0ffff -> 0x0000000000
> [    3.524276] pci-host-generic 60000000.pcie:      MEM
> 0x0068000000..0x006fffffff -> 0x0068000000
> [    3.532987] pci-host-generic 60000000.pcie:      MEM
> 0x3e00000000..0x3effffffff -> 0x3e00000000
> [    3.543045] pci-host-generic 60000000.pcie: ECAM at [mem
> 0x60000000-0x67efffff] for [bus 00-7e]
> [    3.551873] pci-host-generic 60000000.pcie: PCI host bridge to bus 0000:00
> [    3.558764] pci_bus 0000:00: root bus resource [bus 00-7e]
> [    3.564250] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> [    3.570438] pci_bus 0000:00: root bus resource [mem 0x68000000-0x6fffffff]
> [    3.577322] pci_bus 0000:00: root bus resource [mem
> 0x3e00000000-0x3effffffff]
> [    3.584574] pci 0000:00:00.0: [1b21:1184] type 01 class 0x060400
> [    3.590646] pci 0000:00:00.0: enabling Extended Tags
> [    3.595677] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
> [    3.602874] PCI: bus0: Fast back to back transfers disabled
> [    3.608585] pci 0000:01:01.0: [1b21:1184] type 01 class 0x060400
> [    3.614645] pci 0000:01:01.0: enabling Extended Tags
> [    3.619672] pci 0000:01:01.0: PME# supported from D0 D3hot D3cold
> [    3.625969] pci 0000:01:03.0: [1b21:1184] type 01 class 0x060400
> [    3.632040] pci 0000:01:03.0: enabling Extended Tags
> [    3.637066] pci 0000:01:03.0: PME# supported from D0 D3hot D3cold
> [    3.643363] pci 0000:01:05.0: [1b21:1184] type 01 class 0x060400
> [    3.649431] pci 0000:01:05.0: enabling Extended Tags
> [    3.654449] pci 0000:01:05.0: PME# supported from D0 D3hot D3cold
> [    3.660753] pci 0000:01:07.0: [1b21:1184] type 01 class 0x060400
> [    3.666822] pci 0000:01:07.0: enabling Extended Tags
> [    3.671844] pci 0000:01:07.0: PME# supported from D0 D3hot D3cold
> [    3.678832] PCI: bus1: Fast back to back transfers disabled
> [    3.684517] pci 0000:02:00.0: [1b21:0612] type 00 class 0x010601
> [    3.690564] pci 0000:02:00.0: reg 0x10: [io  0x0028-0x002f]
> [    3.696147] pci 0000:02:00.0: reg 0x14: [io  0x0034-0x0037]
> [    3.701738] pci 0000:02:00.0: reg 0x18: [io  0x0020-0x0027]
> [    3.707329] pci 0000:02:00.0: reg 0x1c: [io  0x0030-0x0033]
> [    3.712912] pci 0000:02:00.0: reg 0x20: [io  0x0000-0x001f]
> [    3.718503] pci 0000:02:00.0: reg 0x24: [mem 0x68100000-0x681001ff]
> [    3.724781] pci 0000:02:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
> [    3.732590] PCI: bus2: Fast back to back transfers disabled
> [    3.738174] pci_bus 0000:02: busn_res: [bus 02-7e] end is updated to 02
> [    3.745751] PCI: bus3: Fast back to back transfers enabled
> [    3.751247] pci_bus 0000:03: busn_res: [bus 03-7e] end is updated to 03
> [    3.757969] pci 0000:04:00.0: [1912:0014] type 00 class 0x0c0330
> [    3.764012] pci 0000:04:00.0: reg 0x10: [mem 0x68000000-0x68001fff 64bit]
> [    3.770943] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
> [    3.807778] PCI: bus4: Fast back to back transfers disabled
> [    3.813353] pci_bus 0000:04: busn_res: [bus 04-7e] end is updated to 04
> [    3.820943] PCI: bus5: Fast back to back transfers enabled
> [    3.826430] pci_bus 0000:05: busn_res: [bus 05-7e] end is updated to 05
> [    3.833058] pci_bus 0000:01: busn_res: [bus 01-7e] end is updated to 05
> [    3.839709] pci 0000:00:00.0: BAR 8: assigned [mem 0x68000000-0x681fffff]
> [    3.846498] pci 0000:00:00.0: BAR 7: assigned [io  0x1000-0x1fff]
> [    3.852603] pci 0000:01:01.0: BAR 8: assigned [mem 0x68000000-0x680fffff]
> [    3.859402] pci 0000:01:05.0: BAR 8: assigned [mem 0x68100000-0x681fffff]
> [    3.866190] pci 0000:01:01.0: BAR 7: assigned [io  0x1000-0x1fff]
> [    3.872294] pci 0000:02:00.0: BAR 6: assigned [mem
> 0x68000000-0x6800ffff pref]
> [    3.879529] pci 0000:02:00.0: BAR 5: assigned [mem 0x68010000-0x680101ff]
> [    3.886321] pci 0000:02:00.0: BAR 4: assigned [io  0x1000-0x101f]
> [    3.892425] pci 0000:02:00.0: BAR 0: assigned [io  0x1020-0x1027]
> [    3.898529] pci 0000:02:00.0: BAR 2: assigned [io  0x1028-0x102f]
> [    3.904627] pci 0000:02:00.0: BAR 1: assigned [io  0x1030-0x1033]
> [    3.910730] pci 0000:02:00.0: BAR 3: assigned [io  0x1034-0x1037]
> [    3.916834] pci 0000:01:01.0: PCI bridge to [bus 02]
> [    3.921799] pci 0000:01:01.0:   bridge window [io  0x1000-0x1fff]
> [    3.927903] pci 0000:01:01.0:   bridge window [mem 0x68000000-0x680fffff]
> [    3.934697] pci 0000:01:03.0: PCI bridge to [bus 03]
> [    3.939682] pci 0000:04:00.0: BAR 0: assigned [mem
> 0x68100000-0x68101fff 64bit]
> [    3.947012] pci 0000:01:05.0: PCI bridge to [bus 04]
> [    3.951979] pci 0000:01:05.0:   bridge window [mem 0x68100000-0x681fffff]
> [    3.958780] pci 0000:01:07.0: PCI bridge to [bus 05]
> [    3.963754] pci 0000:00:00.0: PCI bridge to [bus 01-05]
> [    3.968985] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
> [    3.975081] pci 0000:00:00.0:   bridge window [mem 0x68000000-0x681fffff]
> [    3.981914] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    3.990313] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    3.998662] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    4.007005] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    4.015339] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    4.023694] pci 0000:04:00.0: enabling device (0140 -> 0142)
> [    4.029447] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@70000000)
> [    4.037570] pci-host-generic 70000000.pcie: host bridge
> /pcie@70000000 ranges:
> [    4.044805] pci-host-generic 70000000.pcie:       IO
> 0x0077f00000..0x0077f0ffff -> 0x0000000000
> [    4.053523] pci-host-generic 70000000.pcie:      MEM
> 0x0078000000..0x007fffffff -> 0x0078000000
> [    4.062236] pci-host-generic 70000000.pcie:      MEM
> 0x3f00000000..0x3fffffffff -> 0x3f00000000
> [    4.071308] vmap allocation for size 1052672 failed: use
> vmalloc=<size> to increase size
> [    4.079411] pci-host-generic 70000000.pcie: ECAM ioremap failed
> [    4.085525] pci-host-generic: probe of 70000000.pcie failed with error -12
> [    4.126494] Serial: 8250/16550 driver, 5 ports, IRQ sharing enabled
> [    4.134170] OF: translation of DMA address(0) to CPU address failed
> node(/uart@51040000)
> [    4.142748] 51040000.uart: ttyS1 at MMIO 0x51040000 (irq = 23,
> base_baud = 3906250) is a 16550A
> [    4.152099] SuperH (H)SCI(F) driver initialized
> [    4.156953] msm_serial: driver initialized
> [    4.161103] STMicroelectronics ASC driver initialized
> [    4.166594] STM32 USART driver initialized
> [    4.178363] brd: module loaded
> [    4.192943] loop: module loaded
> [    4.197009] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    4.205330] ahci 0000:02:00.0: SSS flag set, parallel bus scan disabled
> [    4.212015] ahci 0000:02:00.0: AHCI 0001.0200 32 slots 2 ports 6
> Gbps 0x3 impl SATA mode
> [    4.220122] ahci 0000:02:00.0: flags: 64bit ncq sntf stag led clo
> pmp pio slum part ccc sxs
> [    4.229431] scsi host0: ahci
> [    4.232675] scsi host1: ahci
> [    4.235694] ata1: SATA max UDMA/133 abar m512@0x68010000 port
> 0x68010100 irq 35
> [    4.243033] ata2: SATA max UDMA/133 abar m512@0x68010000 port
> 0x68010180 irq 35
> [    4.253906] libphy: Fixed MDIO Bus: probed
> [    4.258796] CAN device driver interface
> [    4.262933] bgmac_bcma: Broadcom 47xx GBit MAC driver loaded
> [    4.268942] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
> [    4.274772] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
> [    4.280739] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k
> [    4.287707] igb: Copyright (c) 2007-2014 Intel Corporation.
> [    4.294603] pegasus: v0.9.3 (2013/04/25), Pegasus/Pegasus II USB
> Ethernet driver
> [    4.302042] usbcore: registered new interface driver pegasus
> [    4.307736] usbcore: registered new interface driver asix
> [    4.313150] usbcore: registered new interface driver ax88179_178a
> [    4.319267] usbcore: registered new interface driver cdc_ether
> [    4.325122] usbcore: registered new interface driver smsc75xx
> [    4.330901] usbcore: registered new interface driver smsc95xx
> [    4.336663] usbcore: registered new interface driver net1080
> [    4.342350] usbcore: registered new interface driver cdc_subset
> [    4.348295] usbcore: registered new interface driver zaurus
> [    4.353894] usbcore: registered new interface driver cdc_ncm
> [    4.360347] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
> [    4.366891] ehci-pci: EHCI PCI platform driver
> [    4.371359] ehci-platform: EHCI generic platform driver
> [    4.376646] ehci-orion: EHCI orion driver
> [    4.380714] SPEAr-ehci: EHCI SPEAr driver
> [    4.384767] ehci-st: EHCI STMicroelectronics driver
> [    4.389704] ehci-exynos: EHCI Exynos driver
> [    4.393931] ehci-atmel: EHCI Atmel driver
> [    4.397991] tegra-ehci: Tegra EHCI driver
> [    4.402048] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
> [    4.408245] ohci-pci: OHCI PCI platform driver
> [    4.412714] ohci-platform: OHCI generic platform driver
> [    4.418003] SPEAr-ohci: OHCI SPEAr driver
> [    4.422057] ohci-st: OHCI STMicroelectronics driver
> [    4.426995] ohci-atmel: OHCI Atmel driver
> [    4.431085] OF: translation of DMA address(0) to CPU address failed
> node(/pcie@60000000)
> [    4.439259] xhci_hcd 0000:04:00.0: xHCI Host Controller
> [    4.444497] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
> bus number 1
> [    4.457324] xhci_hcd 0000:04:00.0: hcc params 0x014051cf hci
> version 0x100 quirks 0x0000000100000410
> [    4.467671] hub 1-0:1.0: USB hub found
> [    4.471449] hub 1-0:1.0: 4 ports detected
> [    4.475927] xhci_hcd 0000:04:00.0: xHCI Host Controller
> [    4.481175] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
> bus number 2
> [    4.488585] xhci_hcd 0000:04:00.0: Host supports USB 3.0 SuperSpeed
> [    4.494924] usb usb2: We don't know the algorithms for LPM for this
> host, disabling LPM.
> [    4.503372] hub 2-0:1.0: USB hub found
> [    4.507155] hub 2-0:1.0: 4 ports detected
> [    4.511847] usbcore: registered new interface driver usb-storage
> [    4.519900] i2c /dev entries driver
> [    4.528493] /cpus/cpu@0: unsupported enable-method property: psci
> [    4.537114] sdhci: Secure Digital Host Controller Interface driver
> [    4.543297] sdhci: Copyright(c) Pierre Ossman
> [    4.548328] Synopsys Designware Multimedia Card Interface Driver
> [    4.554829] sdhci-pltfm: SDHCI platform and OF driver helper
> [    4.562104] ledtrig-cpu: registered to indicate activity on CPUs
> [    4.568594] usbcore: registered new interface driver usbhid
> [    4.574168] usbhid: USB HID core driver
> [    4.579546] drop_monitor: Initializing network drop monitor service
> [    4.586552] NET: Registered protocol family 10
> [    4.591887] Segment Routing with IPv6
> [    4.595614] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
> [    4.602085] NET: Registered protocol family 17
> [    4.606537] can: controller area network core (rev 20170425 abi 9)
> [    4.612780] NET: Registered protocol family 29
> [    4.617248] can: raw protocol (rev 20170425)
> [    4.621524] can: broadcast manager protocol (rev 20170425 t)
> [    4.627198] can: netlink gateway (rev 20190810) max_hops=1
> [    4.632967] Key type dns_resolver registered
> [    4.637328] Registering SWP/SWPB emulation handler
> [    4.642410] Loading compiled-in X.509 certificates
> [    4.688987] OF: translation of DMA address(0) to CPU address failed
> node(/gpio-keys)
> [    4.696780] irq: no irq domain found for interrupt-controller@510c0000 !
> [    4.703556] gpio-keys gpio-keys: Found button without gpio or irq
> [    4.709673] gpio-keys: probe of gpio-keys failed with error -22
> [    4.715621] hctosys: unable to open rtc device (rtc0)
> [    4.721044] uart-pl011 2a400000.uart: no DMA platform data
> [    4.746912] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
> [    4.754022] ata1.00: ATA-10: WDC WD10EZEX-22MFCA0, 01.01A01, max UDMA/133
> [    4.760826] ata1.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA
> [    4.768960] ata1.00: configured for UDMA/133
> [    4.773637] scsi 0:0:0:0: Direct-Access     ATA      WDC
> WD10EZEX-22M 1A01 PQ: 0 ANSI: 5
> [    4.782675] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks:
> (1.00 TB/932 GiB)
> [    4.790362] sd 0:0:0:0: [sda] 4096-byte physical blocks
> [    4.795635] sd 0:0:0:0: [sda] Write Protect is off
> [    4.800505] sd 0:0:0:0: [sda] Write cache: enabled, read cache:
> enabled, doesn't support DPO or FUA
> [    4.846916] usb 1-3: new high-speed USB device number 2 using xhci_hcd
> [    4.865348]  sda: sda1 sda2 sda3 sda4
> [    4.871475] sd 0:0:0:0: [sda] Attached SCSI disk
> [    4.887962] usb-storage 1-3:1.0: USB Mass Storage device detected
> [    4.894715] scsi host2: usb-storage 1-3:1.0
> [    5.109059] ata2: SATA link down (SStatus 0 SControl 300)
> [    5.117814] Freeing unused kernel memory: 2048K
> [    5.122861] Run /init as init process
> 
> _______________________________________________
> linux-arm-kernel mailing list
> linux-arm-kernel@lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
>
Ard Biesheuvel Feb. 21, 2020, 1:42 p.m. UTC | #3 
On Fri, 21 Feb 2020 at 14:35, Robin Murphy <robin.murphy@arm.com> wrote:
>
> On 20/02/2020 6:08 pm, Ard Biesheuvel wrote:
> > (+ Arnd)
> >
> > On Wed, 19 Feb 2020 at 10:43, Ard Biesheuvel <ardb@kernel.org> wrote:
> >>
> >> While making changes to the EFI stub startup code, I noticed that we are
> >> still doing set/way maintenance on the caches when booting on v7 cores.
> >> This works today on VMs by virtue of the fact that KVM traps set/way ops
> >> and cleans the whole address space by VA on behalf of the guest, and on
> >> most v7 hardware, the set/way ops are in fact sufficient when only one
> >> core is running, as there usually is no system cache. But on systems
> >> like SynQuacer, for which 32-bit firmware is available, the current cache
> >> maintenance only pushes the data out to the L3 system cache, where it
> >> is not visible to the CPU once it turns the MMU and caches off.
> >>
> >> So instead, switch to the by-VA cache maintenance that the architecture
> >> requires for v7 and later (and ARM1176, as a side effect).
> >>
> >> Changes since v1:
> >> - include the EFI patch that was sent out separately before (#1)
> >> - split the preparatory work to pass the region to clean in r0/r1 in a EFI
> >>    specific one and one for the decompressor - this way, the first two patches
> >>    can go on a stable branch that is shared between the ARM tree and the EFI
> >>    tree
> >> - document the meaning of the values in r0/r1 upon entry to cache_clean_flush
> >> - take care to treat the region end address as exclusive
> >> - switch to clean+invalidate to align with the other implementations
> >> - drop some code that manages the stack pointer value before calling
> >>    cache_clean_flush(), which is no longer necessary
> >> - take care to clean the entire region that is covered by the relocated zImage
> >>    if it needs to relocate itself before decompressing
> >>
> >> https://git.kernel.org/pub/scm/linux/kernel/git/ardb/linux.git/log/?h=arm32-efi-cache-ops
> >>
> >
> > Adding my own data point here: with these patches, I can reproducibly
> > boot on the SynQuacer platform (24x Cortex-A53 + GICv3 + L3 system
> > cache) until the point where /init is loaded, after which it hangs
> > (see below), whereas without them, it always crashes early with weird,
> > unreproducible errors, if it even makes it far enough through the
> > decompressor to produce any earlycon output.
> >
> > There is some other weird stuff going on, but this is unlikely to be
> > related to cache maintenance:
> > - multiple occurrences of
> >     OF: translation of DMA address(0) to CPU address failed node(...)
>
> FWIW that implies a "dma-ranges" property in the wrong place in the DT -
> if you copied the now-gone Juno example of placing one directly in the
> root node, that was bogus, sorry.
>

OK, so where should it be instead? Are you saying it is now required
to have a /soc or /smb node that contains all the device nodes?


> > - /cpus/cpu@0: unsupported enable-method property: psci
>
> Missing CONFIG_ARM_PSCI_CPUIDLE? That's caught me out on more than one
> occasion since 5.4.
>
> Robin.
>
> > Then, there is not enough vmalloc space to map the config space of
> > both PCIe RCs.
> >
> > Also, due to the fact that this platform sadly honours the ARM
> > recommendation on memory maps, it seems there is no way to make useful
> > use of any memory beyond 2 GB, given that the hole between the lower 2
> > GB and the upper <30 GB eats up all the lowmem by being covered by the
> > memmap[] array. (Note that this platform supports up to 64 GB, in
> > which case another hole of 480 GB is created, so there is no way we
> > can even boot with that much memory reported to the kernel)
> >
> >
> > Shell> initrd initrd.gz
> > Shell> zImage
> > EFI stub: Booting Linux Kernel...
> > EFI stub: Using DTB from configuration table
> > EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
> > EFI stub: Exiting boot services and installing virtual address map...
> > [    0.000000] Booting Linux on physical CPU 0x0
> > [    0.000000] Linux version 5.6.0-rc1-00084-g8602a0ff0200-dirty
> > (ardbie01@e123331-lin) (gcc version 7.4.0 (Ubuntu/Linaro
> > 7.4.0-1ubuntu1~18.04.1)) #286 SMP Thu Feb 20 17:49:59 CET 2020
> > [    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=70c5383d
> > [    0.000000] CPU: div instructions available: patching division code
> > [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing
> > instruction cache
> > [    0.000000] OF: fdt: Machine model: Socionext Developer Box
> > [    0.000000] Memory policy: Data cache writealloc
> > [    0.000000] efi: EFI v2.70 by EDK II
> > [    0.000000] efi:  SMBIOS 3.0=0xffa1c000  MEMATTR=0xfd0b4010
> > ESRT=0xfdfbb910  MEMRESERVE=0xf8f2d010
> > [    0.000000] OF: fdt: Ignoring memory block 0x880000000 - 0x1000000000
> > [    0.000000] esrt: Reserving ESRT space from 0x00000000fdfbb910 to
> > 0x00000000fdfbb948.
> > [    0.000000] cma: Reserved 64 MiB at 0x00000000f9000000
> > [    0.000000] psci: probing for conduit method from DT.
> > [    0.000000] psci: PSCIv1.1 detected in firmware.
> > [    0.000000] psci: Using standard PSCI v0.2 function IDs
> > [    0.000000] psci: MIGRATE_INFO_TYPE not supported.
> > [    0.000000] psci: SMC Calling Convention v1.0
> > [    0.000000] percpu: Embedded 20 pages/cpu s49356 r8192 d24372 u81920
> > [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 522368
> > [    0.000000] Kernel command line: zImage
> > [    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
> > [    0.000000] printk: log_buf_len total cpu_extra contributions: 94208 bytes
> > [    0.000000] printk: log_buf_len min size: 131072 bytes
> > [    0.000000] printk: log_buf_len: 262144 bytes
> > [    0.000000] printk: early log buf free: 128828(98%)
> > [    0.000000] Dentry cache hash table entries: 131072 (order: 7,
> > 524288 bytes, linear)
> > [    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144
> > bytes, linear)
> > [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
> > [    0.000000] software IO TLB: mapped [mem 0xaa90c000-0xae90c000] (64MB)
> > [    0.000000] Memory: 1886672K/2097152K available (10240K kernel
> > code, 1811K rwdata, 5392K rodata, 2048K init, 414K bss, 144944K
> > reserved, 65536K cma-reserved, 1233168K highmem)
> > [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
> > [    0.000000] rcu: Hierarchical RCU implementation.
> > [    0.000000] rcu:     RCU event tracing is enabled.
> > [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay
> > is 10 jiffies.
> > [    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
> > [    0.000000] GICv3: 640 SPIs implemented
> > [    0.000000] GICv3: 0 Extended SPIs implemented
> > [    0.000000] GICv3: Distributor has no Range Selector support
> > [    0.000000] GICv3: 16 PPIs implemented
> > [    0.000000] GICv3: no VLPI support, no direct LPI support, no RVPEID support
> > [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000030400000
> > [    0.000000] ITS [mem 0x30020000-0x3003ffff]
> > [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
> > [    0.000000] ITS@0x0000000030020000: allocated 524288 Devices
> > @aa400000 (flat, esz 8, psz 64K, shr 0)
> > [    0.000000] ITS: using cache flushing for cmd queue
> > [    0.000000] GICv3: using LPI property table @0x00000000aa080000
> > [    0.000000] GIC: using cache flushing for LPI property table
> > [    0.000000] GICv3: CPU0: using allocated LPI pending table
> > @0x00000000aa090000
> > [    0.000000] random: get_random_bytes called from
> > start_kernel+0x469/0x5ca with crng_init=0
> > [    0.000000] arch_timer: cp15 and mmio timer(s) running at 100.00MHz
> > (virt/phys).
> > [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
> > max_cycles: 0x171024e7e0, max_idle_ns: 440795205315 ns
> > [    0.000004] sched_clock: 56 bits at 100MHz, resolution 10ns, wraps
> > every 4398046511100ns
> > [    0.000013] Switching to timer-based delay loop, resolution 10ns
> > [    0.000890] Console: colour dummy device 80x30
> > [    0.001344] printk: console [tty0] enabled
> > [    0.001389] Calibrating delay loop (skipped), value calculated
> > using timer frequency.. 200.00 BogoMIPS (lpj=1000000)
> > [    0.001410] pid_max: default: 32768 minimum: 301
> > [    0.001561] Mount-cache hash table entries: 2048 (order: 1, 8192
> > bytes, linear)
> > [    0.001581] Mountpoint-cache hash table entries: 2048 (order: 1,
> > 8192 bytes, linear)
> > [    0.002112] CPU: Testing write buffer coherency: ok
> > [    0.002637] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
> > [    0.002926] Setting up static identity map for 0x80400000 - 0x80400160
> > [    0.003448] rcu: Hierarchical SRCU implementation.
> > [    0.003601] Platform MSI: gic-its@30020000 domain created
> > [    0.003669] PCI/MSI:
> > /interrupt-controller@30000000/gic-its@30020000 domain created
> > [    0.004751] Remapping and enabling EFI services.
> > [    0.005305] smp: Bringing up secondary CPUs ...
> > [    0.005895] GICv3: CPU1: found redistributor 1 region 0:0x0000000030420000
> > [    0.005919] GICv3: CPU1: using allocated LPI pending table
> > @0x00000000aa0a0000
> > [    0.005940] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
> > [    0.011149] GICv3: CPU2: found redistributor 100 region 0:0x0000000030440000
> > [    0.011179] GICv3: CPU2: using allocated LPI pending table
> > @0x00000000aa0b0000
> > [    0.011203] CPU2: thread -1, cpu 0, socket 1, mpidr 80000100
> > [    0.014242] GICv3: CPU3: found redistributor 101 region 0:0x0000000030460000
> > [    0.014264] GICv3: CPU3: using allocated LPI pending table
> > @0x00000000aa0c0000
> > [    0.014284] CPU3: thread -1, cpu 1, socket 1, mpidr 80000101
> > [    0.019622] GICv3: CPU4: found redistributor 200 region 0:0x0000000030480000
> > [    0.019650] GICv3: CPU4: using allocated LPI pending table
> > @0x00000000aa0d0000
> > [    0.019675] CPU4: thread -1, cpu 0, socket 2, mpidr 80000200
> > [    0.022737] GICv3: CPU5: found redistributor 201 region 0:0x00000000304a0000
> > [    0.022759] GICv3: CPU5: using allocated LPI pending table
> > @0x00000000aa0e0000
> > [    0.022777] CPU5: thread -1, cpu 1, socket 2, mpidr 80000201
> > [    0.028146] GICv3: CPU6: found redistributor 300 region 0:0x00000000304c0000
> > [    0.028174] GICv3: CPU6: using allocated LPI pending table
> > @0x00000000aa0f0000
> > [    0.028196] CPU6: thread -1, cpu 0, socket 3, mpidr 80000300
> > [    0.031213] GICv3: CPU7: found redistributor 301 region 0:0x00000000304e0000
> > [    0.031239] GICv3: CPU7: using allocated LPI pending table
> > @0x00000000aa100000
> > [    0.031256] CPU7: thread -1, cpu 1, socket 3, mpidr 80000301
> > [    0.036606] GICv3: CPU8: found redistributor 400 region 0:0x0000000030500000
> > [    0.036634] GICv3: CPU8: using allocated LPI pending table
> > @0x00000000aa110000
> > [    0.036657] CPU8: thread -1, cpu 0, socket 4, mpidr 80000400
> > [    0.039719] GICv3: CPU9: found redistributor 401 region 0:0x0000000030520000
> > [    0.039740] GICv3: CPU9: using allocated LPI pending table
> > @0x00000000aa120000
> > [    0.039757] CPU9: thread -1, cpu 1, socket 4, mpidr 80000401
> > [    0.045156] GICv3: CPU10: found redistributor 500 region 0:0x0000000030540000
> > [    0.045187] GICv3: CPU10: using allocated LPI pending table
> > @0x00000000aa130000
> > [    0.045210] CPU10: thread -1, cpu 0, socket 5, mpidr 80000500
> > [    0.048241] GICv3: CPU11: found redistributor 501 region 0:0x0000000030560000
> > [    0.048263] GICv3: CPU11: using allocated LPI pending table
> > @0x00000000aa140000
> > [    0.048282] CPU11: thread -1, cpu 1, socket 5, mpidr 80000501
> > [    0.053651] GICv3: CPU12: found redistributor 600 region 0:0x0000000030580000
> > [    0.053681] GICv3: CPU12: using allocated LPI pending table
> > @0x00000000aa150000
> > [    0.053706] CPU12: thread -1, cpu 0, socket 6, mpidr 80000600
> > [    0.056742] GICv3: CPU13: found redistributor 601 region 0:0x00000000305a0000
> > [    0.056765] GICv3: CPU13: using allocated LPI pending table
> > @0x00000000aa160000
> > [    0.056785] CPU13: thread -1, cpu 1, socket 6, mpidr 80000601
> > [    0.062113] GICv3: CPU14: found redistributor 700 region 0:0x00000000305c0000
> > [    0.062144] GICv3: CPU14: using allocated LPI pending table
> > @0x00000000aa170000
> > [    0.062166] CPU14: thread -1, cpu 0, socket 7, mpidr 80000700
> > [    0.065238] GICv3: CPU15: found redistributor 701 region 0:0x00000000305e0000
> > [    0.065263] GICv3: CPU15: using allocated LPI pending table
> > @0x00000000aa180000
> > [    0.065282] CPU15: thread -1, cpu 1, socket 7, mpidr 80000701
> > [    0.070661] GICv3: CPU16: found redistributor 800 region 0:0x0000000030600000
> > [    0.070691] GICv3: CPU16: using allocated LPI pending table
> > @0x00000000aa190000
> > [    0.070716] CPU16: thread -1, cpu 0, socket 8, mpidr 80000800
> > [    0.073748] GICv3: CPU17: found redistributor 801 region 0:0x0000000030620000
> > [    0.073774] GICv3: CPU17: using allocated LPI pending table
> > @0x00000000aa1a0000
> > [    0.073794] CPU17: thread -1, cpu 1, socket 8, mpidr 80000801
> > [    0.079132] GICv3: CPU18: found redistributor 900 region 0:0x0000000030640000
> > [    0.079163] GICv3: CPU18: using allocated LPI pending table
> > @0x00000000aa1b0000
> > [    0.079187] CPU18: thread -1, cpu 0, socket 9, mpidr 80000900
> > [    0.082216] GICv3: CPU19: found redistributor 901 region 0:0x0000000030660000
> > [    0.082239] GICv3: CPU19: using allocated LPI pending table
> > @0x00000000aa1c0000
> > [    0.082257] CPU19: thread -1, cpu 1, socket 9, mpidr 80000901
> > [    0.087755] GICv3: CPU20: found redistributor a00 region 0:0x0000000030680000
> > [    0.087788] GICv3: CPU20: using allocated LPI pending table
> > @0x00000000aa1d0000
> > [    0.087811] CPU20: thread -1, cpu 0, socket 10, mpidr 80000a00
> > [    0.090897] GICv3: CPU21: found redistributor a01 region 0:0x00000000306a0000
> > [    0.090922] GICv3: CPU21: using allocated LPI pending table
> > @0x00000000aa1e0000
> > [    0.090939] CPU21: thread -1, cpu 1, socket 10, mpidr 80000a01
> > [    0.096296] GICv3: CPU22: found redistributor b00 region 0:0x00000000306c0000
> > [    0.096329] GICv3: CPU22: using allocated LPI pending table
> > @0x00000000aa1f0000
> > [    0.096353] CPU22: thread -1, cpu 0, socket 11, mpidr 80000b00
> > [    0.099356] GICv3: CPU23: found redistributor b01 region 0:0x00000000306e0000
> > [    0.099381] GICv3: CPU23: using allocated LPI pending table
> > @0x00000000aa200000
> > [    0.099400] CPU23: thread -1, cpu 1, socket 11, mpidr 80000b01
> > [    0.099506] smp: Brought up 1 node, 24 CPUs
> > [    0.100163] SMP: Total of 24 processors activated (4800.00 BogoMIPS).
> > [    0.100175] CPU: All CPU(s) started in SVC mode.
> > [    0.101193] devtmpfs: initialized
> > [    0.103698] VFP support v0.3: implementor 41 architecture 3 part 40
> > variant 3 rev 4
> > [    0.103980] clocksource: jiffies: mask: 0xffffffff max_cycles:
> > 0xffffffff, max_idle_ns: 19112604462750000 ns
> > [    0.104009] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
> > [    0.106670] pinctrl core: initialized pinctrl subsystem
> > [    0.107566] thermal_sys: Registered thermal governor 'step_wise'
> > [    0.107754] SMBIOS 3.3.0 present.
> > [    0.107788] DMI: Socionext SynQuacer E-series DeveloperBox, BIOS
> > build #1 Feb 20 2020
> > [    0.108185] NET: Registered protocol family 16
> > [    0.109556] DMA: preallocated 256 KiB pool for atomic coherent allocations
> > [    0.110957] cpuidle: using governor menu
> > [    0.111063] No ATAGs?
> > [    0.111467] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4
> > watchpoint registers.
> > [    0.111490] hw-breakpoint: maximum watchpoint size is 8 bytes.
> > [    0.112874] Serial: AMBA PL011 UART driver
> > [    0.114349] OF: translation of DMA address(0) to CPU address failed
> > node(/uart@2a400000)
> > [    0.114421] 2a400000.uart: ttyAMA0 at MMIO 0x2a400000 (irq = 22,
> > base_baud = 0) is a PL011 rev3
> > [    1.117194] printk: console [ttyAMA0] enabled
> > [    1.135592] AT91: Could not find identification node
> > [    1.136261] iommu: Default domain type: Translated
> > [    1.146225] vgaarb: loaded
> > [    1.149407] SCSI subsystem initialized
> > [    1.153506] usbcore: registered new interface driver usbfs
> > [    1.159042] usbcore: registered new interface driver hub
> > [    1.164477] usbcore: registered new device driver usb
> > [    1.169950] pps_core: LinuxPPS API ver. 1 registered
> > [    1.174911] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
> > Rodolfo Giometti <giometti@linux.it>
> > [    1.184062] PTP clock support registered
> > [    1.188042] EDAC MC: Ver: 3.0.0
> > [    1.191660] Registered efivars operations
> > [    1.196838] clocksource: Switched to clocksource arch_sys_counter
> > [    2.103835] NET: Registered protocol family 2
> > [    2.108658] tcp_listen_portaddr_hash hash table entries: 512
> > (order: 0, 6144 bytes, linear)
> > [    2.117044] TCP established hash table entries: 8192 (order: 3,
> > 32768 bytes, linear)
> > [    2.124854] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
> > [    2.132103] TCP: Hash tables configured (established 8192 bind 8192)
> > [    2.138585] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
> > [    2.145223] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
> > [    2.152446] NET: Registered protocol family 1
> > [    2.157108] RPC: Registered named UNIX socket transport module.
> > [    2.163026] RPC: Registered udp transport module.
> > [    2.167746] RPC: Registered tcp transport module.
> > [    2.172445] RPC: Registered tcp NFSv4.1 backchannel transport module.
> > [    2.178897] PCI: CLS 0 bytes, default 64
> > [    2.183052] Trying to unpack rootfs image as initramfs...
> > [    3.413006] Freeing initrd memory: 22816K
> > [    3.418665] Initialise system trusted keyrings
> > [    3.423276] workingset: timestamp_bits=30 max_order=19 bucket_order=0
> > [    3.434628] squashfs: version 4.0 (2009/01/31) Phillip Lougher
> > [    3.441097] NFS: Registering the id_resolver key type
> > [    3.446175] Key type id_resolver registered
> > [    3.450375] Key type id_legacy registered
> > [    3.454388] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
> > [    3.461111] ntfs: driver 2.1.32 [Flags: R/O].
> > [    3.465747] Key type asymmetric registered
> > [    3.469857] Asymmetric key parser 'x509' registered
> > [    3.474765] bounce: pool size: 64 pages
> > [    3.478629] Block layer SCSI generic (bsg) driver version 0.4
> > loaded (major 247)
> > [    3.486027] io scheduler mq-deadline registered
> > [    3.490564] io scheduler kyber registered
> > [    3.500170] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    3.508318] pci-host-generic 60000000.pcie: host bridge
> > /pcie@60000000 ranges:
> > [    3.515556] pci-host-generic 60000000.pcie:       IO
> > 0x0067f00000..0x0067f0ffff -> 0x0000000000
> > [    3.524276] pci-host-generic 60000000.pcie:      MEM
> > 0x0068000000..0x006fffffff -> 0x0068000000
> > [    3.532987] pci-host-generic 60000000.pcie:      MEM
> > 0x3e00000000..0x3effffffff -> 0x3e00000000
> > [    3.543045] pci-host-generic 60000000.pcie: ECAM at [mem
> > 0x60000000-0x67efffff] for [bus 00-7e]
> > [    3.551873] pci-host-generic 60000000.pcie: PCI host bridge to bus 0000:00
> > [    3.558764] pci_bus 0000:00: root bus resource [bus 00-7e]
> > [    3.564250] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> > [    3.570438] pci_bus 0000:00: root bus resource [mem 0x68000000-0x6fffffff]
> > [    3.577322] pci_bus 0000:00: root bus resource [mem
> > 0x3e00000000-0x3effffffff]
> > [    3.584574] pci 0000:00:00.0: [1b21:1184] type 01 class 0x060400
> > [    3.590646] pci 0000:00:00.0: enabling Extended Tags
> > [    3.595677] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
> > [    3.602874] PCI: bus0: Fast back to back transfers disabled
> > [    3.608585] pci 0000:01:01.0: [1b21:1184] type 01 class 0x060400
> > [    3.614645] pci 0000:01:01.0: enabling Extended Tags
> > [    3.619672] pci 0000:01:01.0: PME# supported from D0 D3hot D3cold
> > [    3.625969] pci 0000:01:03.0: [1b21:1184] type 01 class 0x060400
> > [    3.632040] pci 0000:01:03.0: enabling Extended Tags
> > [    3.637066] pci 0000:01:03.0: PME# supported from D0 D3hot D3cold
> > [    3.643363] pci 0000:01:05.0: [1b21:1184] type 01 class 0x060400
> > [    3.649431] pci 0000:01:05.0: enabling Extended Tags
> > [    3.654449] pci 0000:01:05.0: PME# supported from D0 D3hot D3cold
> > [    3.660753] pci 0000:01:07.0: [1b21:1184] type 01 class 0x060400
> > [    3.666822] pci 0000:01:07.0: enabling Extended Tags
> > [    3.671844] pci 0000:01:07.0: PME# supported from D0 D3hot D3cold
> > [    3.678832] PCI: bus1: Fast back to back transfers disabled
> > [    3.684517] pci 0000:02:00.0: [1b21:0612] type 00 class 0x010601
> > [    3.690564] pci 0000:02:00.0: reg 0x10: [io  0x0028-0x002f]
> > [    3.696147] pci 0000:02:00.0: reg 0x14: [io  0x0034-0x0037]
> > [    3.701738] pci 0000:02:00.0: reg 0x18: [io  0x0020-0x0027]
> > [    3.707329] pci 0000:02:00.0: reg 0x1c: [io  0x0030-0x0033]
> > [    3.712912] pci 0000:02:00.0: reg 0x20: [io  0x0000-0x001f]
> > [    3.718503] pci 0000:02:00.0: reg 0x24: [mem 0x68100000-0x681001ff]
> > [    3.724781] pci 0000:02:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
> > [    3.732590] PCI: bus2: Fast back to back transfers disabled
> > [    3.738174] pci_bus 0000:02: busn_res: [bus 02-7e] end is updated to 02
> > [    3.745751] PCI: bus3: Fast back to back transfers enabled
> > [    3.751247] pci_bus 0000:03: busn_res: [bus 03-7e] end is updated to 03
> > [    3.757969] pci 0000:04:00.0: [1912:0014] type 00 class 0x0c0330
> > [    3.764012] pci 0000:04:00.0: reg 0x10: [mem 0x68000000-0x68001fff 64bit]
> > [    3.770943] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
> > [    3.807778] PCI: bus4: Fast back to back transfers disabled
> > [    3.813353] pci_bus 0000:04: busn_res: [bus 04-7e] end is updated to 04
> > [    3.820943] PCI: bus5: Fast back to back transfers enabled
> > [    3.826430] pci_bus 0000:05: busn_res: [bus 05-7e] end is updated to 05
> > [    3.833058] pci_bus 0000:01: busn_res: [bus 01-7e] end is updated to 05
> > [    3.839709] pci 0000:00:00.0: BAR 8: assigned [mem 0x68000000-0x681fffff]
> > [    3.846498] pci 0000:00:00.0: BAR 7: assigned [io  0x1000-0x1fff]
> > [    3.852603] pci 0000:01:01.0: BAR 8: assigned [mem 0x68000000-0x680fffff]
> > [    3.859402] pci 0000:01:05.0: BAR 8: assigned [mem 0x68100000-0x681fffff]
> > [    3.866190] pci 0000:01:01.0: BAR 7: assigned [io  0x1000-0x1fff]
> > [    3.872294] pci 0000:02:00.0: BAR 6: assigned [mem
> > 0x68000000-0x6800ffff pref]
> > [    3.879529] pci 0000:02:00.0: BAR 5: assigned [mem 0x68010000-0x680101ff]
> > [    3.886321] pci 0000:02:00.0: BAR 4: assigned [io  0x1000-0x101f]
> > [    3.892425] pci 0000:02:00.0: BAR 0: assigned [io  0x1020-0x1027]
> > [    3.898529] pci 0000:02:00.0: BAR 2: assigned [io  0x1028-0x102f]
> > [    3.904627] pci 0000:02:00.0: BAR 1: assigned [io  0x1030-0x1033]
> > [    3.910730] pci 0000:02:00.0: BAR 3: assigned [io  0x1034-0x1037]
> > [    3.916834] pci 0000:01:01.0: PCI bridge to [bus 02]
> > [    3.921799] pci 0000:01:01.0:   bridge window [io  0x1000-0x1fff]
> > [    3.927903] pci 0000:01:01.0:   bridge window [mem 0x68000000-0x680fffff]
> > [    3.934697] pci 0000:01:03.0: PCI bridge to [bus 03]
> > [    3.939682] pci 0000:04:00.0: BAR 0: assigned [mem
> > 0x68100000-0x68101fff 64bit]
> > [    3.947012] pci 0000:01:05.0: PCI bridge to [bus 04]
> > [    3.951979] pci 0000:01:05.0:   bridge window [mem 0x68100000-0x681fffff]
> > [    3.958780] pci 0000:01:07.0: PCI bridge to [bus 05]
> > [    3.963754] pci 0000:00:00.0: PCI bridge to [bus 01-05]
> > [    3.968985] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
> > [    3.975081] pci 0000:00:00.0:   bridge window [mem 0x68000000-0x681fffff]
> > [    3.981914] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    3.990313] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    3.998662] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    4.007005] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    4.015339] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    4.023694] pci 0000:04:00.0: enabling device (0140 -> 0142)
> > [    4.029447] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@70000000)
> > [    4.037570] pci-host-generic 70000000.pcie: host bridge
> > /pcie@70000000 ranges:
> > [    4.044805] pci-host-generic 70000000.pcie:       IO
> > 0x0077f00000..0x0077f0ffff -> 0x0000000000
> > [    4.053523] pci-host-generic 70000000.pcie:      MEM
> > 0x0078000000..0x007fffffff -> 0x0078000000
> > [    4.062236] pci-host-generic 70000000.pcie:      MEM
> > 0x3f00000000..0x3fffffffff -> 0x3f00000000
> > [    4.071308] vmap allocation for size 1052672 failed: use
> > vmalloc=<size> to increase size
> > [    4.079411] pci-host-generic 70000000.pcie: ECAM ioremap failed
> > [    4.085525] pci-host-generic: probe of 70000000.pcie failed with error -12
> > [    4.126494] Serial: 8250/16550 driver, 5 ports, IRQ sharing enabled
> > [    4.134170] OF: translation of DMA address(0) to CPU address failed
> > node(/uart@51040000)
> > [    4.142748] 51040000.uart: ttyS1 at MMIO 0x51040000 (irq = 23,
> > base_baud = 3906250) is a 16550A
> > [    4.152099] SuperH (H)SCI(F) driver initialized
> > [    4.156953] msm_serial: driver initialized
> > [    4.161103] STMicroelectronics ASC driver initialized
> > [    4.166594] STM32 USART driver initialized
> > [    4.178363] brd: module loaded
> > [    4.192943] loop: module loaded
> > [    4.197009] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    4.205330] ahci 0000:02:00.0: SSS flag set, parallel bus scan disabled
> > [    4.212015] ahci 0000:02:00.0: AHCI 0001.0200 32 slots 2 ports 6
> > Gbps 0x3 impl SATA mode
> > [    4.220122] ahci 0000:02:00.0: flags: 64bit ncq sntf stag led clo
> > pmp pio slum part ccc sxs
> > [    4.229431] scsi host0: ahci
> > [    4.232675] scsi host1: ahci
> > [    4.235694] ata1: SATA max UDMA/133 abar m512@0x68010000 port
> > 0x68010100 irq 35
> > [    4.243033] ata2: SATA max UDMA/133 abar m512@0x68010000 port
> > 0x68010180 irq 35
> > [    4.253906] libphy: Fixed MDIO Bus: probed
> > [    4.258796] CAN device driver interface
> > [    4.262933] bgmac_bcma: Broadcom 47xx GBit MAC driver loaded
> > [    4.268942] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
> > [    4.274772] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
> > [    4.280739] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k
> > [    4.287707] igb: Copyright (c) 2007-2014 Intel Corporation.
> > [    4.294603] pegasus: v0.9.3 (2013/04/25), Pegasus/Pegasus II USB
> > Ethernet driver
> > [    4.302042] usbcore: registered new interface driver pegasus
> > [    4.307736] usbcore: registered new interface driver asix
> > [    4.313150] usbcore: registered new interface driver ax88179_178a
> > [    4.319267] usbcore: registered new interface driver cdc_ether
> > [    4.325122] usbcore: registered new interface driver smsc75xx
> > [    4.330901] usbcore: registered new interface driver smsc95xx
> > [    4.336663] usbcore: registered new interface driver net1080
> > [    4.342350] usbcore: registered new interface driver cdc_subset
> > [    4.348295] usbcore: registered new interface driver zaurus
> > [    4.353894] usbcore: registered new interface driver cdc_ncm
> > [    4.360347] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
> > [    4.366891] ehci-pci: EHCI PCI platform driver
> > [    4.371359] ehci-platform: EHCI generic platform driver
> > [    4.376646] ehci-orion: EHCI orion driver
> > [    4.380714] SPEAr-ehci: EHCI SPEAr driver
> > [    4.384767] ehci-st: EHCI STMicroelectronics driver
> > [    4.389704] ehci-exynos: EHCI Exynos driver
> > [    4.393931] ehci-atmel: EHCI Atmel driver
> > [    4.397991] tegra-ehci: Tegra EHCI driver
> > [    4.402048] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
> > [    4.408245] ohci-pci: OHCI PCI platform driver
> > [    4.412714] ohci-platform: OHCI generic platform driver
> > [    4.418003] SPEAr-ohci: OHCI SPEAr driver
> > [    4.422057] ohci-st: OHCI STMicroelectronics driver
> > [    4.426995] ohci-atmel: OHCI Atmel driver
> > [    4.431085] OF: translation of DMA address(0) to CPU address failed
> > node(/pcie@60000000)
> > [    4.439259] xhci_hcd 0000:04:00.0: xHCI Host Controller
> > [    4.444497] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
> > bus number 1
> > [    4.457324] xhci_hcd 0000:04:00.0: hcc params 0x014051cf hci
> > version 0x100 quirks 0x0000000100000410
> > [    4.467671] hub 1-0:1.0: USB hub found
> > [    4.471449] hub 1-0:1.0: 4 ports detected
> > [    4.475927] xhci_hcd 0000:04:00.0: xHCI Host Controller
> > [    4.481175] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
> > bus number 2
> > [    4.488585] xhci_hcd 0000:04:00.0: Host supports USB 3.0 SuperSpeed
> > [    4.494924] usb usb2: We don't know the algorithms for LPM for this
> > host, disabling LPM.
> > [    4.503372] hub 2-0:1.0: USB hub found
> > [    4.507155] hub 2-0:1.0: 4 ports detected
> > [    4.511847] usbcore: registered new interface driver usb-storage
> > [    4.519900] i2c /dev entries driver
> > [    4.528493] /cpus/cpu@0: unsupported enable-method property: psci
> > [    4.537114] sdhci: Secure Digital Host Controller Interface driver
> > [    4.543297] sdhci: Copyright(c) Pierre Ossman
> > [    4.548328] Synopsys Designware Multimedia Card Interface Driver
> > [    4.554829] sdhci-pltfm: SDHCI platform and OF driver helper
> > [    4.562104] ledtrig-cpu: registered to indicate activity on CPUs
> > [    4.568594] usbcore: registered new interface driver usbhid
> > [    4.574168] usbhid: USB HID core driver
> > [    4.579546] drop_monitor: Initializing network drop monitor service
> > [    4.586552] NET: Registered protocol family 10
> > [    4.591887] Segment Routing with IPv6
> > [    4.595614] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
> > [    4.602085] NET: Registered protocol family 17
> > [    4.606537] can: controller area network core (rev 20170425 abi 9)
> > [    4.612780] NET: Registered protocol family 29
> > [    4.617248] can: raw protocol (rev 20170425)
> > [    4.621524] can: broadcast manager protocol (rev 20170425 t)
> > [    4.627198] can: netlink gateway (rev 20190810) max_hops=1
> > [    4.632967] Key type dns_resolver registered
> > [    4.637328] Registering SWP/SWPB emulation handler
> > [    4.642410] Loading compiled-in X.509 certificates
> > [    4.688987] OF: translation of DMA address(0) to CPU address failed
> > node(/gpio-keys)
> > [    4.696780] irq: no irq domain found for interrupt-controller@510c0000 !
> > [    4.703556] gpio-keys gpio-keys: Found button without gpio or irq
> > [    4.709673] gpio-keys: probe of gpio-keys failed with error -22
> > [    4.715621] hctosys: unable to open rtc device (rtc0)
> > [    4.721044] uart-pl011 2a400000.uart: no DMA platform data
> > [    4.746912] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
> > [    4.754022] ata1.00: ATA-10: WDC WD10EZEX-22MFCA0, 01.01A01, max UDMA/133
> > [    4.760826] ata1.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA
> > [    4.768960] ata1.00: configured for UDMA/133
> > [    4.773637] scsi 0:0:0:0: Direct-Access     ATA      WDC
> > WD10EZEX-22M 1A01 PQ: 0 ANSI: 5
> > [    4.782675] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks:
> > (1.00 TB/932 GiB)
> > [    4.790362] sd 0:0:0:0: [sda] 4096-byte physical blocks
> > [    4.795635] sd 0:0:0:0: [sda] Write Protect is off
> > [    4.800505] sd 0:0:0:0: [sda] Write cache: enabled, read cache:
> > enabled, doesn't support DPO or FUA
> > [    4.846916] usb 1-3: new high-speed USB device number 2 using xhci_hcd
> > [    4.865348]  sda: sda1 sda2 sda3 sda4
> > [    4.871475] sd 0:0:0:0: [sda] Attached SCSI disk
> > [    4.887962] usb-storage 1-3:1.0: USB Mass Storage device detected
> > [    4.894715] scsi host2: usb-storage 1-3:1.0
> > [    5.109059] ata2: SATA link down (SStatus 0 SControl 300)
> > [    5.117814] Freeing unused kernel memory: 2048K
> > [    5.122861] Run /init as init process
> >
> > _______________________________________________
> > linux-arm-kernel mailing list
> > linux-arm-kernel@lists.infradead.org
> > http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
> >
Ard Biesheuvel Feb. 21, 2020, 3:54 p.m. UTC | #4 
On Fri, 21 Feb 2020 at 14:42, Ard Biesheuvel <ardb@kernel.org> wrote:
>
> On Fri, 21 Feb 2020 at 14:35, Robin Murphy <robin.murphy@arm.com> wrote:
> >
> > On 20/02/2020 6:08 pm, Ard Biesheuvel wrote:
> > > (+ Arnd)
> > >
> > > On Wed, 19 Feb 2020 at 10:43, Ard Biesheuvel <ardb@kernel.org> wrote:
> > >>
> > >> While making changes to the EFI stub startup code, I noticed that we are
> > >> still doing set/way maintenance on the caches when booting on v7 cores.
> > >> This works today on VMs by virtue of the fact that KVM traps set/way ops
> > >> and cleans the whole address space by VA on behalf of the guest, and on
> > >> most v7 hardware, the set/way ops are in fact sufficient when only one
> > >> core is running, as there usually is no system cache. But on systems
> > >> like SynQuacer, for which 32-bit firmware is available, the current cache
> > >> maintenance only pushes the data out to the L3 system cache, where it
> > >> is not visible to the CPU once it turns the MMU and caches off.
> > >>
> > >> So instead, switch to the by-VA cache maintenance that the architecture
> > >> requires for v7 and later (and ARM1176, as a side effect).
> > >>
> > >> Changes since v1:
> > >> - include the EFI patch that was sent out separately before (#1)
> > >> - split the preparatory work to pass the region to clean in r0/r1 in a EFI
> > >>    specific one and one for the decompressor - this way, the first two patches
> > >>    can go on a stable branch that is shared between the ARM tree and the EFI
> > >>    tree
> > >> - document the meaning of the values in r0/r1 upon entry to cache_clean_flush
> > >> - take care to treat the region end address as exclusive
> > >> - switch to clean+invalidate to align with the other implementations
> > >> - drop some code that manages the stack pointer value before calling
> > >>    cache_clean_flush(), which is no longer necessary
> > >> - take care to clean the entire region that is covered by the relocated zImage
> > >>    if it needs to relocate itself before decompressing
> > >>
> > >> https://git.kernel.org/pub/scm/linux/kernel/git/ardb/linux.git/log/?h=arm32-efi-cache-ops
> > >>
> > >
> > > Adding my own data point here: with these patches, I can reproducibly
> > > boot on the SynQuacer platform (24x Cortex-A53 + GICv3 + L3 system
> > > cache) until the point where /init is loaded, after which it hangs
> > > (see below), whereas without them, it always crashes early with weird,
> > > unreproducible errors, if it even makes it far enough through the
> > > decompressor to produce any earlycon output.
> > >
> > > There is some other weird stuff going on, but this is unlikely to be
> > > related to cache maintenance:
> > > - multiple occurrences of
> > >     OF: translation of DMA address(0) to CPU address failed node(...)
> >
> > FWIW that implies a "dma-ranges" property in the wrong place in the DT -
> > if you copied the now-gone Juno example of placing one directly in the
> > root node, that was bogus, sorry.
> >
>
> OK, so where should it be instead? Are you saying it is now required
> to have a /soc or /smb node that contains all the device nodes?
>

Never mind - I'll just drop "dma-ranges" from the root node entirely.
Robin Murphy Feb. 21, 2020, 4:09 p.m. UTC | #5 
On 21/02/2020 1:42 pm, Ard Biesheuvel wrote:
> On Fri, 21 Feb 2020 at 14:35, Robin Murphy <robin.murphy@arm.com> wrote:
>>
>> On 20/02/2020 6:08 pm, Ard Biesheuvel wrote:
>>> (+ Arnd)
>>>
>>> On Wed, 19 Feb 2020 at 10:43, Ard Biesheuvel <ardb@kernel.org> wrote:
>>>>
>>>> While making changes to the EFI stub startup code, I noticed that we are
>>>> still doing set/way maintenance on the caches when booting on v7 cores.
>>>> This works today on VMs by virtue of the fact that KVM traps set/way ops
>>>> and cleans the whole address space by VA on behalf of the guest, and on
>>>> most v7 hardware, the set/way ops are in fact sufficient when only one
>>>> core is running, as there usually is no system cache. But on systems
>>>> like SynQuacer, for which 32-bit firmware is available, the current cache
>>>> maintenance only pushes the data out to the L3 system cache, where it
>>>> is not visible to the CPU once it turns the MMU and caches off.
>>>>
>>>> So instead, switch to the by-VA cache maintenance that the architecture
>>>> requires for v7 and later (and ARM1176, as a side effect).
>>>>
>>>> Changes since v1:
>>>> - include the EFI patch that was sent out separately before (#1)
>>>> - split the preparatory work to pass the region to clean in r0/r1 in a EFI
>>>>     specific one and one for the decompressor - this way, the first two patches
>>>>     can go on a stable branch that is shared between the ARM tree and the EFI
>>>>     tree
>>>> - document the meaning of the values in r0/r1 upon entry to cache_clean_flush
>>>> - take care to treat the region end address as exclusive
>>>> - switch to clean+invalidate to align with the other implementations
>>>> - drop some code that manages the stack pointer value before calling
>>>>     cache_clean_flush(), which is no longer necessary
>>>> - take care to clean the entire region that is covered by the relocated zImage
>>>>     if it needs to relocate itself before decompressing
>>>>
>>>> https://git.kernel.org/pub/scm/linux/kernel/git/ardb/linux.git/log/?h=arm32-efi-cache-ops
>>>>
>>>
>>> Adding my own data point here: with these patches, I can reproducibly
>>> boot on the SynQuacer platform (24x Cortex-A53 + GICv3 + L3 system
>>> cache) until the point where /init is loaded, after which it hangs
>>> (see below), whereas without them, it always crashes early with weird,
>>> unreproducible errors, if it even makes it far enough through the
>>> decompressor to produce any earlycon output.
>>>
>>> There is some other weird stuff going on, but this is unlikely to be
>>> related to cache maintenance:
>>> - multiple occurrences of
>>>      OF: translation of DMA address(0) to CPU address failed node(...)
>>
>> FWIW that implies a "dma-ranges" property in the wrong place in the DT -
>> if you copied the now-gone Juno example of placing one directly in the
>> root node, that was bogus, sorry.
>>
> 
> OK, so where should it be instead? Are you saying it is now required
> to have a /soc or /smb node that contains all the device nodes?

That is now my understanding, yes - if there is some property of the 
system interconnect which is not entirely transparent relative to the 
conceptual CPU-visible physical address space and needs to be described, 
then the only way to correctly encode that in DT is with an explicit 
level of 'bus' in the hierarchy to represent that interconnect. 
Otherwise these address translation properties quickly end up in 
philosophical conundrums over what the parent of the root node is.

Robin.

>>> - /cpus/cpu@0: unsupported enable-method property: psci
>>
>> Missing CONFIG_ARM_PSCI_CPUIDLE? That's caught me out on more than one
>> occasion since 5.4.
>>
>> Robin.
>>
>>> Then, there is not enough vmalloc space to map the config space of
>>> both PCIe RCs.
>>>
>>> Also, due to the fact that this platform sadly honours the ARM
>>> recommendation on memory maps, it seems there is no way to make useful
>>> use of any memory beyond 2 GB, given that the hole between the lower 2
>>> GB and the upper <30 GB eats up all the lowmem by being covered by the
>>> memmap[] array. (Note that this platform supports up to 64 GB, in
>>> which case another hole of 480 GB is created, so there is no way we
>>> can even boot with that much memory reported to the kernel)
>>>
>>>
>>> Shell> initrd initrd.gz
>>> Shell> zImage
>>> EFI stub: Booting Linux Kernel...
>>> EFI stub: Using DTB from configuration table
>>> EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
>>> EFI stub: Exiting boot services and installing virtual address map...
>>> [    0.000000] Booting Linux on physical CPU 0x0
>>> [    0.000000] Linux version 5.6.0-rc1-00084-g8602a0ff0200-dirty
>>> (ardbie01@e123331-lin) (gcc version 7.4.0 (Ubuntu/Linaro
>>> 7.4.0-1ubuntu1~18.04.1)) #286 SMP Thu Feb 20 17:49:59 CET 2020
>>> [    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=70c5383d
>>> [    0.000000] CPU: div instructions available: patching division code
>>> [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing
>>> instruction cache
>>> [    0.000000] OF: fdt: Machine model: Socionext Developer Box
>>> [    0.000000] Memory policy: Data cache writealloc
>>> [    0.000000] efi: EFI v2.70 by EDK II
>>> [    0.000000] efi:  SMBIOS 3.0=0xffa1c000  MEMATTR=0xfd0b4010
>>> ESRT=0xfdfbb910  MEMRESERVE=0xf8f2d010
>>> [    0.000000] OF: fdt: Ignoring memory block 0x880000000 - 0x1000000000
>>> [    0.000000] esrt: Reserving ESRT space from 0x00000000fdfbb910 to
>>> 0x00000000fdfbb948.
>>> [    0.000000] cma: Reserved 64 MiB at 0x00000000f9000000
>>> [    0.000000] psci: probing for conduit method from DT.
>>> [    0.000000] psci: PSCIv1.1 detected in firmware.
>>> [    0.000000] psci: Using standard PSCI v0.2 function IDs
>>> [    0.000000] psci: MIGRATE_INFO_TYPE not supported.
>>> [    0.000000] psci: SMC Calling Convention v1.0
>>> [    0.000000] percpu: Embedded 20 pages/cpu s49356 r8192 d24372 u81920
>>> [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 522368
>>> [    0.000000] Kernel command line: zImage
>>> [    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
>>> [    0.000000] printk: log_buf_len total cpu_extra contributions: 94208 bytes
>>> [    0.000000] printk: log_buf_len min size: 131072 bytes
>>> [    0.000000] printk: log_buf_len: 262144 bytes
>>> [    0.000000] printk: early log buf free: 128828(98%)
>>> [    0.000000] Dentry cache hash table entries: 131072 (order: 7,
>>> 524288 bytes, linear)
>>> [    0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144
>>> bytes, linear)
>>> [    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
>>> [    0.000000] software IO TLB: mapped [mem 0xaa90c000-0xae90c000] (64MB)
>>> [    0.000000] Memory: 1886672K/2097152K available (10240K kernel
>>> code, 1811K rwdata, 5392K rodata, 2048K init, 414K bss, 144944K
>>> reserved, 65536K cma-reserved, 1233168K highmem)
>>> [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
>>> [    0.000000] rcu: Hierarchical RCU implementation.
>>> [    0.000000] rcu:     RCU event tracing is enabled.
>>> [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay
>>> is 10 jiffies.
>>> [    0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
>>> [    0.000000] GICv3: 640 SPIs implemented
>>> [    0.000000] GICv3: 0 Extended SPIs implemented
>>> [    0.000000] GICv3: Distributor has no Range Selector support
>>> [    0.000000] GICv3: 16 PPIs implemented
>>> [    0.000000] GICv3: no VLPI support, no direct LPI support, no RVPEID support
>>> [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x0000000030400000
>>> [    0.000000] ITS [mem 0x30020000-0x3003ffff]
>>> [    0.000000] GIC: enabling workaround for ITS: Socionext Synquacer pre-ITS
>>> [    0.000000] ITS@0x0000000030020000: allocated 524288 Devices
>>> @aa400000 (flat, esz 8, psz 64K, shr 0)
>>> [    0.000000] ITS: using cache flushing for cmd queue
>>> [    0.000000] GICv3: using LPI property table @0x00000000aa080000
>>> [    0.000000] GIC: using cache flushing for LPI property table
>>> [    0.000000] GICv3: CPU0: using allocated LPI pending table
>>> @0x00000000aa090000
>>> [    0.000000] random: get_random_bytes called from
>>> start_kernel+0x469/0x5ca with crng_init=0
>>> [    0.000000] arch_timer: cp15 and mmio timer(s) running at 100.00MHz
>>> (virt/phys).
>>> [    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
>>> max_cycles: 0x171024e7e0, max_idle_ns: 440795205315 ns
>>> [    0.000004] sched_clock: 56 bits at 100MHz, resolution 10ns, wraps
>>> every 4398046511100ns
>>> [    0.000013] Switching to timer-based delay loop, resolution 10ns
>>> [    0.000890] Console: colour dummy device 80x30
>>> [    0.001344] printk: console [tty0] enabled
>>> [    0.001389] Calibrating delay loop (skipped), value calculated
>>> using timer frequency.. 200.00 BogoMIPS (lpj=1000000)
>>> [    0.001410] pid_max: default: 32768 minimum: 301
>>> [    0.001561] Mount-cache hash table entries: 2048 (order: 1, 8192
>>> bytes, linear)
>>> [    0.001581] Mountpoint-cache hash table entries: 2048 (order: 1,
>>> 8192 bytes, linear)
>>> [    0.002112] CPU: Testing write buffer coherency: ok
>>> [    0.002637] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
>>> [    0.002926] Setting up static identity map for 0x80400000 - 0x80400160
>>> [    0.003448] rcu: Hierarchical SRCU implementation.
>>> [    0.003601] Platform MSI: gic-its@30020000 domain created
>>> [    0.003669] PCI/MSI:
>>> /interrupt-controller@30000000/gic-its@30020000 domain created
>>> [    0.004751] Remapping and enabling EFI services.
>>> [    0.005305] smp: Bringing up secondary CPUs ...
>>> [    0.005895] GICv3: CPU1: found redistributor 1 region 0:0x0000000030420000
>>> [    0.005919] GICv3: CPU1: using allocated LPI pending table
>>> @0x00000000aa0a0000
>>> [    0.005940] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
>>> [    0.011149] GICv3: CPU2: found redistributor 100 region 0:0x0000000030440000
>>> [    0.011179] GICv3: CPU2: using allocated LPI pending table
>>> @0x00000000aa0b0000
>>> [    0.011203] CPU2: thread -1, cpu 0, socket 1, mpidr 80000100
>>> [    0.014242] GICv3: CPU3: found redistributor 101 region 0:0x0000000030460000
>>> [    0.014264] GICv3: CPU3: using allocated LPI pending table
>>> @0x00000000aa0c0000
>>> [    0.014284] CPU3: thread -1, cpu 1, socket 1, mpidr 80000101
>>> [    0.019622] GICv3: CPU4: found redistributor 200 region 0:0x0000000030480000
>>> [    0.019650] GICv3: CPU4: using allocated LPI pending table
>>> @0x00000000aa0d0000
>>> [    0.019675] CPU4: thread -1, cpu 0, socket 2, mpidr 80000200
>>> [    0.022737] GICv3: CPU5: found redistributor 201 region 0:0x00000000304a0000
>>> [    0.022759] GICv3: CPU5: using allocated LPI pending table
>>> @0x00000000aa0e0000
>>> [    0.022777] CPU5: thread -1, cpu 1, socket 2, mpidr 80000201
>>> [    0.028146] GICv3: CPU6: found redistributor 300 region 0:0x00000000304c0000
>>> [    0.028174] GICv3: CPU6: using allocated LPI pending table
>>> @0x00000000aa0f0000
>>> [    0.028196] CPU6: thread -1, cpu 0, socket 3, mpidr 80000300
>>> [    0.031213] GICv3: CPU7: found redistributor 301 region 0:0x00000000304e0000
>>> [    0.031239] GICv3: CPU7: using allocated LPI pending table
>>> @0x00000000aa100000
>>> [    0.031256] CPU7: thread -1, cpu 1, socket 3, mpidr 80000301
>>> [    0.036606] GICv3: CPU8: found redistributor 400 region 0:0x0000000030500000
>>> [    0.036634] GICv3: CPU8: using allocated LPI pending table
>>> @0x00000000aa110000
>>> [    0.036657] CPU8: thread -1, cpu 0, socket 4, mpidr 80000400
>>> [    0.039719] GICv3: CPU9: found redistributor 401 region 0:0x0000000030520000
>>> [    0.039740] GICv3: CPU9: using allocated LPI pending table
>>> @0x00000000aa120000
>>> [    0.039757] CPU9: thread -1, cpu 1, socket 4, mpidr 80000401
>>> [    0.045156] GICv3: CPU10: found redistributor 500 region 0:0x0000000030540000
>>> [    0.045187] GICv3: CPU10: using allocated LPI pending table
>>> @0x00000000aa130000
>>> [    0.045210] CPU10: thread -1, cpu 0, socket 5, mpidr 80000500
>>> [    0.048241] GICv3: CPU11: found redistributor 501 region 0:0x0000000030560000
>>> [    0.048263] GICv3: CPU11: using allocated LPI pending table
>>> @0x00000000aa140000
>>> [    0.048282] CPU11: thread -1, cpu 1, socket 5, mpidr 80000501
>>> [    0.053651] GICv3: CPU12: found redistributor 600 region 0:0x0000000030580000
>>> [    0.053681] GICv3: CPU12: using allocated LPI pending table
>>> @0x00000000aa150000
>>> [    0.053706] CPU12: thread -1, cpu 0, socket 6, mpidr 80000600
>>> [    0.056742] GICv3: CPU13: found redistributor 601 region 0:0x00000000305a0000
>>> [    0.056765] GICv3: CPU13: using allocated LPI pending table
>>> @0x00000000aa160000
>>> [    0.056785] CPU13: thread -1, cpu 1, socket 6, mpidr 80000601
>>> [    0.062113] GICv3: CPU14: found redistributor 700 region 0:0x00000000305c0000
>>> [    0.062144] GICv3: CPU14: using allocated LPI pending table
>>> @0x00000000aa170000
>>> [    0.062166] CPU14: thread -1, cpu 0, socket 7, mpidr 80000700
>>> [    0.065238] GICv3: CPU15: found redistributor 701 region 0:0x00000000305e0000
>>> [    0.065263] GICv3: CPU15: using allocated LPI pending table
>>> @0x00000000aa180000
>>> [    0.065282] CPU15: thread -1, cpu 1, socket 7, mpidr 80000701
>>> [    0.070661] GICv3: CPU16: found redistributor 800 region 0:0x0000000030600000
>>> [    0.070691] GICv3: CPU16: using allocated LPI pending table
>>> @0x00000000aa190000
>>> [    0.070716] CPU16: thread -1, cpu 0, socket 8, mpidr 80000800
>>> [    0.073748] GICv3: CPU17: found redistributor 801 region 0:0x0000000030620000
>>> [    0.073774] GICv3: CPU17: using allocated LPI pending table
>>> @0x00000000aa1a0000
>>> [    0.073794] CPU17: thread -1, cpu 1, socket 8, mpidr 80000801
>>> [    0.079132] GICv3: CPU18: found redistributor 900 region 0:0x0000000030640000
>>> [    0.079163] GICv3: CPU18: using allocated LPI pending table
>>> @0x00000000aa1b0000
>>> [    0.079187] CPU18: thread -1, cpu 0, socket 9, mpidr 80000900
>>> [    0.082216] GICv3: CPU19: found redistributor 901 region 0:0x0000000030660000
>>> [    0.082239] GICv3: CPU19: using allocated LPI pending table
>>> @0x00000000aa1c0000
>>> [    0.082257] CPU19: thread -1, cpu 1, socket 9, mpidr 80000901
>>> [    0.087755] GICv3: CPU20: found redistributor a00 region 0:0x0000000030680000
>>> [    0.087788] GICv3: CPU20: using allocated LPI pending table
>>> @0x00000000aa1d0000
>>> [    0.087811] CPU20: thread -1, cpu 0, socket 10, mpidr 80000a00
>>> [    0.090897] GICv3: CPU21: found redistributor a01 region 0:0x00000000306a0000
>>> [    0.090922] GICv3: CPU21: using allocated LPI pending table
>>> @0x00000000aa1e0000
>>> [    0.090939] CPU21: thread -1, cpu 1, socket 10, mpidr 80000a01
>>> [    0.096296] GICv3: CPU22: found redistributor b00 region 0:0x00000000306c0000
>>> [    0.096329] GICv3: CPU22: using allocated LPI pending table
>>> @0x00000000aa1f0000
>>> [    0.096353] CPU22: thread -1, cpu 0, socket 11, mpidr 80000b00
>>> [    0.099356] GICv3: CPU23: found redistributor b01 region 0:0x00000000306e0000
>>> [    0.099381] GICv3: CPU23: using allocated LPI pending table
>>> @0x00000000aa200000
>>> [    0.099400] CPU23: thread -1, cpu 1, socket 11, mpidr 80000b01
>>> [    0.099506] smp: Brought up 1 node, 24 CPUs
>>> [    0.100163] SMP: Total of 24 processors activated (4800.00 BogoMIPS).
>>> [    0.100175] CPU: All CPU(s) started in SVC mode.
>>> [    0.101193] devtmpfs: initialized
>>> [    0.103698] VFP support v0.3: implementor 41 architecture 3 part 40
>>> variant 3 rev 4
>>> [    0.103980] clocksource: jiffies: mask: 0xffffffff max_cycles:
>>> 0xffffffff, max_idle_ns: 19112604462750000 ns
>>> [    0.104009] futex hash table entries: 8192 (order: 7, 524288 bytes, linear)
>>> [    0.106670] pinctrl core: initialized pinctrl subsystem
>>> [    0.107566] thermal_sys: Registered thermal governor 'step_wise'
>>> [    0.107754] SMBIOS 3.3.0 present.
>>> [    0.107788] DMI: Socionext SynQuacer E-series DeveloperBox, BIOS
>>> build #1 Feb 20 2020
>>> [    0.108185] NET: Registered protocol family 16
>>> [    0.109556] DMA: preallocated 256 KiB pool for atomic coherent allocations
>>> [    0.110957] cpuidle: using governor menu
>>> [    0.111063] No ATAGs?
>>> [    0.111467] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4
>>> watchpoint registers.
>>> [    0.111490] hw-breakpoint: maximum watchpoint size is 8 bytes.
>>> [    0.112874] Serial: AMBA PL011 UART driver
>>> [    0.114349] OF: translation of DMA address(0) to CPU address failed
>>> node(/uart@2a400000)
>>> [    0.114421] 2a400000.uart: ttyAMA0 at MMIO 0x2a400000 (irq = 22,
>>> base_baud = 0) is a PL011 rev3
>>> [    1.117194] printk: console [ttyAMA0] enabled
>>> [    1.135592] AT91: Could not find identification node
>>> [    1.136261] iommu: Default domain type: Translated
>>> [    1.146225] vgaarb: loaded
>>> [    1.149407] SCSI subsystem initialized
>>> [    1.153506] usbcore: registered new interface driver usbfs
>>> [    1.159042] usbcore: registered new interface driver hub
>>> [    1.164477] usbcore: registered new device driver usb
>>> [    1.169950] pps_core: LinuxPPS API ver. 1 registered
>>> [    1.174911] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
>>> Rodolfo Giometti <giometti@linux.it>
>>> [    1.184062] PTP clock support registered
>>> [    1.188042] EDAC MC: Ver: 3.0.0
>>> [    1.191660] Registered efivars operations
>>> [    1.196838] clocksource: Switched to clocksource arch_sys_counter
>>> [    2.103835] NET: Registered protocol family 2
>>> [    2.108658] tcp_listen_portaddr_hash hash table entries: 512
>>> (order: 0, 6144 bytes, linear)
>>> [    2.117044] TCP established hash table entries: 8192 (order: 3,
>>> 32768 bytes, linear)
>>> [    2.124854] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
>>> [    2.132103] TCP: Hash tables configured (established 8192 bind 8192)
>>> [    2.138585] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
>>> [    2.145223] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
>>> [    2.152446] NET: Registered protocol family 1
>>> [    2.157108] RPC: Registered named UNIX socket transport module.
>>> [    2.163026] RPC: Registered udp transport module.
>>> [    2.167746] RPC: Registered tcp transport module.
>>> [    2.172445] RPC: Registered tcp NFSv4.1 backchannel transport module.
>>> [    2.178897] PCI: CLS 0 bytes, default 64
>>> [    2.183052] Trying to unpack rootfs image as initramfs...
>>> [    3.413006] Freeing initrd memory: 22816K
>>> [    3.418665] Initialise system trusted keyrings
>>> [    3.423276] workingset: timestamp_bits=30 max_order=19 bucket_order=0
>>> [    3.434628] squashfs: version 4.0 (2009/01/31) Phillip Lougher
>>> [    3.441097] NFS: Registering the id_resolver key type
>>> [    3.446175] Key type id_resolver registered
>>> [    3.450375] Key type id_legacy registered
>>> [    3.454388] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
>>> [    3.461111] ntfs: driver 2.1.32 [Flags: R/O].
>>> [    3.465747] Key type asymmetric registered
>>> [    3.469857] Asymmetric key parser 'x509' registered
>>> [    3.474765] bounce: pool size: 64 pages
>>> [    3.478629] Block layer SCSI generic (bsg) driver version 0.4
>>> loaded (major 247)
>>> [    3.486027] io scheduler mq-deadline registered
>>> [    3.490564] io scheduler kyber registered
>>> [    3.500170] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    3.508318] pci-host-generic 60000000.pcie: host bridge
>>> /pcie@60000000 ranges:
>>> [    3.515556] pci-host-generic 60000000.pcie:       IO
>>> 0x0067f00000..0x0067f0ffff -> 0x0000000000
>>> [    3.524276] pci-host-generic 60000000.pcie:      MEM
>>> 0x0068000000..0x006fffffff -> 0x0068000000
>>> [    3.532987] pci-host-generic 60000000.pcie:      MEM
>>> 0x3e00000000..0x3effffffff -> 0x3e00000000
>>> [    3.543045] pci-host-generic 60000000.pcie: ECAM at [mem
>>> 0x60000000-0x67efffff] for [bus 00-7e]
>>> [    3.551873] pci-host-generic 60000000.pcie: PCI host bridge to bus 0000:00
>>> [    3.558764] pci_bus 0000:00: root bus resource [bus 00-7e]
>>> [    3.564250] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
>>> [    3.570438] pci_bus 0000:00: root bus resource [mem 0x68000000-0x6fffffff]
>>> [    3.577322] pci_bus 0000:00: root bus resource [mem
>>> 0x3e00000000-0x3effffffff]
>>> [    3.584574] pci 0000:00:00.0: [1b21:1184] type 01 class 0x060400
>>> [    3.590646] pci 0000:00:00.0: enabling Extended Tags
>>> [    3.595677] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
>>> [    3.602874] PCI: bus0: Fast back to back transfers disabled
>>> [    3.608585] pci 0000:01:01.0: [1b21:1184] type 01 class 0x060400
>>> [    3.614645] pci 0000:01:01.0: enabling Extended Tags
>>> [    3.619672] pci 0000:01:01.0: PME# supported from D0 D3hot D3cold
>>> [    3.625969] pci 0000:01:03.0: [1b21:1184] type 01 class 0x060400
>>> [    3.632040] pci 0000:01:03.0: enabling Extended Tags
>>> [    3.637066] pci 0000:01:03.0: PME# supported from D0 D3hot D3cold
>>> [    3.643363] pci 0000:01:05.0: [1b21:1184] type 01 class 0x060400
>>> [    3.649431] pci 0000:01:05.0: enabling Extended Tags
>>> [    3.654449] pci 0000:01:05.0: PME# supported from D0 D3hot D3cold
>>> [    3.660753] pci 0000:01:07.0: [1b21:1184] type 01 class 0x060400
>>> [    3.666822] pci 0000:01:07.0: enabling Extended Tags
>>> [    3.671844] pci 0000:01:07.0: PME# supported from D0 D3hot D3cold
>>> [    3.678832] PCI: bus1: Fast back to back transfers disabled
>>> [    3.684517] pci 0000:02:00.0: [1b21:0612] type 00 class 0x010601
>>> [    3.690564] pci 0000:02:00.0: reg 0x10: [io  0x0028-0x002f]
>>> [    3.696147] pci 0000:02:00.0: reg 0x14: [io  0x0034-0x0037]
>>> [    3.701738] pci 0000:02:00.0: reg 0x18: [io  0x0020-0x0027]
>>> [    3.707329] pci 0000:02:00.0: reg 0x1c: [io  0x0030-0x0033]
>>> [    3.712912] pci 0000:02:00.0: reg 0x20: [io  0x0000-0x001f]
>>> [    3.718503] pci 0000:02:00.0: reg 0x24: [mem 0x68100000-0x681001ff]
>>> [    3.724781] pci 0000:02:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
>>> [    3.732590] PCI: bus2: Fast back to back transfers disabled
>>> [    3.738174] pci_bus 0000:02: busn_res: [bus 02-7e] end is updated to 02
>>> [    3.745751] PCI: bus3: Fast back to back transfers enabled
>>> [    3.751247] pci_bus 0000:03: busn_res: [bus 03-7e] end is updated to 03
>>> [    3.757969] pci 0000:04:00.0: [1912:0014] type 00 class 0x0c0330
>>> [    3.764012] pci 0000:04:00.0: reg 0x10: [mem 0x68000000-0x68001fff 64bit]
>>> [    3.770943] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
>>> [    3.807778] PCI: bus4: Fast back to back transfers disabled
>>> [    3.813353] pci_bus 0000:04: busn_res: [bus 04-7e] end is updated to 04
>>> [    3.820943] PCI: bus5: Fast back to back transfers enabled
>>> [    3.826430] pci_bus 0000:05: busn_res: [bus 05-7e] end is updated to 05
>>> [    3.833058] pci_bus 0000:01: busn_res: [bus 01-7e] end is updated to 05
>>> [    3.839709] pci 0000:00:00.0: BAR 8: assigned [mem 0x68000000-0x681fffff]
>>> [    3.846498] pci 0000:00:00.0: BAR 7: assigned [io  0x1000-0x1fff]
>>> [    3.852603] pci 0000:01:01.0: BAR 8: assigned [mem 0x68000000-0x680fffff]
>>> [    3.859402] pci 0000:01:05.0: BAR 8: assigned [mem 0x68100000-0x681fffff]
>>> [    3.866190] pci 0000:01:01.0: BAR 7: assigned [io  0x1000-0x1fff]
>>> [    3.872294] pci 0000:02:00.0: BAR 6: assigned [mem
>>> 0x68000000-0x6800ffff pref]
>>> [    3.879529] pci 0000:02:00.0: BAR 5: assigned [mem 0x68010000-0x680101ff]
>>> [    3.886321] pci 0000:02:00.0: BAR 4: assigned [io  0x1000-0x101f]
>>> [    3.892425] pci 0000:02:00.0: BAR 0: assigned [io  0x1020-0x1027]
>>> [    3.898529] pci 0000:02:00.0: BAR 2: assigned [io  0x1028-0x102f]
>>> [    3.904627] pci 0000:02:00.0: BAR 1: assigned [io  0x1030-0x1033]
>>> [    3.910730] pci 0000:02:00.0: BAR 3: assigned [io  0x1034-0x1037]
>>> [    3.916834] pci 0000:01:01.0: PCI bridge to [bus 02]
>>> [    3.921799] pci 0000:01:01.0:   bridge window [io  0x1000-0x1fff]
>>> [    3.927903] pci 0000:01:01.0:   bridge window [mem 0x68000000-0x680fffff]
>>> [    3.934697] pci 0000:01:03.0: PCI bridge to [bus 03]
>>> [    3.939682] pci 0000:04:00.0: BAR 0: assigned [mem
>>> 0x68100000-0x68101fff 64bit]
>>> [    3.947012] pci 0000:01:05.0: PCI bridge to [bus 04]
>>> [    3.951979] pci 0000:01:05.0:   bridge window [mem 0x68100000-0x681fffff]
>>> [    3.958780] pci 0000:01:07.0: PCI bridge to [bus 05]
>>> [    3.963754] pci 0000:00:00.0: PCI bridge to [bus 01-05]
>>> [    3.968985] pci 0000:00:00.0:   bridge window [io  0x1000-0x1fff]
>>> [    3.975081] pci 0000:00:00.0:   bridge window [mem 0x68000000-0x681fffff]
>>> [    3.981914] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    3.990313] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    3.998662] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    4.007005] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    4.015339] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    4.023694] pci 0000:04:00.0: enabling device (0140 -> 0142)
>>> [    4.029447] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@70000000)
>>> [    4.037570] pci-host-generic 70000000.pcie: host bridge
>>> /pcie@70000000 ranges:
>>> [    4.044805] pci-host-generic 70000000.pcie:       IO
>>> 0x0077f00000..0x0077f0ffff -> 0x0000000000
>>> [    4.053523] pci-host-generic 70000000.pcie:      MEM
>>> 0x0078000000..0x007fffffff -> 0x0078000000
>>> [    4.062236] pci-host-generic 70000000.pcie:      MEM
>>> 0x3f00000000..0x3fffffffff -> 0x3f00000000
>>> [    4.071308] vmap allocation for size 1052672 failed: use
>>> vmalloc=<size> to increase size
>>> [    4.079411] pci-host-generic 70000000.pcie: ECAM ioremap failed
>>> [    4.085525] pci-host-generic: probe of 70000000.pcie failed with error -12
>>> [    4.126494] Serial: 8250/16550 driver, 5 ports, IRQ sharing enabled
>>> [    4.134170] OF: translation of DMA address(0) to CPU address failed
>>> node(/uart@51040000)
>>> [    4.142748] 51040000.uart: ttyS1 at MMIO 0x51040000 (irq = 23,
>>> base_baud = 3906250) is a 16550A
>>> [    4.152099] SuperH (H)SCI(F) driver initialized
>>> [    4.156953] msm_serial: driver initialized
>>> [    4.161103] STMicroelectronics ASC driver initialized
>>> [    4.166594] STM32 USART driver initialized
>>> [    4.178363] brd: module loaded
>>> [    4.192943] loop: module loaded
>>> [    4.197009] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    4.205330] ahci 0000:02:00.0: SSS flag set, parallel bus scan disabled
>>> [    4.212015] ahci 0000:02:00.0: AHCI 0001.0200 32 slots 2 ports 6
>>> Gbps 0x3 impl SATA mode
>>> [    4.220122] ahci 0000:02:00.0: flags: 64bit ncq sntf stag led clo
>>> pmp pio slum part ccc sxs
>>> [    4.229431] scsi host0: ahci
>>> [    4.232675] scsi host1: ahci
>>> [    4.235694] ata1: SATA max UDMA/133 abar m512@0x68010000 port
>>> 0x68010100 irq 35
>>> [    4.243033] ata2: SATA max UDMA/133 abar m512@0x68010000 port
>>> 0x68010180 irq 35
>>> [    4.253906] libphy: Fixed MDIO Bus: probed
>>> [    4.258796] CAN device driver interface
>>> [    4.262933] bgmac_bcma: Broadcom 47xx GBit MAC driver loaded
>>> [    4.268942] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
>>> [    4.274772] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
>>> [    4.280739] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k
>>> [    4.287707] igb: Copyright (c) 2007-2014 Intel Corporation.
>>> [    4.294603] pegasus: v0.9.3 (2013/04/25), Pegasus/Pegasus II USB
>>> Ethernet driver
>>> [    4.302042] usbcore: registered new interface driver pegasus
>>> [    4.307736] usbcore: registered new interface driver asix
>>> [    4.313150] usbcore: registered new interface driver ax88179_178a
>>> [    4.319267] usbcore: registered new interface driver cdc_ether
>>> [    4.325122] usbcore: registered new interface driver smsc75xx
>>> [    4.330901] usbcore: registered new interface driver smsc95xx
>>> [    4.336663] usbcore: registered new interface driver net1080
>>> [    4.342350] usbcore: registered new interface driver cdc_subset
>>> [    4.348295] usbcore: registered new interface driver zaurus
>>> [    4.353894] usbcore: registered new interface driver cdc_ncm
>>> [    4.360347] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
>>> [    4.366891] ehci-pci: EHCI PCI platform driver
>>> [    4.371359] ehci-platform: EHCI generic platform driver
>>> [    4.376646] ehci-orion: EHCI orion driver
>>> [    4.380714] SPEAr-ehci: EHCI SPEAr driver
>>> [    4.384767] ehci-st: EHCI STMicroelectronics driver
>>> [    4.389704] ehci-exynos: EHCI Exynos driver
>>> [    4.393931] ehci-atmel: EHCI Atmel driver
>>> [    4.397991] tegra-ehci: Tegra EHCI driver
>>> [    4.402048] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
>>> [    4.408245] ohci-pci: OHCI PCI platform driver
>>> [    4.412714] ohci-platform: OHCI generic platform driver
>>> [    4.418003] SPEAr-ohci: OHCI SPEAr driver
>>> [    4.422057] ohci-st: OHCI STMicroelectronics driver
>>> [    4.426995] ohci-atmel: OHCI Atmel driver
>>> [    4.431085] OF: translation of DMA address(0) to CPU address failed
>>> node(/pcie@60000000)
>>> [    4.439259] xhci_hcd 0000:04:00.0: xHCI Host Controller
>>> [    4.444497] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
>>> bus number 1
>>> [    4.457324] xhci_hcd 0000:04:00.0: hcc params 0x014051cf hci
>>> version 0x100 quirks 0x0000000100000410
>>> [    4.467671] hub 1-0:1.0: USB hub found
>>> [    4.471449] hub 1-0:1.0: 4 ports detected
>>> [    4.475927] xhci_hcd 0000:04:00.0: xHCI Host Controller
>>> [    4.481175] xhci_hcd 0000:04:00.0: new USB bus registered, assigned
>>> bus number 2
>>> [    4.488585] xhci_hcd 0000:04:00.0: Host supports USB 3.0 SuperSpeed
>>> [    4.494924] usb usb2: We don't know the algorithms for LPM for this
>>> host, disabling LPM.
>>> [    4.503372] hub 2-0:1.0: USB hub found
>>> [    4.507155] hub 2-0:1.0: 4 ports detected
>>> [    4.511847] usbcore: registered new interface driver usb-storage
>>> [    4.519900] i2c /dev entries driver
>>> [    4.528493] /cpus/cpu@0: unsupported enable-method property: psci
>>> [    4.537114] sdhci: Secure Digital Host Controller Interface driver
>>> [    4.543297] sdhci: Copyright(c) Pierre Ossman
>>> [    4.548328] Synopsys Designware Multimedia Card Interface Driver
>>> [    4.554829] sdhci-pltfm: SDHCI platform and OF driver helper
>>> [    4.562104] ledtrig-cpu: registered to indicate activity on CPUs
>>> [    4.568594] usbcore: registered new interface driver usbhid
>>> [    4.574168] usbhid: USB HID core driver
>>> [    4.579546] drop_monitor: Initializing network drop monitor service
>>> [    4.586552] NET: Registered protocol family 10
>>> [    4.591887] Segment Routing with IPv6
>>> [    4.595614] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
>>> [    4.602085] NET: Registered protocol family 17
>>> [    4.606537] can: controller area network core (rev 20170425 abi 9)
>>> [    4.612780] NET: Registered protocol family 29
>>> [    4.617248] can: raw protocol (rev 20170425)
>>> [    4.621524] can: broadcast manager protocol (rev 20170425 t)
>>> [    4.627198] can: netlink gateway (rev 20190810) max_hops=1
>>> [    4.632967] Key type dns_resolver registered
>>> [    4.637328] Registering SWP/SWPB emulation handler
>>> [    4.642410] Loading compiled-in X.509 certificates
>>> [    4.688987] OF: translation of DMA address(0) to CPU address failed
>>> node(/gpio-keys)
>>> [    4.696780] irq: no irq domain found for interrupt-controller@510c0000 !
>>> [    4.703556] gpio-keys gpio-keys: Found button without gpio or irq
>>> [    4.709673] gpio-keys: probe of gpio-keys failed with error -22
>>> [    4.715621] hctosys: unable to open rtc device (rtc0)
>>> [    4.721044] uart-pl011 2a400000.uart: no DMA platform data
>>> [    4.746912] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
>>> [    4.754022] ata1.00: ATA-10: WDC WD10EZEX-22MFCA0, 01.01A01, max UDMA/133
>>> [    4.760826] ata1.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA
>>> [    4.768960] ata1.00: configured for UDMA/133
>>> [    4.773637] scsi 0:0:0:0: Direct-Access     ATA      WDC
>>> WD10EZEX-22M 1A01 PQ: 0 ANSI: 5
>>> [    4.782675] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks:
>>> (1.00 TB/932 GiB)
>>> [    4.790362] sd 0:0:0:0: [sda] 4096-byte physical blocks
>>> [    4.795635] sd 0:0:0:0: [sda] Write Protect is off
>>> [    4.800505] sd 0:0:0:0: [sda] Write cache: enabled, read cache:
>>> enabled, doesn't support DPO or FUA
>>> [    4.846916] usb 1-3: new high-speed USB device number 2 using xhci_hcd
>>> [    4.865348]  sda: sda1 sda2 sda3 sda4
>>> [    4.871475] sd 0:0:0:0: [sda] Attached SCSI disk
>>> [    4.887962] usb-storage 1-3:1.0: USB Mass Storage device detected
>>> [    4.894715] scsi host2: usb-storage 1-3:1.0
>>> [    5.109059] ata2: SATA link down (SStatus 0 SControl 300)
>>> [    5.117814] Freeing unused kernel memory: 2048K
>>> [    5.122861] Run /init as init process
>>>
>>> _______________________________________________
>>> linux-arm-kernel mailing list
>>> linux-arm-kernel@lists.infradead.org
>>> http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
>>>
Linus Walleij Feb. 22, 2020, 11:38 p.m. UTC | #6 
On Fri, Feb 21, 2020 at 5:09 PM Robin Murphy <robin.murphy@arm.com> wrote:
> On 21/02/2020 1:42 pm, Ard Biesheuvel wrote:

> > OK, so where should it be instead? Are you saying it is now required
> > to have a /soc or /smb node that contains all the device nodes?
>
> That is now my understanding, yes - if there is some property of the
> system interconnect which is not entirely transparent relative to the
> conceptual CPU-visible physical address space and needs to be described,
> then the only way to correctly encode that in DT is with an explicit
> level of 'bus' in the hierarchy to represent that interconnect.
> Otherwise these address translation properties quickly end up in
> philosophical conundrums over what the parent of the root node is.

This confirms my similar understanding. Rob sent a patch to
remove the root level dma-ranges from the ARM Integrator,
and I have since added it back below the logic module bus
after you pointed out that the dma-ranges was actually there
for that very bus.

Yours,
Linus Walleij