[V5,0/8] iommu/arm: Add Renesas IPMMU-VMSA support + Linux's iommu_fwspec

Message

Oleksandr Tyshchenko Sept. 24, 2019, 3:30 p.m. UTC

From: Oleksandr Tyshchenko <[e-mail]>

The purpose of this patch series is to add IPMMU-VMSA support to Xen on ARM.

Besides new IOMMU driver, this series contains "iommu_fwspec" support
and new API iommu_add_dt_device() for adding DT device to IOMMU and many other 
things.

The IPMMU-VMSA is VMSA-compatible I/O Memory Management Unit (IOMMU)
which provides address translation and access protection functionalities
to processing units and interconnect networks.

Please note, this driver is supposed to work only with newest
R-Car Gen3 SoCs revisions which IPMMU hardware supports stage 2 translation
table format and is able to use CPU's P2M table as is if one is
3-level page table (up to 40 bit IPA).

----------
This driver is based on Linux's IPMMU-VMSA driver from Renesas BSP:
https://git.kernel.org/pub/scm/linux/kernel/git/horms/renesas-bsp.git/tree/drivers/iommu/ipmmu-vmsa.c?h=v4.14.75-ltsi/rcar-3.9.6
and Xen's SMMU driver:
xen/drivers/passthrough/arm/smmu.c

Although Xen driver has a lot in common with Linux driver, it is not
a "direct ported" copy and should be treated as such.

The major differences compare to the Linux driver are:

1. Stage 1/Stage 2 translation. Linux driver supports Stage 1
translation only (with Stage 1 translation table format). It manages
page table by itself. But Xen driver supports Stage 2 translation
(with Stage 2 translation table format) to be able to share the P2M
with the CPU. Stage 1 translation is always bypassed in Xen driver.

So, Xen driver is supposed to be used with newest R-Car Gen3 SoC revisions only
(H3 ES3.0, M3-W+, etc.) which IPMMU H/W supports stage 2 translation
table format.

2. AArch64 support. Linux driver uses VMSAv8-32 mode, while Xen driver
enables Armv8 VMSAv8-64 mode to cover up to 40 bit input address.

3. Context bank (sets of page table) usage. In Xen, each context bank is
mapped to one Xen domain. So, all devices being pass throughed to the
same Xen domain share the same context bank.

4. IPMMU device tracking. In Xen, all IPMMU devices are managed
by single driver instance. So, driver uses global list to keep track
of registered devices.

----------
Series was tested on R-Car Gen3 H3 ES3.0/M3N ES1.0 based boards using current staging
(df29d03 libxc/x86: avoid certain overflows in CPUID APIC ID adjustments)
in a system with several DMA masters being assigned to different guest domains.
Guest domain reboot, destroy/create are functional.  

You can find the whole series here:
repo: https://github.com/otyshchenko1/xen.git branch: ipmmu_upstream5

You can find previous discussions here:
[V1] https://lists.xenproject.org/archives/html/xen-devel/2019-06/msg01755.html
[V2] https://lists.xenproject.org/archives/html/xen-devel/2019-08/msg00253.html
[V3] https://lists.xenproject.org/archives/html/xen-devel/2019-08/msg01948.html
[V4] https://lists.xenproject.org/archives/html/xen-devel/2019-09/msg01255.html

Also, please note, there is a patch in ML which is intended to address the main TODO
in the IPMMU-VMSA driver (I am about to send non-RFC version):
https://lists.xenproject.org/archives/html/xen-devel/2019-09/msg00973.html

For convenience:
1. iommu/arm: Add iommu_helpers.c file to keep common for IOMMUs stuff
   A-b
2. iommu/arm: Add ability to handle deferred probing request
   R-b
3. xen/common: Introduce _xrealloc function
   -none- 
4. xen/common: Introduce xrealloc_flex_struct() helper macros
   R-b
5. iommu/arm: Add lightweight iommu_fwspec support
   -none- 
6. iommu: Order the headers alphabetically in device_tree.c
   new
7. iommu/arm: Introduce iommu_add_dt_device API
   -none-
8. iommu/arm: Add Renesas IPMMU-VMSA support
   A-b/R-b

Oleksandr Tyshchenko (8):
  iommu/arm: Add iommu_helpers.c file to keep common for IOMMUs stuff
  iommu/arm: Add ability to handle deferred probing request
  xen/common: Introduce _xrealloc function
  xen/common: Introduce xrealloc_flex_struct() helper macros
  iommu/arm: Add lightweight iommu_fwspec support
  iommu: Order the headers alphabetically in device_tree.c
  iommu/arm: Introduce iommu_add_dt_device API
  iommu/arm: Add Renesas IPMMU-VMSA support

 xen/arch/arm/domain_build.c                 |   22 +-
 xen/arch/arm/platforms/Kconfig              |    1 +
 xen/common/xmalloc_tlsf.c                   |  113 ++-
 xen/drivers/passthrough/Kconfig             |   13 +
 xen/drivers/passthrough/arm/Makefile        |    3 +-
 xen/drivers/passthrough/arm/iommu.c         |   56 +-
 xen/drivers/passthrough/arm/iommu_fwspec.c  |   97 ++
 xen/drivers/passthrough/arm/iommu_helpers.c |   84 ++
 xen/drivers/passthrough/arm/ipmmu-vmsa.c    | 1333 +++++++++++++++++++++++++++
 xen/drivers/passthrough/arm/smmu.c          |   48 +-
 xen/drivers/passthrough/device_tree.c       |   77 +-
 xen/include/asm-arm/device.h                |    7 +-
 xen/include/asm-arm/iommu.h                 |   10 +
 xen/include/asm-arm/iommu_fwspec.h          |   68 ++
 xen/include/xen/device_tree.h               |    7 +
 xen/include/xen/iommu.h                     |   21 +
 xen/include/xen/xmalloc.h                   |   13 +
 17 files changed, 1895 insertions(+), 78 deletions(-)
 create mode 100644 xen/drivers/passthrough/arm/iommu_fwspec.c
 create mode 100644 xen/drivers/passthrough/arm/iommu_helpers.c
 create mode 100644 xen/drivers/passthrough/arm/ipmmu-vmsa.c
 create mode 100644 xen/include/asm-arm/iommu_fwspec.h