From patchwork Fri Mar 25 02:04:46 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Andre Przywara X-Patchwork-Id: 8668001 Return-Path: X-Original-To: patchwork-linux-arm@patchwork.kernel.org Delivered-To: patchwork-parsemail@patchwork1.web.kernel.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.136]) by patchwork1.web.kernel.org (Postfix) with ESMTP id DA5BD9F44D for ; Fri, 25 Mar 2016 02:21:15 +0000 (UTC) Received: from mail.kernel.org (localhost [127.0.0.1]) by mail.kernel.org (Postfix) with ESMTP id 90CC820383 for ; Fri, 25 Mar 2016 02:21:14 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.9]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 493D320382 for ; Fri, 25 Mar 2016 02:21:13 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.80.1 #2 (Red Hat Linux)) id 1ajHLR-0004E4-Q1; Fri, 25 Mar 2016 02:19:25 +0000 Received: from foss.arm.com ([217.140.101.70]) by bombadil.infradead.org with esmtp (Exim 4.80.1 #2 (Red Hat Linux)) id 1ajH8R-00077K-IZ for linux-arm-kernel@lists.infradead.org; Fri, 25 Mar 2016 02:06:10 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 423905E2; Thu, 24 Mar 2016 19:04:41 -0700 (PDT) Received: from e104803-lin.lan (unknown [10.1.203.153]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 46C233F3DD; Thu, 24 Mar 2016 19:05:45 -0700 (PDT) From: Andre Przywara To: Christoffer Dall , Marc Zyngier , Eric Auger Subject: [RFC PATCH 23/45] KVM: arm/arm64: vgic-new: Add GICv3 emulation framework Date: Fri, 25 Mar 2016 02:04:46 +0000 Message-Id: <1458871508-17279-24-git-send-email-andre.przywara@arm.com> X-Mailer: git-send-email 2.7.3 In-Reply-To: <1458871508-17279-1-git-send-email-andre.przywara@arm.com> References: <1458871508-17279-1-git-send-email-andre.przywara@arm.com> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20160324_190559_893307_50F63E10 X-CRM114-Status: GOOD ( 15.45 ) X-Spam-Score: -6.9 (------) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: linux-arm-kernel@lists.infradead.org, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org MIME-Version: 1.0 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+patchwork-linux-arm=patchwork.kernel.org@lists.infradead.org X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00, RCVD_IN_DNSWL_MED, T_RP_MATCHES_RCVD, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mail.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Describe the GICv3 distributor and redistributor registers in our structure. This adds a special macro to deal with the split of SGI/PPI in the redistributor and SPIs in the distributor, which allows us to reuse the existing GICv2 handlers for those registers which are compatible. Also we register the separate MMIO page for the redistributor registers dealing with private interrupts. GICv3 specific registers are only implemented as stubs at this time. Signed-off-by: Andre Przywara --- virt/kvm/arm/vgic/vgic.h | 16 +++ virt/kvm/arm/vgic/vgic_mmio.c | 246 ++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 262 insertions(+) diff --git a/virt/kvm/arm/vgic/vgic.h b/virt/kvm/arm/vgic/vgic.h index 57aea8f..4b8952a 100644 --- a/virt/kvm/arm/vgic/vgic.h +++ b/virt/kvm/arm/vgic/vgic.h @@ -37,6 +37,10 @@ void vgic_v3_process_maintenance(struct kvm_vcpu *vcpu); void vgic_v3_fold_lr_state(struct kvm_vcpu *vcpu); void vgic_v3_populate_lr(struct kvm_vcpu *vcpu, struct vgic_irq *irq, int lr); void vgic_v3_set_underflow(struct kvm_vcpu *vcpu); +int vgic_v3_dist_access(struct kvm_vcpu *vcpu, bool is_write, + int offset, int len, void *val); +int vgic_v3_redist_access(struct kvm_vcpu *vcpu, bool is_write, + int offset, int len, void *val); #else static inline void vgic_v3_irq_change_affinity(struct kvm *kvm, u32 intid, u64 mpidr) @@ -59,6 +63,18 @@ static inline void vgic_v3_populate_lr(struct kvm_vcpu *vcpu, static inline void vgic_v3_set_underflow(struct kvm_vcpu *vcpu) { } + +static inline int vgic_v3_dist_access(struct kvm_vcpu *vcpu, bool is_write, + int offset, int len, void *val) +{ + return -ENXIO; +} + +static inline int vgic_v3_redist_access(struct kvm_vcpu *vcpu, bool is_write, + int offset, int len, void *val) +{ + return -ENXIO; +} #endif #endif diff --git a/virt/kvm/arm/vgic/vgic_mmio.c b/virt/kvm/arm/vgic/vgic_mmio.c index 2ab8961..2d10c06 100644 --- a/virt/kvm/arm/vgic/vgic_mmio.c +++ b/virt/kvm/arm/vgic/vgic_mmio.c @@ -17,6 +17,8 @@ #include #include #include +#include +#include #include "vgic.h" #include "vgic_mmio.h" @@ -595,6 +597,105 @@ static int vgic_mmio_write_sgipends(struct kvm_vcpu *vcpu, return 0; } +/*****************************/ +/* GICv3 emulation functions */ +/*****************************/ +#ifdef CONFIG_KVM_ARM_VGIC_V3 + +static int vgic_mmio_read_v3_misc(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, void *val) +{ + /* TODO: implement */ + return 0; +} + +static int vgic_mmio_write_v3_misc(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, const void *val) +{ + /* TODO: implement */ + return 0; +} + +static int vgic_mmio_read_v3r_misc(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, void *val) +{ + /* TODO: implement for ITS support */ + return vgic_mmio_read_raz(vcpu, this, addr, len, val); +} + +static int vgic_mmio_write_v3r_misc(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, const void *val) +{ + /* TODO: implement for ITS support */ + return vgic_mmio_write_wi(vcpu, this, addr, len, val); +} + +static int vgic_mmio_read_v3r_iidr(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, void *val) +{ + return 0; +} + +static int vgic_mmio_read_v3r_typer(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, void *val) +{ + /* TODO: implement */ + return 0; +} + +static int vgic_mmio_read_v3r_propbase(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, void *val) +{ + /* TODO: implement */ + return 0; +} + +static int vgic_mmio_write_v3r_propbase(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, const void *val) +{ + /* TODO: implement */ + return 0; +} + +static int vgic_mmio_read_v3r_pendbase(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, void *val) +{ + /* TODO: implement */ + return 0; +} + +static int vgic_mmio_write_v3r_pendbase(struct kvm_vcpu *vcpu, + struct kvm_io_device *this, + gpa_t addr, int len, const void *val) +{ + /* TODO: implement */ + return 0; +} +#endif + +/* + * The GICv3 per-IRQ registers are split to control PPIs and SGIs in the + * redistributors, while SPIs are covered by registers in the distributor + * block. Trying to set private IRQs in this block gets ignored. + * We take some special care here to fix the calculation of the register + * offset. + */ +#define REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(name, read_ops, write_ops, bpi) \ + {.reg_offset = name, .bits_per_irq = 0, \ + .len = (bpi * VGIC_NR_PRIVATE_IRQS) / 8, \ + .ops.read = vgic_mmio_read_raz, .ops.write = vgic_mmio_write_wi, }, \ + {.reg_offset = name, .bits_per_irq = bpi, .len = 0, \ + .ops.read = read_ops, .ops.write = write_ops, } + struct vgic_register_region vgic_v2_dist_registers[] = { REGISTER_DESC_WITH_LENGTH(GIC_DIST_CTRL, vgic_mmio_read_v2_misc, vgic_mmio_write_v2_misc, 12), @@ -626,6 +727,73 @@ struct vgic_register_region vgic_v2_dist_registers[] = { vgic_mmio_read_sgipend, vgic_mmio_write_sgipends, 16), }; +#ifdef CONFIG_KVM_ARM_VGIC_V3 +struct vgic_register_region vgic_v3_dist_registers[] = { + REGISTER_DESC_WITH_LENGTH(GICD_CTLR, + vgic_mmio_read_v3_misc, vgic_mmio_write_v3_misc, 16), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_IGROUPR, + vgic_mmio_read_raz, vgic_mmio_write_wi, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ISENABLER, + vgic_mmio_read_enable, vgic_mmio_write_senable, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ICENABLER, + vgic_mmio_read_enable, vgic_mmio_write_cenable, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ISPENDR, + vgic_mmio_read_pending, vgic_mmio_write_spending, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ICPENDR, + vgic_mmio_read_pending, vgic_mmio_write_cpending, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ISACTIVER, + vgic_mmio_read_active, vgic_mmio_write_sactive, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ICACTIVER, + vgic_mmio_read_active, vgic_mmio_write_cactive, 1), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_IPRIORITYR, + vgic_mmio_read_priority, vgic_mmio_write_priority, 8), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ITARGETSR, + vgic_mmio_read_raz, vgic_mmio_write_wi, 8), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_ICFGR, + vgic_mmio_read_config, vgic_mmio_write_config, 2), + REGISTER_DESC_WITH_BITS_PER_IRQ_SHARED(GICD_IGRPMODR, + vgic_mmio_read_raz, vgic_mmio_write_wi, 1), +}; + +struct vgic_register_region vgic_v3_redist_registers[] = { + REGISTER_DESC_WITH_LENGTH(GICR_CTLR, + vgic_mmio_read_v3r_misc, vgic_mmio_write_v3r_misc, 4), + REGISTER_DESC_WITH_LENGTH(GICR_IIDR, + vgic_mmio_read_v3r_iidr, vgic_mmio_write_wi, 4), + REGISTER_DESC_WITH_LENGTH(GICR_TYPER, + vgic_mmio_read_v3r_typer, vgic_mmio_write_wi, 8), + REGISTER_DESC_WITH_LENGTH(GICR_PROPBASER, + vgic_mmio_read_v3r_propbase, vgic_mmio_write_v3r_propbase, 8), + REGISTER_DESC_WITH_LENGTH(GICR_PENDBASER, + vgic_mmio_read_v3r_pendbase, vgic_mmio_write_v3r_pendbase, 8), +}; + +struct vgic_register_region vgic_v3_private_registers[] = { + REGISTER_DESC_WITH_LENGTH(GICR_IGROUPR0, + vgic_mmio_read_raz, vgic_mmio_write_wi, 4), + REGISTER_DESC_WITH_LENGTH(GICR_ISENABLER0, + vgic_mmio_read_enable, vgic_mmio_write_senable, 4), + REGISTER_DESC_WITH_LENGTH(GICR_ICENABLER0, + vgic_mmio_read_enable, vgic_mmio_write_cenable, 4), + REGISTER_DESC_WITH_LENGTH(GICR_ISPENDR0, + vgic_mmio_read_pending, vgic_mmio_write_spending, 4), + REGISTER_DESC_WITH_LENGTH(GICR_ICPENDR0, + vgic_mmio_read_pending, vgic_mmio_write_cpending, 4), + REGISTER_DESC_WITH_LENGTH(GICR_ISACTIVER0, + vgic_mmio_read_active, vgic_mmio_write_sactive, 4), + REGISTER_DESC_WITH_LENGTH(GICR_ICACTIVER0, + vgic_mmio_read_active, vgic_mmio_write_cactive, 4), + REGISTER_DESC_WITH_LENGTH(GICR_IPRIORITYR0, + vgic_mmio_read_priority, vgic_mmio_write_priority, 32), + REGISTER_DESC_WITH_LENGTH(GICR_ICFGR0, + vgic_mmio_read_config, vgic_mmio_write_config, 8), + REGISTER_DESC_WITH_LENGTH(GICR_IGRPMODR0, + vgic_mmio_read_raz, vgic_mmio_write_wi, 4), + REGISTER_DESC_WITH_LENGTH(GICR_NSACR, + vgic_mmio_read_raz, vgic_mmio_write_wi, 4), +}; +#endif + /* * Using kvm_io_bus_* to access GIC registers directly from userspace does * not work, since we would need the absolute IPA address of the register @@ -671,6 +839,24 @@ int vgic_v2_dist_access(struct kvm_vcpu *vcpu, bool is_write, is_write, offset, len, val); } +#ifdef CONFIG_KVM_ARM_VGIC_V3 +int vgic_v3_dist_access(struct kvm_vcpu *vcpu, bool is_write, + int offset, int len, void *val) +{ + return vgic_mmio_access(vcpu, vgic_v3_dist_registers, + ARRAY_SIZE(vgic_v3_dist_registers), + is_write, offset, len, val); +} + +int vgic_v3_redist_access(struct kvm_vcpu *vcpu, bool is_write, + int offset, int len, void *val) +{ + return vgic_mmio_access(vcpu, vgic_v3_redist_registers, + ARRAY_SIZE(vgic_v3_redist_registers), + is_write, offset, len, val); +} +#endif + int kvm_vgic_register_mmio_region(struct kvm *kvm, struct kvm_vcpu *vcpu, struct vgic_register_region *reg_desc, struct vgic_io_device *region, @@ -717,6 +903,12 @@ int vgic_register_dist_regions(struct kvm *kvm, gpa_t dist_base_address, reg_desc = vgic_v2_dist_registers; nr_regions = ARRAY_SIZE(vgic_v2_dist_registers); break; +#ifdef CONFIG_KVM_ARM_VGIC_V3 + case VGIC_V3: + reg_desc = vgic_v3_dist_registers; + nr_regions = ARRAY_SIZE(vgic_v3_dist_registers); + break; +#endif default: BUG_ON(1); } @@ -750,3 +942,57 @@ int vgic_register_dist_regions(struct kvm *kvm, gpa_t dist_base_address, return ret; } + +#ifdef CONFIG_KVM_ARM_VGIC_V3 +int vgic_register_redist_regions(struct kvm *kvm, gpa_t redist_base_address) +{ + int nr_vcpus = atomic_read(&kvm->online_vcpus); + int nr_regions = ARRAY_SIZE(vgic_v3_redist_registers) + + ARRAY_SIZE(vgic_v3_private_registers); + struct kvm_vcpu *vcpu; + struct vgic_io_device *regions, *region; + int c, i, ret = 0; + + regions = kmalloc(sizeof(struct vgic_io_device) * nr_regions * nr_vcpus, + GFP_KERNEL); + if (!regions) + return -ENOMEM; + + kvm_for_each_vcpu(c, vcpu, kvm) { + region = ®ions[c * nr_regions]; + for (i = 0; i < ARRAY_SIZE(vgic_v3_redist_registers); i++) { + region->base_addr = redist_base_address; + region->base_addr += c * 2 * SZ_64K; + + ret = kvm_vgic_register_mmio_region(kvm, vcpu, + vgic_v3_redist_registers + i, + region, VGIC_NR_PRIVATE_IRQS, + false); + if (ret) + break; + region++; + } + if (ret) + break; + + for (i = 0; i < ARRAY_SIZE(vgic_v3_private_registers); i++) { + region->base_addr = redist_base_address; + region->base_addr += c * 2 * SZ_64K + SZ_64K; + ret = kvm_vgic_register_mmio_region(kvm, vcpu, + vgic_v3_private_registers + i, + region, VGIC_NR_PRIVATE_IRQS, + false); + if (ret) + break; + region++; + } + if (ret) + break; + } + + if (!ret) + kvm->arch.vgic.redist_iodevs = regions; + + return ret; +} +#endif