From patchwork Mon Feb 18 19:52:13 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Dave Martin X-Patchwork-Id: 10818797 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 82F0617D5 for ; Mon, 18 Feb 2019 20:02:31 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 6BEC72BA8F for ; Mon, 18 Feb 2019 20:02:31 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 5EB9C2BAA9; Mon, 18 Feb 2019 20:02:31 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.2 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,MAILING_LIST_MULTI,RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 2F6A62B81C for ; Mon, 18 Feb 2019 20:02:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:Cc:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:Message-Id:Date:Subject:To :From:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References: List-Owner; bh=Bm3NGlgldgANRc9NooFXyNJLViGkIcyhmurjOZ4tD5c=; b=o9Fd9nvALy7jxP cLKrg1dn5JpttZc8TWsLa4uoq05YRH1QapoJCvDzf2rdZPvuI6j7px/I/WOCti4K2jWT2HN7NF3vv pFz4LLllH6PLQ9eeythEoqOPH0ijyX2ztOSw6fyxIm+OPRePkTn7MjU25KJjZQPWdZOyFKU6RNLRd QchHpf09F/O02zvLkdPryw5ySPwRxMbh90HmR3tJbjKg2TvwxGbWOrOFbGQzooPzzayoS48HZBjg7 jKlZAdjBCwUHIgZe3EhL1uKIDo7ITqJUGuQ1azQJtIoqJ8KlJbgWVWGk0QWFpnOp55ZvuEJIkMDnZ L0bVqF7ZAteFokH6YgAA==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.90_1 #2 (Red Hat Linux)) id 1gvp7V-0006EB-5F; Mon, 18 Feb 2019 20:02:29 +0000 Received: from foss.arm.com ([217.140.101.70]) by bombadil.infradead.org with esmtp (Exim 4.90_1 #2 (Red Hat Linux)) id 1gvp7R-0006Di-0X for linux-arm-kernel@lists.infradead.org; Mon, 18 Feb 2019 20:02:27 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 996B6A78; Mon, 18 Feb 2019 11:53:07 -0800 (PST) Received: from e103592.cambridge.arm.com (usa-sjc-imap-foss1.foss.arm.com [10.72.51.249]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 99CAB3F575; Mon, 18 Feb 2019 11:52:45 -0800 (PST) From: Dave Martin To: kvmarm@lists.cs.columbia.edu Subject: [PATCH v5 00/26] KVM: arm64: SVE guest support Date: Mon, 18 Feb 2019 19:52:13 +0000 Message-Id: <1550519559-15915-1-git-send-email-Dave.Martin@arm.com> X-Mailer: git-send-email 2.1.4 MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20190218_120225_062259_638D6E36 X-CRM114-Status: GOOD ( 17.14 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Peter Maydell , Okamoto Takayuki , Christoffer Dall , Ard Biesheuvel , Marc Zyngier , Catalin Marinas , Will Deacon , Zhang Lei , Julien Grall , =?utf-8?q?Alex_Benn=C3=A9e?= , linux-arm-kernel@lists.infradead.org Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+patchwork-linux-arm=patchwork.kernel.org@lists.infradead.org X-Virus-Scanned: ClamAV using ClamSMTP This series implements support for allowing KVM guests to use the Arm Scalable Vector Extension (SVE), superseding the previous v4 series [1]. The patches are also available on a branch for reviewer convenience. [2] The patches are based on v5.0-rc6. They depend on another small series currently under review [3] that does a bit of relevant refactoring (as well as fixing an anomaly not directly related to this series). A base branch [4] is provided so that reviewers don't need to hunt down both series independently. This series contains no major update except for the removal of multiple register slice support in the user register access ioctls. The ABI is kept as-is so that this functionality can be added back in later on if/when needed. ioctl access to nonexistent slices now yields ENOENT, which is more consistent with the notion of an absent register. For a description of minor updates, see the individual patches. Functionality testing and stress-testing has been done, using a hacked-up kvmtool [5]: * Arm Fast Model: full testing of arm64 defconfig, including running non-SVE and SVE guests with mixtures of vector lengths. limited testing of other configurations. * ThunderX2: basic testing of arm64 defconfig, including booting guests (no SVE support on this hardware). * Full build-bisect testing and sparse testing of every commit done for arm64 (defconfig, CONFIG_ARM64_SVE=n, CONFIG_KVM=n) and arm (multi_v7_defconfig, CONFIG_KVM=y). One new sparse warning, probably spurious (see note in patch 22). AArch32 host testing is pending. I will ping this series with a reply to the cover letter when that testing has been completed. Known issues: * **Possible bug** SVE state corruption has been in the host when running on the Arm Fast Model. After some investigation with the model engineers, it appears that there may be a model bug in this area. I have also obtained detailed trace of failure cases, which is also suggestive of a model bug. No clear evidence has been obtained to show that there is a bug in Linux, so far. All available evidence suggests that this bug will not affect non-SVE hardware: the symptom is unexpected zeroing of bits 128 and above of the vector registers (which don't exist prior to SVE). * kvmtool support is not mature [1] [RFC PATCH v4 00/24] KVM: arm64: SVE guest support https://lists.cs.columbia.edu/pipermail/kvmarm/2019-January/034134.html [2] This series in git: http://linux-arm.org/git?p=linux-dm.git;a=shortlog;h=refs/heads/sve-kvm/v5/head git://linux-arm.org/linux-dm.git sve-kvm/v5/head [3] [PATCH v2 0/2] Fix KVM_GET_REG_LIST invalid register ID regression https://lists.cs.columbia.edu/pipermail/kvmarm/2018-December/033810.html [4] Base of this series in git: http://linux-arm.org/git?p=linux-dm.git;a=shortlog;h=refs/heads/sve-kvm/v5/base git://linux-arm.org/linux-dm.git sve-kvm/v5/base [5] [RFC PATCH 00/12] arm64: SVE guest support test hacks https://lists.cs.columbia.edu/pipermail/kvmarm/2019-January/034162.html Dave Martin (26): KVM: Documentation: Document arm64 core registers in detail arm64: fpsimd: Always set TIF_FOREIGN_FPSTATE on task state flush KVM: arm64: Delete orphaned declaration for __fpsimd_enabled() KVM: arm64: Refactor kvm_arm_num_regs() for easier maintenance KVM: arm64: Add missing #include of to kvm_host.h arm64/sve: Check SVE virtualisability arm64/sve: Clarify role of the VQ map maintenance functions arm64/sve: Enable SVE state tracking for non-task contexts KVM: arm64: Add a vcpu flag to control SVE visibility for the guest KVM: arm64: Propagate vcpu into read_id_reg() KVM: arm64: Extend reset_unknown() to handle mixed RES0/UNKNOWN registers KVM: arm64: Support runtime sysreg visibility filtering KVM: arm64/sve: System register context switch and access support KVM: arm64/sve: Context switch the SVE registers KVM: Allow 2048-bit register access via ioctl interface KVM: arm64: Add missing #include of in guest.c KVM: arm64: Reject ioctl access to FPSIMD V-regs on SVE vcpus KVM: arm64/sve: Add SVE support to register access ioctl interface KVM: arm64: Enumerate SVE register indices for KVM_GET_REG_LIST arm64/sve: In-kernel vector length availability query interface KVM: arm/arm64: Add hook to finalize the vcpu configuration KVM: arm64/sve: Add pseudo-register for the guest's vector lengths KVM: arm64/sve: Allow userspace to enable SVE for vcpus KVM: arm64: Add a capabillity to advertise SVE support KVM: Document errors for KVM_GET_ONE_REG and KVM_SET_ONE_REG KVM: arm64/sve: Document KVM API extensions for SVE Documentation/virtual/kvm/api.txt | 93 ++++++++++ arch/arm/include/asm/kvm_host.h | 4 + arch/arm64/include/asm/fpsimd.h | 33 +++- arch/arm64/include/asm/kvm_host.h | 35 +++- arch/arm64/include/asm/kvm_hyp.h | 1 - arch/arm64/include/asm/sysreg.h | 3 + arch/arm64/include/uapi/asm/kvm.h | 22 +++ arch/arm64/kernel/cpufeature.c | 2 +- arch/arm64/kernel/fpsimd.c | 172 +++++++++++++------ arch/arm64/kernel/signal.c | 5 - arch/arm64/kvm/fpsimd.c | 17 +- arch/arm64/kvm/guest.c | 348 +++++++++++++++++++++++++++++++++++--- arch/arm64/kvm/hyp/switch.c | 69 ++++++-- arch/arm64/kvm/reset.c | 87 +++++++++- arch/arm64/kvm/sys_regs.c | 144 ++++++++++++++-- arch/arm64/kvm/sys_regs.h | 24 ++- include/uapi/linux/kvm.h | 2 + virt/kvm/arm/arm.c | 8 + 18 files changed, 944 insertions(+), 125 deletions(-)