From patchwork Mon Mar 4 10:13:29 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Eric Auger X-Patchwork-Id: 10837565 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id ED7541390 for ; Mon, 4 Mar 2019 10:26:37 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id D8A1529AB6 for ; Mon, 4 Mar 2019 10:26:37 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id C913C29AC7; Mon, 4 Mar 2019 10:26:37 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI autolearn=ham version=3.3.1 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 3032629AB6 for ; Mon, 4 Mar 2019 10:26:37 +0000 (UTC) Received: from localhost ([127.0.0.1]:51515 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1h0kns-00023T-5d for patchwork-qemu-devel@patchwork.kernel.org; Mon, 04 Mar 2019 05:26:36 -0500 Received: from eggs.gnu.org ([209.51.188.92]:53014) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1h0khA-0005rB-L1 for qemu-devel@nongnu.org; Mon, 04 Mar 2019 05:19:41 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1h0kh9-0004I0-GY for qemu-devel@nongnu.org; Mon, 04 Mar 2019 05:19:40 -0500 Received: from mx1.redhat.com ([209.132.183.28]:37330) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1h0kh6-0004Gt-Mp; Mon, 04 Mar 2019 05:19:36 -0500 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 9C43D81F25; Mon, 4 Mar 2019 10:13:52 +0000 (UTC) Received: from laptop.redhat.com (ovpn-116-102.ams2.redhat.com [10.36.116.102]) by smtp.corp.redhat.com (Postfix) with ESMTP id 984492B893; Mon, 4 Mar 2019 10:13:41 +0000 (UTC) From: Eric Auger To: eric.auger.pro@gmail.com, eric.auger@redhat.com, qemu-devel@nongnu.org, qemu-arm@nongnu.org, peter.maydell@linaro.org, shameerali.kolothum.thodi@huawei.com, imammedo@redhat.com, david@redhat.com Date: Mon, 4 Mar 2019 11:13:29 +0100 Message-Id: <20190304101339.25970-1-eric.auger@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.25]); Mon, 04 Mar 2019 10:13:52 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH v12 00/10] ARM virt: Initial RAM expansion and extended memory map X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: pbonzini@redhat.com, drjones@redhat.com, dgilbert@redhat.com, david@gibson.dropbear.id.au Errors-To: qemu-devel-bounces+patchwork-qemu-devel=patchwork.kernel.org@nongnu.org Sender: "Qemu-devel" X-Virus-Scanned: ClamAV using ClamSMTP This series aims to bump the 255GB RAM limit in machvirt and paves the way to device memory addition. In machvirt versions < 4.0, the initial RAM starts at 1GB and can grow up to 255GB. From 256GB onwards we find IO regions such as the additional GICv3 RDIST region, high PCIe ECAM region and high PCIe MMIO region. The address map was 1TB large. This corresponded to the max IPA capacity KVM was able to manage. Since 4.20, the host kernel is able to support a larger and dynamic IPA range. So the guest physical address can go beyond the 1TB. The max GPA size depends on the host kernel configuration and physical CPUs. In this series we use this feature and allow the RAM to grow without any other limit than the one put by the host kernel. The RAM still starts at 1GB. First comes the initial ram (-m) of size ram_size and then we provision sufficient space for the looming device memory (dimensionned using ,maxmem and slots options). IO regions previously located between 256GB and 1TB are moved after the RAM. Their offset is dynamically computed, depends on ram_size, slots, maxram_size. Size alignment is enforced. In case maxmem value is inferior to 255GB, the legacy memory map still is used. As we keep the initial RAM at 1GB base address, we do not need to do invasive changes in the EDK2 FW. It seems nobody is eager to do that job at the moment. Device memory being put just after the initial RAM, it will be possible to get access to this feature while keeping a 1TB address map. Best Regards Eric This series can be found at: https://github.com/eauger/qemu/tree/v3.1.0-extended-memmap-v12 History: v11 -> v12: - collected last Igor's and Richard's R-b's - removed the memmap initialization to NULL v10 -> v11: - remove vms->high_io_base - remove RAM_BASE - see individual change logs for other adjustments v9 -> v10: - only the keep the first 10 patches which move to the extended memmap - remove the 1GB alignment check on maxram_size v8 -> v9: - fixed make check SIGSEV - fixed TCG issue (restored virt_set_memmap in machvirt_init) - removed Igor's R-b on "hw/arm/boot: Expose the PC-DIMM nodes in the DT" v7 -> v8: - addressed Igor's comments" - remove no_extended_memmap knob - moved acpi_nvdimm_state into MachineState - separate "hw/arm/virt: Check the VCPU PA range in TCG mode" patch v6 -> v7: - Addressed Peter and Igor comments (exceptions sent my email) - Fixed TCG case. Now device memory works also for TCG and vcpu pamax is checked - See individual logs for more details v5 -> v6: - mingw compilation issue fix - kvm_arm_get_max_vm_phys_shift always returns the number of supported IPA bits - new patch "hw/arm/virt: Rename highmem IO regions" that eases the review of "hw/arm/virt: Split the memory map description" - "hw/arm/virt: Move memory map initialization into machvirt_init" squashed into the previous patch - change alignment of IO regions beyond the RAM so that it matches their size v4 -> v5: - change in the memory map - see individual logs v3 -> v4: - rebase on David's "pc-dimm: next bunch of cleanups" and "pc-dimm: pre_plug "slot" and "addr" assignment" - kvm-type option not used anymore. We directly use maxram_size and ram_size machine fields to compute the MAX IPA range. Migration is naturally handled as CLI option are kept between source and destination. This was suggested by David. - device_memory_start and device_memory_size not stored anymore in vms->bootinfo - I did not take into account 2 Igor's comments: the one related to the refactoring of arm_load_dtb and the one related to the generation of the dtb after system_reset which would contain nodes of hotplugged devices (we do not support hotplug at this stage) - check the end-user does not attempt to hotplug a device - addition of "vl: Set machine ram_size, maxram_size and ram_slots earlier" v2 -> v3: - fix pc_q35 and pc_piix compilation error - kwangwoo's email being not valid anymore, remove his address v1 -> v2: - kvm_get_max_vm_phys_shift moved in arch specific file - addition of NVDIMM part - single series - rebase on David's refactoring v1: - was "[RFC 0/6] KVM/ARM: Dynamic and larger GPA size" - was "[RFC 0/5] ARM virt: Support PC-DIMM at 2TB" Eric Auger (9): hw/arm/virt: Rename highmem IO regions hw/arm/virt: Split the memory map description hw/boards: Add a MachineState parameter to kvm_type callback kvm: add kvm_arm_get_max_vm_ipa_size vl: Set machine ram_size, maxram_size and ram_slots earlier hw/arm/virt: Dynamic memory map depending on RAM requirements hw/arm/virt: Implement kvm_type function for 4.0 machine hw/arm/virt: Check the VCPU PA range in TCG mode hw/arm/virt: Bump the 255GB initial RAM limit Shameer Kolothum (1): hw/arm/boot: introduce fdt_add_memory_node helper accel/kvm/kvm-all.c | 2 +- hw/arm/boot.c | 54 +++++++---- hw/arm/virt-acpi-build.c | 10 +- hw/arm/virt.c | 196 +++++++++++++++++++++++++++++++-------- hw/ppc/mac_newworld.c | 3 +- hw/ppc/mac_oldworld.c | 2 +- hw/ppc/spapr.c | 2 +- include/hw/arm/virt.h | 16 +++- include/hw/boards.h | 5 +- target/arm/kvm.c | 10 ++ target/arm/kvm_arm.h | 13 +++ vl.c | 6 +- 12 files changed, 241 insertions(+), 78 deletions(-)