From patchwork Wed May 11 10:31:21 2011 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sasha Levin X-Patchwork-Id: 776112 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by demeter1.kernel.org (8.14.4/8.14.3) with ESMTP id p4BFi1kj026158 for ; Wed, 11 May 2011 15:44:02 GMT Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754509Ab1EKPnt (ORCPT ); Wed, 11 May 2011 11:43:49 -0400 Received: from mail-wy0-f174.google.com ([74.125.82.174]:64475 "EHLO mail-wy0-f174.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752697Ab1EKPns (ORCPT ); Wed, 11 May 2011 11:43:48 -0400 Received: by wya21 with SMTP id 21so482942wya.19 for ; Wed, 11 May 2011 08:43:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:from:to:cc:subject:date:message-id:x-mailer; bh=txrrMjUxWZ/Ht98dPfwMrgw7MhLkCLpux+GCP77Q00k=; b=erCkfdQfbsDilain3Jqzy3pQeokaqh1KkzigiwWH2SAkTF75vTmKO6vB5taF/vjOi0 KzfO3YFvoGZF9Nj8AW6whJsfaTHfg5uHsuYEF6UboPc+lXJ+r3T9lnJRPZHVtdF4RmpG K6+DMxugZWoFojGAKXlJR9KZfyTA3KNmO3rt0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:cc:subject:date:message-id:x-mailer; b=POxkatpOSH/J8FQ8HTjs7QhWpJj5wBxkxLYgC5AqR967rMJVs7Es6ETQHZbsHL6eGK Fma/qvzWFnPbWgXJAcw7G97Kr9OGB3YLqzJ2v31RMNVrM38a9VgLuozeFLD97XFHVWg5 qmo4FZF9bUBeWPDMsWFRzv9/udmyWAJmpQdHw= Received: by 10.227.197.201 with SMTP id el9mr9529468wbb.22.1305109895166; Wed, 11 May 2011 03:31:35 -0700 (PDT) Received: from localhost.localdomain ([188.120.134.217]) by mx.google.com with ESMTPS id w12sm2736wby.58.2011.05.11.03.31.33 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 May 2011 03:31:34 -0700 (PDT) From: Sasha Levin To: penberg@kernel.org Cc: mingo@elte.hu, asias.hejun@gmail.com, prasadjoshi124@gmail.com, avi@redhat.com, gorcunov@gmail.com, kvm@vger.kernel.org, Sasha Levin Subject: [PATCH] kvm tools: Add memory gap for larger RAM sizes Date: Wed, 11 May 2011 13:31:21 +0300 Message-Id: <1305109881-11189-1-git-send-email-levinsasha928@gmail.com> X-Mailer: git-send-email 1.7.5.rc3 Sender: kvm-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org X-Greylist: IP, sender and recipient auto-whitelisted, not delayed by milter-greylist-4.2.6 (demeter1.kernel.org [140.211.167.41]); Wed, 11 May 2011 15:44:02 +0000 (UTC) e820 is expected to leave a memory gap within the low 32 bits of RAM space. From the documentation of e820_setup_gap(): /* * Search for the biggest gap in the low 32 bits of the e820 * memory space. We pass this space to PCI to assign MMIO resources * for hotplug or unconfigured devices in. * Hopefully the BIOS let enough space left. */ Not leaving such gap causes errors and hangs during the boot process. This patch adds a memory gap between 0xe0000000 and 0x100000000 when using more than 0xe0000000 bytes for guest RAM. This patch updates the e820 table, slot allocations used for KVM_SET_USER_MEMORY_REGION. Changes in V2: - Allocate RAM with the gap to avoid altering the translation code. - New patch description. Changes in V3: - Remove unnecessary casts. Signed-off-by: Sasha Levin --- tools/kvm/bios.c | 27 ++++++++++++++++++++------- tools/kvm/include/kvm/e820.h | 2 +- tools/kvm/include/kvm/kvm.h | 2 ++ tools/kvm/kvm.c | 30 +++++++++++++++++++++++------- 4 files changed, 46 insertions(+), 15 deletions(-) diff --git a/tools/kvm/bios.c b/tools/kvm/bios.c index 2199c0c..3cd9b24 100644 --- a/tools/kvm/bios.c +++ b/tools/kvm/bios.c @@ -61,8 +61,6 @@ static void e820_setup(struct kvm *kvm) size = guest_flat_to_host(kvm, E820_MAP_SIZE); mem_map = guest_flat_to_host(kvm, E820_MAP_START); - *size = E820_MEM_AREAS; - mem_map[i++] = (struct e820_entry) { .addr = REAL_MODE_IVT_BEGIN, .size = EBDA_START - REAL_MODE_IVT_BEGIN, @@ -78,13 +76,28 @@ static void e820_setup(struct kvm *kvm) .size = MB_BIOS_END - MB_BIOS_BEGIN, .type = E820_MEM_RESERVED, }; - mem_map[i++] = (struct e820_entry) { - .addr = BZ_KERNEL_START, - .size = kvm->ram_size - BZ_KERNEL_START, - .type = E820_MEM_USABLE, - }; + if (kvm->ram_size < KVM_32BIT_GAP_START) { + mem_map[i++] = (struct e820_entry) { + .addr = BZ_KERNEL_START, + .size = kvm->ram_size - BZ_KERNEL_START, + .type = E820_MEM_USABLE, + }; + } else { + mem_map[i++] = (struct e820_entry) { + .addr = BZ_KERNEL_START, + .size = KVM_32BIT_GAP_START - BZ_KERNEL_START, + .type = E820_MEM_USABLE, + }; + mem_map[i++] = (struct e820_entry) { + .addr = 0x100000000ULL, + .size = kvm->ram_size - KVM_32BIT_GAP_START, + .type = E820_MEM_USABLE, + }; + } BUILD_BUG_ON(i > E820_MEM_AREAS); + + *size = i; } /** diff --git a/tools/kvm/include/kvm/e820.h b/tools/kvm/include/kvm/e820.h index 252ae1f..e0f5f2a 100644 --- a/tools/kvm/include/kvm/e820.h +++ b/tools/kvm/include/kvm/e820.h @@ -8,7 +8,7 @@ #define E820_MEM_USABLE 1 #define E820_MEM_RESERVED 2 -#define E820_MEM_AREAS 4 +#define E820_MEM_AREAS 5 struct e820_entry { u64 addr; /* start of memory segment */ diff --git a/tools/kvm/include/kvm/kvm.h b/tools/kvm/include/kvm/kvm.h index 3dab78d..5e2e64c 100644 --- a/tools/kvm/include/kvm/kvm.h +++ b/tools/kvm/include/kvm/kvm.h @@ -8,6 +8,8 @@ #include #define KVM_NR_CPUS (255) +#define KVM_32BIT_GAP_SIZE (512 << 20) +#define KVM_32BIT_GAP_START ((1ULL << 32) - KVM_32BIT_GAP_SIZE) struct kvm { int sys_fd; /* For system ioctls(), i.e. /dev/kvm */ diff --git a/tools/kvm/kvm.c b/tools/kvm/kvm.c index 65793f2..16d91d5 100644 --- a/tools/kvm/kvm.c +++ b/tools/kvm/kvm.c @@ -153,23 +153,33 @@ static bool kvm__cpu_supports_vm(void) return regs.ecx & (1 << feature); } -void kvm__init_ram(struct kvm *self) +static void kvm_register_mem_slot(struct kvm *kvm, u32 slot, u64 guest_phys, u64 size, void *userspace_addr) { struct kvm_userspace_memory_region mem; int ret; mem = (struct kvm_userspace_memory_region) { - .slot = 0, - .guest_phys_addr = 0x0UL, - .memory_size = self->ram_size, - .userspace_addr = (unsigned long) self->ram_start, + .slot = slot, + .guest_phys_addr = guest_phys, + .memory_size = size, + .userspace_addr = (u64)userspace_addr, }; - ret = ioctl(self->vm_fd, KVM_SET_USER_MEMORY_REGION, &mem); + ret = ioctl(kvm->vm_fd, KVM_SET_USER_MEMORY_REGION, &mem); if (ret < 0) die_perror("KVM_SET_USER_MEMORY_REGION ioctl"); } +void kvm__init_ram(struct kvm *self) +{ + if (self->ram_size < KVM_32BIT_GAP_START) { + kvm_register_mem_slot(self, 0, 0, self->ram_size, self->ram_start); + } else { + kvm_register_mem_slot(self, 0, 0, KVM_32BIT_GAP_START, self->ram_start); + kvm_register_mem_slot(self, 1, 0x100000000ULL, self->ram_size - KVM_32BIT_GAP_START, self->ram_start + 0x100000000ULL); + } +} + int kvm__max_cpus(struct kvm *self) { int ret; @@ -225,7 +235,13 @@ struct kvm *kvm__init(const char *kvm_dev, unsigned long ram_size) self->ram_size = ram_size; - self->ram_start = mmap(NULL, ram_size, PROT_READ | PROT_WRITE, MAP_PRIVATE | MAP_ANONYMOUS | MAP_NORESERVE, -1, 0); + if (self->ram_size < KVM_32BIT_GAP_START) { + self->ram_start = mmap(NULL, ram_size, PROT_READ | PROT_WRITE, MAP_PRIVATE | MAP_ANONYMOUS | MAP_NORESERVE, -1, 0); + } else { + self->ram_start = mmap(NULL, ram_size + KVM_32BIT_GAP_SIZE, PROT_READ | PROT_WRITE, MAP_PRIVATE | MAP_ANONYMOUS | MAP_NORESERVE, -1, 0); + if (self->ram_start != MAP_FAILED) + mprotect(self->ram_start + KVM_32BIT_GAP_START, KVM_32BIT_GAP_SIZE, PROT_NONE); + } if (self->ram_start == MAP_FAILED) die("out of memory");