From patchwork Tue Jan 17 17:29:53 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Paul Durrant X-Patchwork-Id: 9521603 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id ED72F6020B for ; Tue, 17 Jan 2017 17:32:26 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id DDD7F285F8 for ; Tue, 17 Jan 2017 17:32:26 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id D2C26285FB; Tue, 17 Jan 2017 17:32:26 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00, RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 1596F285F8 for ; Tue, 17 Jan 2017 17:32:26 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cTXaA-0000qm-84; Tue, 17 Jan 2017 17:30:06 +0000 Received: from mail6.bemta6.messagelabs.com ([193.109.254.103]) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cTXa8-0000cH-GS for xen-devel@lists.xenproject.org; Tue, 17 Jan 2017 17:30:04 +0000 Received: from [85.158.143.35] by server-2.bemta-6.messagelabs.com id 45/56-22326-B945E785; Tue, 17 Jan 2017 17:30:03 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFupjkeJIrShJLcpLzFFi42JxWrrBXnd2SF2 EwYuJwhbft0xmcmD0OPzhCksAYxRrZl5SfkUCa8a2Q63MBfvDK2a39LA3MG516GLk4JAQ8Jc4 e6qsi5GTg01AR2Lq00usIGERARWJ23sNQMLMAqcYJR7dZwGxhQVsJP4duswKYrMIqEr8+3eNG cTmFXCXaH6yG8yWEJCTOH/8J5jNKeAhMfnkJLBeIaCa1o6PULaKxPqps9ggegUlTs58wgKxS0 Li4IsXzBMYeWchSc1CklrAyLSKUb04tagstUjXWC+pKDM9oyQ3MTNH19DATC83tbg4MT01JzG pWC85P3cTIzBsGIBgB2PHP6dDjJIcTEqivB2PayOE+JLyUyozEosz4otKc1KLDzHKcHAoSfBW BNdFCAkWpaanVqRl5gADGCYtwcGjJMJrApLmLS5IzC3OTIdInWLU5di3/cxLJiGWvPy8VClx3 rMgRQIgRRmleXAjYNF0iVFWSpiXEegoIZ6C1KLczBJU+VeM4hyMSsK8HCBTeDLzSuA2vQI6gg noiOs61SBHlCQipKQaGBexOkdtnRZ8RHW+4YmP7+y/cR7IqrgzpfGz0/36tuPMz47xT40t42w 5Et6nGLFrysMtEkUK+q5vlT/e4m54L/rIT7vtQOzRy+xR3N1sDZyL/KvNfAVYdXZo1TSGGxhx vTx87F5MxubN380a1Bc8sbJX6443crMqnL3ed9r8Hb1ht+79cbx/T4mlOCPRUIu5qDgRAMfKU CuhAgAA X-Env-Sender: prvs=183c9fafe=Paul.Durrant@citrix.com X-Msg-Ref: server-5.tower-21.messagelabs.com!1484674200!45179966!2 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n, received_headers: No Received headers X-StarScan-Received: X-StarScan-Version: 9.1.1; banners=-,-,- X-VirusChecked: Checked Received: (qmail 46430 invoked from network); 17 Jan 2017 17:30:03 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-5.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 17 Jan 2017 17:30:03 -0000 X-IronPort-AV: E=Sophos;i="5.33,245,1477958400"; d="scan'208";a="409098004" From: Paul Durrant To: Date: Tue, 17 Jan 2017 17:29:53 +0000 Message-ID: <1484674196-19951-6-git-send-email-paul.durrant@citrix.com> X-Mailer: git-send-email 2.1.4 In-Reply-To: <1484674196-19951-1-git-send-email-paul.durrant@citrix.com> References: <1484674196-19951-1-git-send-email-paul.durrant@citrix.com> MIME-Version: 1.0 Cc: Andrew Cooper , Daniel De Graaf , Paul Durrant , Ian Jackson , Jan Beulich Subject: [Xen-devel] [PATCH v4 5/8] dm_op: convert HVMOP_modified_memory X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xen.org Sender: "Xen-devel" X-Virus-Scanned: ClamAV using ClamSMTP This patch introduces code to handle DMOP continuations. NOTE: This patch also modifies the type of the 'nr' argument of xc_hvm_modified_memory() from uint64_t to uint32_t. In practice the value passed was always truncated to 32 bits. Suggested-by: Jan Beulich Signed-off-by: Paul Durrant Acked-by: Daniel De Graaf --- Cc: Jan Beulich Cc: Ian Jackson Acked-by: Wei Liu Cc: Andrew Cooper Cc: Daniel De Graaf v4: - Continuation code in dm.c modified as knock-on from compat code. Not adding Jan's R-b since patch has fundamentally changed. v3: - Addressed more comments from Jan. v2: - Addressed several comments from Jan, including... - Added explanatory note on continuation handling --- tools/libxc/include/xenctrl.h | 2 +- tools/libxc/xc_misc.c | 27 +++++-------- xen/arch/x86/hvm/dm.c | 77 ++++++++++++++++++++++++++++++++++++- xen/arch/x86/hvm/hvm.c | 60 ----------------------------- xen/include/public/hvm/dm_op.h | 19 +++++++++ xen/include/public/hvm/hvm_op.h | 13 ------- xen/xsm/flask/policy/access_vectors | 2 +- 7 files changed, 106 insertions(+), 94 deletions(-) diff --git a/tools/libxc/include/xenctrl.h b/tools/libxc/include/xenctrl.h index f819bf2..a5c234f 100644 --- a/tools/libxc/include/xenctrl.h +++ b/tools/libxc/include/xenctrl.h @@ -1627,7 +1627,7 @@ int xc_hvm_track_dirty_vram( * Notify that some pages got modified by the Device Model */ int xc_hvm_modified_memory( - xc_interface *xch, domid_t dom, uint64_t first_pfn, uint64_t nr); + xc_interface *xch, domid_t dom, uint64_t first_pfn, uint32_t nr); /* * Set a range of memory to a specific type. diff --git a/tools/libxc/xc_misc.c b/tools/libxc/xc_misc.c index ddea2bb..597df99 100644 --- a/tools/libxc/xc_misc.c +++ b/tools/libxc/xc_misc.c @@ -573,29 +573,20 @@ int xc_hvm_track_dirty_vram( } int xc_hvm_modified_memory( - xc_interface *xch, domid_t dom, uint64_t first_pfn, uint64_t nr) + xc_interface *xch, domid_t dom, uint64_t first_pfn, uint32_t nr) { - DECLARE_HYPERCALL_BUFFER(struct xen_hvm_modified_memory, arg); - int rc; - - arg = xc_hypercall_buffer_alloc(xch, arg, sizeof(*arg)); - if ( arg == NULL ) - { - PERROR("Could not allocate memory for xc_hvm_modified_memory hypercall"); - return -1; - } + struct xen_dm_op op; + struct xen_dm_op_modified_memory *data; - arg->domid = dom; - arg->first_pfn = first_pfn; - arg->nr = nr; + memset(&op, 0, sizeof(op)); - rc = xencall2(xch->xcall, __HYPERVISOR_hvm_op, - HVMOP_modified_memory, - HYPERCALL_BUFFER_AS_ARG(arg)); + op.op = XEN_DMOP_modified_memory; + data = &op.u.modified_memory; - xc_hypercall_buffer_free(xch, arg); + data->first_pfn = first_pfn; + data->nr = nr; - return rc; + return do_dm_op(xch, dom, 1, &op, sizeof(op)); } int xc_hvm_set_mem_type( diff --git a/xen/arch/x86/hvm/dm.c b/xen/arch/x86/hvm/dm.c index 12a82e5..dd81116 100644 --- a/xen/arch/x86/hvm/dm.c +++ b/xen/arch/x86/hvm/dm.c @@ -14,6 +14,7 @@ * this program; If not, see . */ +#include #include #include #include @@ -105,6 +106,59 @@ static int set_isa_irq_level(struct domain *d, uint8_t isa_irq, return 0; } +static int modified_memory(struct domain *d, xen_pfn_t *first_pfn, + unsigned int *nr) +{ + xen_pfn_t last_pfn = *first_pfn + *nr - 1; + unsigned int iter = 0; + int rc = 0; + + if ( (*first_pfn > last_pfn) || + (last_pfn > domain_get_maximum_gpfn(d)) ) + return -EINVAL; + + if ( !paging_mode_log_dirty(d) ) + return 0; + + while ( iter < *nr ) + { + unsigned long pfn = *first_pfn + iter; + struct page_info *page; + + page = get_page_from_gfn(d, pfn, NULL, P2M_UNSHARE); + if ( page ) + { + mfn_t gmfn = _mfn(page_to_mfn(page)); + + paging_mark_dirty(d, gmfn); + /* + * These are most probably not page tables any more + * don't take a long time and don't die either. + */ + sh_remove_shadows(d, gmfn, 1, 0); + put_page(page); + } + + iter++; + + /* + * Check for continuation every 256th iteration and if the + * iteration is not the last. + */ + if ( (iter < *nr) && ((iter & 0xff) == 0) && + hypercall_preempt_check() ) + { + *first_pfn += iter; + *nr -= iter; + + rc = -ERESTART; + break; + } + } + + return rc; +} + static int dm_op(domid_t domid, unsigned int nr_bufs, xen_dm_op_buf_t bufs[]) @@ -266,12 +320,25 @@ static int dm_op(domid_t domid, break; } + case XEN_DMOP_modified_memory: + { + struct xen_dm_op_modified_memory *data = + &op.u.modified_memory; + + rc = -EINVAL; + if ( data->pad ) + break; + + rc = modified_memory(d, &data->first_pfn, &data->nr); + break; + } + default: rc = -EOPNOTSUPP; break; } - if ( !rc && + if ( (!rc || rc == -ERESTART) && !copy_buf_to_guest(bufs, nr_bufs, 0, &op, sizeof(op)) ) rc = -EFAULT; @@ -310,6 +377,10 @@ int compat_dm_op(domid_t domid, rc = dm_op(domid, nr_bufs, nat); + if ( rc == -ERESTART ) + rc = hypercall_create_continuation(__HYPERVISOR_dm_op, "iih", + domid, nr_bufs, bufs); + out: xfree(nat); @@ -332,6 +403,10 @@ long do_dm_op(domid_t domid, rc = dm_op(domid, nr_bufs, nat); + if ( rc == -ERESTART ) + rc = hypercall_create_continuation(__HYPERVISOR_dm_op, "iih", + domid, nr_bufs, bufs); + xfree(nat); return rc; diff --git a/xen/arch/x86/hvm/hvm.c b/xen/arch/x86/hvm/hvm.c index 937e16f..32dc6d7 100644 --- a/xen/arch/x86/hvm/hvm.c +++ b/xen/arch/x86/hvm/hvm.c @@ -4965,7 +4965,6 @@ long do_hvm_op(unsigned long op, XEN_GUEST_HANDLE_PARAM(void) arg) default: mask = ~0UL; break; - case HVMOP_modified_memory: case HVMOP_set_mem_type: mask = HVMOP_op_mask; break; @@ -4998,65 +4997,6 @@ long do_hvm_op(unsigned long op, XEN_GUEST_HANDLE_PARAM(void) arg) rc = guest_handle_is_null(arg) ? hvmop_flush_tlb_all() : -EINVAL; break; - case HVMOP_modified_memory: - { - struct xen_hvm_modified_memory a; - struct domain *d; - - if ( copy_from_guest(&a, arg, 1) ) - return -EFAULT; - - rc = rcu_lock_remote_domain_by_id(a.domid, &d); - if ( rc != 0 ) - return rc; - - rc = -EINVAL; - if ( !is_hvm_domain(d) ) - goto modmem_fail; - - rc = xsm_hvm_control(XSM_DM_PRIV, d, op); - if ( rc ) - goto modmem_fail; - - rc = -EINVAL; - if ( a.nr < start_iter || - ((a.first_pfn + a.nr - 1) < a.first_pfn) || - ((a.first_pfn + a.nr - 1) > domain_get_maximum_gpfn(d)) ) - goto modmem_fail; - - rc = 0; - if ( !paging_mode_log_dirty(d) ) - goto modmem_fail; - - while ( a.nr > start_iter ) - { - unsigned long pfn = a.first_pfn + start_iter; - struct page_info *page; - - page = get_page_from_gfn(d, pfn, NULL, P2M_UNSHARE); - if ( page ) - { - paging_mark_dirty(d, _mfn(page_to_mfn(page))); - /* These are most probably not page tables any more */ - /* don't take a long time and don't die either */ - sh_remove_shadows(d, _mfn(page_to_mfn(page)), 1, 0); - put_page(page); - } - - /* Check for continuation if it's not the last interation */ - if ( a.nr > ++start_iter && !(start_iter & HVMOP_op_mask) && - hypercall_preempt_check() ) - { - rc = -ERESTART; - break; - } - } - - modmem_fail: - rcu_unlock_domain(d); - break; - } - case HVMOP_get_mem_type: rc = hvmop_get_mem_type( guest_handle_cast(arg, xen_hvm_get_mem_type_t)); diff --git a/xen/include/public/hvm/dm_op.h b/xen/include/public/hvm/dm_op.h index a52c8ea..8514ca4 100644 --- a/xen/include/public/hvm/dm_op.h +++ b/xen/include/public/hvm/dm_op.h @@ -234,6 +234,24 @@ struct xen_dm_op_set_pci_link_route { uint8_t isa_irq; }; +/* + * XEN_DMOP_modified_memory: Notify that a set of pages were modified by + * an emulator. + * + * NOTE: In the event of a continuation, the @first_pfn is set to the + * value of the pfn of the remaining set of pages and @nr reduced + * to the size of the remaining set. + */ +#define XEN_DMOP_modified_memory 11 + +struct xen_dm_op_modified_memory { + /* IN - number of contiguous pages modified */ + uint32_t nr; + uint32_t pad; + /* IN - first pfn modified */ + uint64_aligned_t first_pfn; +}; + struct xen_dm_op { uint32_t op; uint32_t pad; @@ -248,6 +266,7 @@ struct xen_dm_op { struct xen_dm_op_set_pci_intx_level set_pci_intx_level; struct xen_dm_op_set_isa_irq_level set_isa_irq_level; struct xen_dm_op_set_pci_link_route set_pci_link_route; + struct xen_dm_op_modified_memory modified_memory; } u; }; diff --git a/xen/include/public/hvm/hvm_op.h b/xen/include/public/hvm/hvm_op.h index 7cf8d4d..76e1b78 100644 --- a/xen/include/public/hvm/hvm_op.h +++ b/xen/include/public/hvm/hvm_op.h @@ -99,19 +99,6 @@ typedef enum { /* Following tools-only interfaces may change in future. */ #if defined(__XEN__) || defined(__XEN_TOOLS__) -/* Notify that some pages got modified by the Device Model. */ -#define HVMOP_modified_memory 7 -struct xen_hvm_modified_memory { - /* Domain to be updated. */ - domid_t domid; - /* Number of pages. */ - uint32_t nr; - /* First pfn. */ - uint64_aligned_t first_pfn; -}; -typedef struct xen_hvm_modified_memory xen_hvm_modified_memory_t; -DEFINE_XEN_GUEST_HANDLE(xen_hvm_modified_memory_t); - #define HVMOP_set_mem_type 8 /* Notify that a region of memory is to be treated in a specific way. */ struct xen_hvm_set_mem_type { diff --git a/xen/xsm/flask/policy/access_vectors b/xen/xsm/flask/policy/access_vectors index 2f0ed2d..361e7aa 100644 --- a/xen/xsm/flask/policy/access_vectors +++ b/xen/xsm/flask/policy/access_vectors @@ -262,7 +262,7 @@ class hvm bind_irq # XEN_DOMCTL_pin_mem_cacheattr cacheattr -# HVMOP_modified_memory, HVMOP_get_mem_type, HVMOP_set_mem_type, +# HVMOP_get_mem_type, HVMOP_set_mem_type, # HVMOP_set_mem_access, HVMOP_get_mem_access, HVMOP_pagetable_dying, # HVMOP_inject_trap hvmctl