From patchwork Wed Apr 3 11:49:50 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Juan Quintela X-Patchwork-Id: 10883565 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id C6AC0139A for ; Wed, 3 Apr 2019 11:59:02 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id AF8D9289C0 for ; Wed, 3 Apr 2019 11:59:02 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id A1D06289CE; Wed, 3 Apr 2019 11:59:02 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00,MAILING_LIST_MULTI autolearn=ham version=3.3.1 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id 4FFB8289C0 for ; Wed, 3 Apr 2019 11:59:02 +0000 (UTC) Received: from localhost ([127.0.0.1]:52855 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1hBeXl-0004Cg-MR for patchwork-qemu-devel@patchwork.kernel.org; Wed, 03 Apr 2019 07:59:01 -0400 Received: from eggs.gnu.org ([209.51.188.92]:59023) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1hBeWg-0003S1-KK for qemu-devel@nongnu.org; Wed, 03 Apr 2019 07:57:55 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hBeWe-0001ku-Oy for qemu-devel@nongnu.org; Wed, 03 Apr 2019 07:57:54 -0400 Received: from mx1.redhat.com ([209.132.183.28]:46666) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1hBeWc-0001fs-Qd for qemu-devel@nongnu.org; Wed, 03 Apr 2019 07:57:51 -0400 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 63AB4368E7 for ; Wed, 3 Apr 2019 11:51:29 +0000 (UTC) Received: from localhost.localdomain (ovpn-117-49.ams2.redhat.com [10.36.117.49]) by smtp.corp.redhat.com (Postfix) with ESMTP id 7B2B6608D5; Wed, 3 Apr 2019 11:51:27 +0000 (UTC) From: Juan Quintela To: qemu-devel@nongnu.org Date: Wed, 3 Apr 2019 13:49:50 +0200 Message-Id: <20190403114958.3705-1-quintela@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.30]); Wed, 03 Apr 2019 11:51:29 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH v2 0/8] WIP: Multifd compression support X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Laurent Vivier , Thomas Huth , Juan Quintela , Markus Armbruster , "Dr. David Alan Gilbert" , Paolo Bonzini Errors-To: qemu-devel-bounces+patchwork-qemu-devel=patchwork.kernel.org@nongnu.org Sender: "Qemu-devel" X-Virus-Scanned: ClamAV using ClamSMTP v2: - improve the code left and right - Split better the zlib code - rename everything to v4.1 - Add tests for multifd-compress zlib - Parameter is now an enum (soon will see sztd) ToDo: - Make operations for diferent methods: * multifd_prepare_send_none/zlib * multifd_send_none/zlib * multifd_recv_none/zlib - Use the MULTIFD_FLAG_ZLIB (it is unused so far). Please review and comment. v1: This series create compression code on top of multifd. It is still WIP, but it is already: - faster that current compression code - it does the minimum amount of copies possible - we allow support for other compression codes - it pass the multifd test sent in my previous series Test for existing code didn't work because code is too slow, I need to make downtime 10 times bigger to make it to converge on my test machine. This code works with same limits that multifd no- ToDo: - move printf's to traces - move code to a struct instead of if (zlib) inside the main threads. - improve error handling. Please, review and coment. Juan Quintela (8): migration: Fix migrate_set_parameter migration: fix multifd_recv event typo migration-test: rename parameter to parameter_int tests: Add migration multifd test migration-test: introduce functions to handle string parameters migration: Add multifd-compress parameter multifd: Add zlib compression support multifd: rest of zlib compression (WIP) hmp.c | 23 +++++- hw/core/qdev-properties.c | 11 +++ include/hw/qdev-properties.h | 1 + migration/migration.c | 25 ++++++ migration/migration.h | 1 + migration/ram.c | 140 +++++++++++++++++++++++++++++++-- migration/trace-events | 2 +- qapi/common.json | 15 ++++ qapi/migration.json | 19 ++++- tests/migration-test.c | 147 +++++++++++++++++++++++++++++------ 10 files changed, 348 insertions(+), 36 deletions(-)