From patchwork Thu Oct 14 00:48:46 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Longpeng(Mike)" X-Patchwork-Id: 12557615 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D54DDC433EF for ; Thu, 14 Oct 2021 00:53:56 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 95388610E8 for ; Thu, 14 Oct 2021 00:53:56 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 95388610E8 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=huawei.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=nongnu.org Received: from localhost ([::1]:58618 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1map0M-0006Kc-No for qemu-devel@archiver.kernel.org; Wed, 13 Oct 2021 20:53:54 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50114) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1maow2-000751-RP for qemu-devel@nongnu.org; Wed, 13 Oct 2021 20:49:26 -0400 Received: from szxga01-in.huawei.com ([45.249.212.187]:2939) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1maovz-0002ve-0x for qemu-devel@nongnu.org; Wed, 13 Oct 2021 20:49:25 -0400 Received: from dggemv704-chm.china.huawei.com (unknown [172.30.72.57]) by szxga01-in.huawei.com (SkyGuard) with ESMTP id 4HV9f24jCVzbn5Q; Thu, 14 Oct 2021 08:44:42 +0800 (CST) Received: from dggpeml100016.china.huawei.com (7.185.36.216) by dggemv704-chm.china.huawei.com (10.3.19.47) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.8; Thu, 14 Oct 2021 08:49:11 +0800 Received: from DESKTOP-27KDQMV.china.huawei.com (10.174.148.223) by dggpeml100016.china.huawei.com (7.185.36.216) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.8; Thu, 14 Oct 2021 08:49:10 +0800 From: "Longpeng(Mike)" To: , Subject: [PATCH v4 0/6] optimize the downtime for vfio migration Date: Thu, 14 Oct 2021 08:48:46 +0800 Message-ID: <20211014004852.1293-1-longpeng2@huawei.com> X-Mailer: git-send-email 2.25.0.windows.1 MIME-Version: 1.0 X-Originating-IP: [10.174.148.223] X-ClientProxiedBy: dggems703-chm.china.huawei.com (10.3.19.180) To dggpeml100016.china.huawei.com (7.185.36.216) X-CFilter-Loop: Reflected Received-SPF: pass client-ip=45.249.212.187; envelope-from=longpeng2@huawei.com; helo=szxga01-in.huawei.com X-Spam_score_int: -41 X-Spam_score: -4.2 X-Spam_bar: ---- X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "Longpeng\(Mike\)" , arei.gonglei@huawei.com, qemu-devel@nongnu.org, kvm@vger.kernel.org Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Hi guys, In vfio migration resume phase, the cost would increase if the vfio device has more unmasked vectors. We try to optimize it in this series. You can see the commit message in PATCH 6 for details. Patch 1-3 are simple cleanups and fixup. Patch 4-5 are the preparations for the optimization. Patch 6 optimizes the vfio msix setup path. Changes v3->v4: - fix several typos and grammatical errors [Alex] - remove the patches that fix and clean the MSIX common part from this series [Alex] - Patch 6: - use vector->use directly and fill it with -1 on error paths [Alex] - add comment before enable deferring to commit [Alex] - move the code that do_use/release on vector 0 into an "else" branch [Alex] - introduce vfio_prepare_kvm_msi_virq_batch() that enables the 'defer_kvm_irq_routing' flag [Alex] - introduce vfio_commit_kvm_msi_virq_batch() that clears the 'defer_kvm_irq_routing' flag and does further work [Alex] Changes v2->v3: - fix two errors [Longpeng] Changes v1->v2: - fix several typos and grammatical errors [Alex, Philippe] - split fixups and cleanups into separate patches [Alex, Philippe] - introduce kvm_irqchip_add_deferred_msi_route to minimize code changes [Alex] - enable the optimization in msi setup path [Alex] Longpeng (Mike) (6): vfio: simplify the conditional statements in vfio_msi_enable vfio: move re-enabling INTX out of the common helper vfio: simplify the failure path in vfio_msi_enable kvm: irqchip: extract kvm_irqchip_add_deferred_msi_route Revert "vfio: Avoid disabling and enabling vectors repeatedly in VFIO migration" vfio: defer to commit kvm irq routing when enable msi/msix accel/kvm/kvm-all.c | 15 ++++- hw/vfio/pci.c | 182 +++++++++++++++++++++++++++++++++------------------ hw/vfio/pci.h | 1 + include/sysemu/kvm.h | 6 ++ 4 files changed, 140 insertions(+), 64 deletions(-)