From patchwork Sat Jan 16 21:47:05 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vladimir Sementsov-Ogievskiy X-Patchwork-Id: 12025099 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.7 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 75F69C433DB for ; Sat, 16 Jan 2021 22:09:16 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id D66EA20791 for ; Sat, 16 Jan 2021 22:09:15 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org D66EA20791 Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=virtuozzo.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:41596 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l0tkx-0000rZ-0V for qemu-devel@archiver.kernel.org; Sat, 16 Jan 2021 17:09:15 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:50998) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l0tQZ-0005Zf-GG; Sat, 16 Jan 2021 16:48:11 -0500 Received: from mail-am6eur05on2132.outbound.protection.outlook.com ([40.107.22.132]:15968 helo=EUR05-AM6-obe.outbound.protection.outlook.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l0tQX-00078U-6y; Sat, 16 Jan 2021 16:48:11 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nn+UyZQ9ZLOe89G9NLTvKhLT78DOAfiIR6GpC+luTKLXcxkuXZlqs4vXw6ZGcI8T1m1daWwVQUa4t5pBgmGa0kGm+9cBzyQcXL31SfGMPF1RjteTI3The9MAiV9qwG2J8nJ1xVRHZ/wU+rGw9FAz6DpaVqYdiAjJIlE3jjyr6ZpyfL9U8D9ScU6faSpGwnL3IVLvfXqbLBYdBWg39sHIUqIxXV5Hp/3dOezXQz5/AjGMe2t/AdGVrMdLIfbwSV8U171oaN/FgxcxWXd5W3mFMXPR/TkWQm+bL1ONrKIHCRDHe+76ZjWI+DLJD82IldMrpy9FI3bTt9D1sT1UVWi6KQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=B1yrOan4pfN15DMCckZo9Yzs4v4jxuVIcNK4PXQ1oVU=; b=NRbu9JU7mpuOxH9FNnnKfzpIfOxA/JJkzfPL2X4LMUwrOTeXjj/Zu8x8oL9JukAUNghtpNVhQwNsLntzkER0OD3l+V5GGHG5g59MwMaFqS13aBF0IelltpRfJdEhPv/Tan5JZMJ1PI4xB0SmYf6QV1SzoixZKnb98W7fJnBLYKuudMkN5FgWQNf4AuOoXODZQKpgJ34VTHTIQ7nVDr0IQ341tVOjNGMdfQHXRSK/mnRZ/L1MwYhVWotRdnT26Wxy/bREzQPrScfiIJkoHuB2roUh44uCbLqV8pP3LJONiY+qJxzwNGmBz5k+CLEeBnLfjfeoOW92VJFSfVB3K7KaRQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=virtuozzo.com; dmarc=pass action=none header.from=virtuozzo.com; dkim=pass header.d=virtuozzo.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=virtuozzo.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=B1yrOan4pfN15DMCckZo9Yzs4v4jxuVIcNK4PXQ1oVU=; b=uk7gPf9fLEZwEUroRKUPo6z2MQ5GXOergBLgmKCd6p2wzpI7K6tAV5eYWh/0siu6XaG5AOzVxJImRyuWX2sMeVUxpt4IRDACWsjfCnsgIfzDb/a+n9S7kliuaehqdGmjAcQQ0eGv2s0BL+Muzw4lHDAvPhWGX89vZb+iFlJL2TI= Authentication-Results: nongnu.org; dkim=none (message not signed) header.d=none;nongnu.org; dmarc=none action=none header.from=virtuozzo.com; Received: from AM7PR08MB5494.eurprd08.prod.outlook.com (2603:10a6:20b:dc::15) by AM5PR0801MB2033.eurprd08.prod.outlook.com (2603:10a6:203:4c::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3763.12; Sat, 16 Jan 2021 21:48:03 +0000 Received: from AM7PR08MB5494.eurprd08.prod.outlook.com ([fe80::214a:3545:368c:7ae8]) by AM7PR08MB5494.eurprd08.prod.outlook.com ([fe80::214a:3545:368c:7ae8%9]) with mapi id 15.20.3763.013; Sat, 16 Jan 2021 21:48:03 +0000 From: Vladimir Sementsov-Ogievskiy To: qemu-block@nongnu.org Subject: [PATCH v4 23/23] simplebench: add bench-backup.py Date: Sun, 17 Jan 2021 00:47:05 +0300 Message-Id: <20210116214705.822267-24-vsementsov@virtuozzo.com> X-Mailer: git-send-email 2.29.2 In-Reply-To: <20210116214705.822267-1-vsementsov@virtuozzo.com> References: <20210116214705.822267-1-vsementsov@virtuozzo.com> X-Originating-IP: [185.215.60.72] X-ClientProxiedBy: AM4PR0701CA0005.eurprd07.prod.outlook.com (2603:10a6:200:42::15) To AM7PR08MB5494.eurprd08.prod.outlook.com (2603:10a6:20b:dc::15) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from kvm.sw.ru (185.215.60.72) by AM4PR0701CA0005.eurprd07.prod.outlook.com (2603:10a6:200:42::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3784.6 via Frontend Transport; Sat, 16 Jan 2021 21:48:02 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 156412c7-5f01-4938-5f4f-08d8ba686682 X-MS-TrafficTypeDiagnostic: AM5PR0801MB2033: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: jM5k245RHWXXEFnuPP8Iy3XMl4r7d+rdfAUnHOdLw8ihGGGJjNFTNA4co8cV27uvxPUEyuME9xS2x/rZroufqIZ0yRHxm0s3e5GWMZ5f5E8PhbjkPyjWdnFdEFSy6XLlCEYcssDMeHvFWMCRsBGOwlNz4PJ56OwCkerEY/yCVjToIuQt9LGhRPFOsC0x6ZE77agipf04dbX9U+anOXrWQz4hMYw4rdum+fUJVSqKsCrDyv0aAqQdYftD66VmlOkSpmTUDOXreR2n6sfqqPCZf9x4GVK+WaIotLZ6+cQ3wysOZircKqVyKwmxQXW9V3zcZk8HN9VJJn02VDJf5ZG5SrR8YDwvbZwMBNDsdleBWwK5fIHo2XTvTrzTyL2NOniKUjDytkMtH49HOWVnD08xJPkQWMXnT8yDUpgJKHjqH+eh6hNQsclR9MT/8JLpOJEdVLW2X6jb2aobFAPYAXOfiiQPzKk5++4d0EGUdgc1wF8wfDNJ0AkulaYvChOFL3lnYr7m+WfaU6EL0deNyK47Iw== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM7PR08MB5494.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(136003)(346002)(376002)(366004)(39840400004)(6506007)(8676002)(1076003)(186003)(16526019)(5660300002)(6486002)(6916009)(36756003)(316002)(8936002)(107886003)(4326008)(478600001)(86362001)(6512007)(2616005)(956004)(2906002)(26005)(66476007)(66556008)(66946007)(83380400001)(52116002)(2004002); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData: aUWeYfGq8kM/idqk0+FdhbtZY1uCH9wdH5yK+wKonPQZPXFPlI24fvmlNLYU/+SwTvjoymzPmoEbcII27HXgXMXJb8upgAoTUa649JIvMqAfjJcwYgne+9qoPDM9lQiwHc1rZYXmWpu+PReGd6kHoWwRF2hkGV53ZIe7tYOnhBJhBytv1GCjhGzn8MzePN1YaBBEseLTHup/bMjFQs8drbQbCvSq40ZecDsOTZROjQrpfQH+71d6l6ecxlmPJ1JFZvXM7mWVJ0ohu6x2+OrRcLaynjNKCSJ3kWWM6DV/ZsF+d4q623U4ReMu4RFAtcahoJ5AEuGrcR4lKK0zDZ/o3heNCgFSbZafeB81cbbzmM05gQZ7kWpEazsRCUWbkMyiLf/vSD1O66Q4/udOS8h6Tqf7qxLwCmfnUZ0Na9Mo0IAYHkR8j3OhR1W9VeoMREfay7i1vqxJlP3ATYNcLJi61dQC/g+mwLHInWKKVjTsXh/aLvDU9AL+v03YBf4s4D74G8WY2vfeWYxzIRya6CA+DNNlkzBNNjRWZ6qH6MWSIew60Ncw48DGv2mW6OwCXXGYU9PWp6tkccotU0HZFN0RxRquC/+nL74HUWukibtouT51gyGW/p5lGJNt9SdT8hEGwfDI1adtkyIrHZwmlMq1fjfH3Zc9luPu7GChoCfqMCGH6H5KFegfOBygDmhxSy2rjbx38/H17DdQSVUdnhVzWhBPBL7iGZ4GKJGHkrehIj1dpu065T0zv+DCU8IenR0J96pMT8EpmPi9emj0oWUL6uo1FJ7M1rCDGkohjAabAsgw0aD+npvgHo+iYQLF3uLNSWiMmXr+P1m0LRPaApvkYDFGmlH7ayj96e6TPdnbXrj1g7njh308GPyFOeDwUaZWKJmY4QkLeQH95JynRa3sviT5RIFFQ4cFNQTkWN2UTxEiu8RgLkdcM2/cTiImfeLKFNTjcNtp7nYfPibsJyWHYb/RRrhhRoLaaFqa3FmvuZjSTE+j73fB+pEmm+fUDLgy X-OriginatorOrg: virtuozzo.com X-MS-Exchange-CrossTenant-Network-Message-Id: 156412c7-5f01-4938-5f4f-08d8ba686682 X-MS-Exchange-CrossTenant-AuthSource: AM7PR08MB5494.eurprd08.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jan 2021 21:48:03.4460 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 0bc7f26d-0264-416e-a6fc-8352af79c58f X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 6BrsxPzRnIYMsvObsByTYTZ0Bx3JlJxy4bHFDwmrr+xLHgP2lZ3vsrH2H2uLwi9pu4VMDoUSS80B8PltglaDWoJcyyWMNpxfhOqv/4iUWFg= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR0801MB2033 Received-SPF: pass client-ip=40.107.22.132; envelope-from=vsementsov@virtuozzo.com; helo=EUR05-AM6-obe.outbound.protection.outlook.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, MSGID_FROM_MTA_HEADER=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: kwolf@redhat.com, vsementsov@virtuozzo.com, wencongyang2@huawei.com, xiechanglong.d@gmail.com, qemu-devel@nongnu.org, armbru@redhat.com, jsnow@redhat.com, den@openvz.org, mreitz@redhat.com Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" Add script to benchmark new backup architecture. Signed-off-by: Vladimir Sementsov-Ogievskiy --- scripts/simplebench/bench-backup.py | 167 ++++++++++++++++++++++++++++ 1 file changed, 167 insertions(+) create mode 100755 scripts/simplebench/bench-backup.py diff --git a/scripts/simplebench/bench-backup.py b/scripts/simplebench/bench-backup.py new file mode 100755 index 0000000000..2cf7a852e0 --- /dev/null +++ b/scripts/simplebench/bench-backup.py @@ -0,0 +1,167 @@ +#!/usr/bin/env python3 +# +# Bench backup block-job +# +# Copyright (c) 2020 Virtuozzo International GmbH. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . +# + +import argparse +import json + +import simplebench +from results_to_text import results_to_text +from bench_block_job import bench_block_copy, drv_file, drv_nbd + + +def bench_func(env, case): + """ Handle one "cell" of benchmarking table. """ + cmd_options = env['cmd-options'] if 'cmd-options' in env else {} + return bench_block_copy(env['qemu-binary'], env['cmd'], + cmd_options, + case['source'], case['target']) + + +def bench(args): + test_cases = [] + + sources = {} + targets = {} + for d in args.dir: + label, path = d.split(':') # paths with colon not unsupported + sources[label] = drv_file(path + '/test-source') + targets[label] = drv_file(path + '/test-target') + + if args.nbd: + nbd = args.nbd.split(':') + host = nbd[0] + port = '10809' if len(nbd) == 1 else nbd[1] + drv = drv_nbd(host, port) + sources['nbd'] = drv + targets['nbd'] = drv + + for t in args.test: + src, dst = t.split(':') + + test_cases.append({ + 'id': t, + 'source': sources[src], + 'target': targets[dst] + }) + + binaries = [] # list of (