From patchwork Tue Apr 26 10:20:26 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jan Beulich X-Patchwork-Id: 12826828 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 4A39FC433F5 for ; Tue, 26 Apr 2022 10:20:48 +0000 (UTC) Received: from list by lists.xenproject.org with outflank-mailman.313673.531337 (Exim 4.92) (envelope-from ) id 1njIJ9-0005Cp-AT; Tue, 26 Apr 2022 10:20:35 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 313673.531337; Tue, 26 Apr 2022 10:20:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1njIJ9-0005Ci-6U; Tue, 26 Apr 2022 10:20:35 +0000 Received: by outflank-mailman (input) for mailman id 313673; Tue, 26 Apr 2022 10:20:34 +0000 Received: from se1-gles-flk1-in.inumbo.com ([94.247.172.50] helo=se1-gles-flk1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1njIJ8-0005Ca-B9 for xen-devel@lists.xenproject.org; Tue, 26 Apr 2022 10:20:34 +0000 Received: from de-smtp-delivery-102.mimecast.com (de-smtp-delivery-102.mimecast.com [194.104.111.102]) by se1-gles-flk1.inumbo.com (Halon) with ESMTPS id 8149ef11-c54a-11ec-8fc2-03012f2f19d4; Tue, 26 Apr 2022 12:20:33 +0200 (CEST) Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05lp2168.outbound.protection.outlook.com [104.47.17.168]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id de-mta-2-CfLYma4wN4-v4LJADd9CQA-1; Tue, 26 Apr 2022 12:20:31 +0200 Received: from DU2PR04MB8616.eurprd04.prod.outlook.com (2603:10a6:10:2db::16) by DB3PR0402MB3802.eurprd04.prod.outlook.com (2603:10a6:8:f::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.21; Tue, 26 Apr 2022 10:20:28 +0000 Received: from DU2PR04MB8616.eurprd04.prod.outlook.com ([fe80::5cb0:5195:4203:7c2f]) by DU2PR04MB8616.eurprd04.prod.outlook.com ([fe80::5cb0:5195:4203:7c2f%9]) with mapi id 15.20.5186.021; Tue, 26 Apr 2022 10:20:28 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 8149ef11-c54a-11ec-8fc2-03012f2f19d4 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=mimecast20200619; t=1650968432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=8mF7sdl0jbfeZ0WAUgPUUQdPB6IKJPyJIzvkMw/O2vk=; b=kClV7PoNpTaqE86wVw+y2onooiLJwPThAs22jfqRmJfIok+MTdVV/JpmnDN3NC8uDgi6mo XxRrFkGeri+Ue45ca2834KI/MhM0lenqqMxJ35xUmig+5y5sz35V8H8Odf+swpm0nJgJ94 D5uO75Gz83+1K4Gu9XyNbh2MNRr8qoM= X-MC-Unique: CfLYma4wN4-v4LJADd9CQA-1 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=WhKmIofS9ZOShRW+BUCLulQDksLhhnECYVcp4ZCn15+pKtm0AO7ZWDjDsSY0q0f+ek8zkdiyIIZXD0l6/XJnofUOUAApgC1UFUCyqBPwn1PMW/hk4nA8A5m7+B1xigMBx2QowmLUKlYuQ1Xo2tg+CF43Y+DgdzpYFmkW584fRXvhOslMPC3FtC4LP3KY41WvsslDhfblFiHguU2/xK/pn65UEV09amJmZzW7y2r/I3PZSBbToK7KB+tRY/tQdHdIcoHfrLVdR/V4vPpnoUjTPZ8aLDROy+XVqYaSGl9R/ZqGupGb+NZ6hglJgQR9pBGA49K1YTIe4fqSwqNFREhdpA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=8mF7sdl0jbfeZ0WAUgPUUQdPB6IKJPyJIzvkMw/O2vk=; b=SmZYrStnqxHetS1O4zb4nBGnGn49IXxo9uVWkY4ol1jt8/0WBRQPMIfiITo77n1TeadRN1HRAC6XbuECStTh9n0Fewar/E7Sdi6ZGNm0vLx00/MIJXQ9M325kNZ6+rWPXxVj7HVZbjWW+LUZLv+UFSFBVN4LfZyHrwSaiw2IY9bdX2Z873IM/Efu+8lstxXIjgld62NCqIx9fZjhZZavT9loLrr27QSBaRtVr2AUPhfBKjne4xOcgZEQONtSrdkIJ3Z/56RcsJD4P04u6xme9HHSdPgwC3294n9ozyIVPQqb54c5mbLmnvj0jXn15pTAZBVsii/orwtvaEIaid+vIw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=suse.com; dmarc=pass action=none header.from=suse.com; dkim=pass header.d=suse.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=suse.com; Message-ID: Date: Tue, 26 Apr 2022 12:20:26 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.8.1 From: Jan Beulich Subject: [PATCH v3 0/8] x86: more or less log-dirty related improvements To: "xen-devel@lists.xenproject.org" Cc: Andrew Cooper , Wei Liu , =?utf-8?q?Roger_Pau_Monn=C3=A9?= , Juergen Gross , George Dunlap , Anthony Perard Content-Language: en-US X-ClientProxiedBy: AS8P189CA0027.EURP189.PROD.OUTLOOK.COM (2603:10a6:20b:31f::28) To DU2PR04MB8616.eurprd04.prod.outlook.com (2603:10a6:10:2db::16) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 3da4a929-3b05-4ece-d1b4-08da276e62df X-MS-TrafficTypeDiagnostic: DB3PR0402MB3802:EE_ X-LD-Processed: f7a17af6-1c5c-4a36-aa8b-f5be247aa4ba,ExtFwd X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: ZLW0Pu/lgFwTPEApEDWqJqo2/I+vcxqAjBlUzfxNDRiyzZUg1biqk5UNypjo0+D0FRUHxZf6UT4AG0BjdZ9J7lpF7KUghHkEuBWiZfeY+YKYKaYtoTi6VTmx4IG4/BNN3zGMeGidmPdp2Ht1IrO/GOUMxi5H96oaQfWa7VZpo5ftztpDvLjpVhrbgmNhLrFD0SwTVcwcaivasTq2Aavj09wewsDaSwtcFSb/H9XpYtu/eTbLbnlZAP2y1a9HDCQa5/2qUhM0GG6IX0UqY4CAesm7+9LwBDhSVRGLdERaU03mbG/Tg77ZDOH213LdKADlluoVZUYSxK31SXcbOqPqVkeFfIcaMUDit3I1moZCSY8s7BG0RNw3CABxOwt6gWnHD+uznNGxp2pU0+xOmpJ2+b/eE3IxLKoRMXLH7+vDHyC3gfd+EB0bgX//S4EDvQgmMOAMvIb00CGTTkGzFXfISnXdgevwPXMNzW/xd4jiW2dWvmMjweO3i0oS9GpTs2rgEeG91Uw9TYu6+nBEfRMvGzjxTtDlmz7aJRfcCa7abiRZYf5IOp2EI39b8oDT0ozBspYRBsbIIML8LbVseS0ANy28Zk8WZflFEn6aZhhX1cdQXi6hi2eIl/8eJng6oshlJlq7TpcVpLQvrnJE7GjZeZenn+6Ong2S4BWQnfRnagCLaV5uv9uGwX6vT+Dr9PscEelpljaUFCS0/xoNy03I1PUOalwhiQxX6J+b3blI3Uj/OMlFPWv/+S0xGhgDLEfT9GD7+TB0ANOXk1JXX3Zwyg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DU2PR04MB8616.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230001)(366004)(2616005)(8676002)(66476007)(4326008)(186003)(36756003)(31686004)(316002)(86362001)(66556008)(66946007)(31696002)(8936002)(5660300002)(26005)(6512007)(6916009)(83380400001)(6486002)(54906003)(6506007)(508600001)(38100700002)(2906002)(14143004)(45980500001)(43740500002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?q?5AuNl4VEs1DQz193B/osfdB7+Fhw?= =?utf-8?q?Du1yF6jA+JkagSd8xlNiQD6vqBiyAOG+dbDnx7w1hzeeExsTkk3+FnDj4FJsKk5wZ?= =?utf-8?q?quv/Hfb1gbN9Wt5WKgvXuljuHDtD7hTeYkkE4z4mv5wVrIoYRJD3e+rH+H44xrMZR?= =?utf-8?q?vLzFNcDdalP5/6gu4eADx0FRrwvU004ESXPz3KMeNfcnT+UlFlxbjI/PEXHZD/3TR?= =?utf-8?q?H6b0TFGfGLlUuIIMIz1xEcUSjaxjsuu+XyO03lZLoElC/r6PB1k72brRxPPRp+Zo8?= =?utf-8?q?PKb7Qc8rX4SE2cn2sx5N4P7iqufoJiDN0tJB0IBQ3i+sff1ThAEGQyfUYuPiHN4u3?= =?utf-8?q?hK9WFA6KqaEk+DfehPy5Pe7IU1GEZMW0BP1YGkACqjiIsztdIsCMflLYyPTx+rt2j?= =?utf-8?q?L4ormd6rSctd/z7PMkouonNtoI7bQtNEgN5wR/yU9EecyyqDJweJ5OUYlpk+mWLaN?= =?utf-8?q?2LZFbo0s90RWM1DzNl25qVki6ISvYskLOhSzeIt7dT3pdn0mo5ouCdZj8vSRy5/HR?= =?utf-8?q?BSQ+TexT/t6au7+lS+5VUhM1bDc/Y1lzzYjggrmqizivD0PxmBcT9x+HoRIP/p6Cm?= =?utf-8?q?PoKQzTJ896/00ci2RIKD1MMEbAt4AH59lJMjTzoHRGNbWwGRThGpDuJTuc4nIlRu8?= =?utf-8?q?4hglhFcfHfUgGprLr1BVCBOlZkC0NGuQAQm1sX0ArMIqKHA9WpRh7YIa6/lAjDPUx?= =?utf-8?q?ayTwpLtIuztPPE2uMbmr2LTUU7F8r1N9g1Of5xiFoDyW+Sy/LuSimRvG3JS7LtXA4?= =?utf-8?q?nFrD3WNUpsbLv3L8z0XRd/rFJs0DdYBU+59lPiLRCbF3er0qtpYcHfyz6E7lUjWEH?= =?utf-8?q?Xa4yOU+REmYrjd5BUwRWWb/3EEtt4GFRdafBH4NlF5+4YyyQbrpe9ZGPOh3t0M6aH?= =?utf-8?q?Zd1ca6wGAIA5XjZzVa+WcJjreM4wtCsu/lSgAwhn1XV4NZshI7YGon2GXOiSPj+SD?= =?utf-8?q?4I0LUSVnrrQR8Kh1BVDAZYik8Kc3g1aQtT06SmF0WiRH2HZNF1hI2GaD2y2C8pv/c?= =?utf-8?q?BNmbd0qWzm+YZ+g43PMx+yShAzLra6W9FYTKrkfGyWOjfrpN0tkpPq4NZGWuqVIiQ?= =?utf-8?q?c/GuIC9+7wexFosnrSQJ2wvpKxPhRcFVmQ9yCaEyfWdUToEFRISdqV94Dh8CS16Ca?= =?utf-8?q?+EbrFuQNnXWnXxTLaBgzasWHdbJOkEza/hY+oEA5soJPMCzhpqsTI2D4LiET4YGId?= =?utf-8?q?uud2Kttq3ZLDwbAS6CPRNOWcc3njd1lSEWFTefc8z7ja0XJP0rcr4FAKNvZcTOCQD?= =?utf-8?q?hkyJljcUy7S+Zn384ogTBNdnwpOb+zvl2phPlL4x3HxZ5gRWl7zmHAXmUxWNuqp6t?= =?utf-8?q?3Dp6tqkANnQmFrO2V2X2tKhqcaru+ufoMWXud7XI8lLntKQ7QKfRPzSP+KzHyXtZB?= =?utf-8?q?xNFW3Gk5E3MuKTrgyXHAPU5cHsnjCDFMNfp41L9eHmObaVeKrxYLINI9IXq6aEAzU?= =?utf-8?q?pcx3GI6MA6CPlJDD+h2vE6E6gj3LyV26uyUlAm1R1rJ6JRCAQ2WNeJ4z6Sa6Pt8wD?= =?utf-8?q?XXPmsPDun7EYPnh0S1j30pzP9Tu60zZIK9Ik5QvglzkfQK6+ZMLcesspC1Wi1iu9V?= =?utf-8?q?CNILCjNmHYZqnleouqYY7v68qxOsEZqQO0QdFnPH65bgYHCu94mY0OW4cH9bt+5/c?= =?utf-8?q?Jlv0jUiPf6SH6o1mXQII3oXAxUKAEB+g=3D=3D?= X-OriginatorOrg: suse.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3da4a929-3b05-4ece-d1b4-08da276e62df X-MS-Exchange-CrossTenant-AuthSource: DU2PR04MB8616.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Apr 2022 10:20:28.6161 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: f7a17af6-1c5c-4a36-aa8b-f5be247aa4ba X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 4K3BDar9uOuBMOFRttqipKstCslqDGlqwsWzNrx7nKxf+vZxHGmySmW3Oeu2EYrpO6R0N3mNDT+TVVnfKSahHw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB3PR0402MB3802 ... or so I hope. This series continues the attempt to deal with the ovmf change putting the shared info page at a very high address (which is now planned to get reverted there, but the general problem doesn't go away by them doing so). There are further issues with truncated value, which are being dealt with here. But there are also not directly related changes, when I simply spotted things that aren't very likely to be right the way they are. And then there are also adjustments to the underlying hypervisor implementation, with the goal of making the returned data more useful to consumers. With these changes in place, a 1Gb guest which has "inflated" itself by putting a page right below the 16Tb boundary migrates successfully, albeit the process takes from some 20 minutes to over half an hour on my test system. No significant changes in v3 (individual patches have details); a controversial patch was moved later in the series. 1: libxenguest: short-circuit "all-dirty" handling 2: libxenguest: avoid allocating unused deferred-pages bitmap 3: libxenguest: guard against overflow from too large p2m when checkpointing 4: libxenguest: restrict PV guest size 5: libxenguest: deal with log-dirty op stats overflow 6: x86/paging: supply more useful log-dirty page count 7: x86/mm: update log-dirty bitmap when manipulating P2M 8: SUPPORT.md: write down restriction of 32-bit tool stacks Jan