From patchwork Tue Sep 3 08:38:06 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Huan Yang X-Patchwork-Id: 13788298 Received: from APC01-TYZ-obe.outbound.protection.outlook.com (mail-tyzapc01on2066.outbound.protection.outlook.com [40.107.117.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 13F4021C160; Tue, 3 Sep 2024 08:41:43 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.117.66 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1725352904; cv=fail; b=taYq9+DWdNQHCZXTtqIPfsCcLpzdDTThNYMULRCiOl5k/vyqR3a5BG6g+43S4im9FSwiplJ0MFBoyJByKQ6/lqfpy8yYwO+L82940nmwqijMG79nFBl0RA81hQQOnIPPyrVzt1y+bs0IldkHkw4ueoJh40sgfnlJBqceKdMBjzw= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1725352904; c=relaxed/simple; bh=MJh9qeeM0oh93AJXo0IjTavN5Bi6QdM4YDnD7nz+HFg=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: Content-Type:MIME-Version; b=LvJihidumNAPDmz2XcT0gIcVWzGii8/JU1Vr9IKELl1/J7HLhBvi3aZOhN+1u/+dDxomCv8UQqxVGXqcu7rXZEuJJOVFyDt6sP2KyPCpGpp+a+GGpE/mwl6Ie89cEs8MXwev4AUvmlVUddDd0uPSL0f6OSWWYBhg5YlKD1hYGGQ= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=vivo.com; spf=pass smtp.mailfrom=vivo.com; dkim=pass (2048-bit key) header.d=vivo.com header.i=@vivo.com header.b=Fv/Upo97; arc=fail smtp.client-ip=40.107.117.66 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=vivo.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=vivo.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=vivo.com header.i=@vivo.com header.b="Fv/Upo97" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=QvG6HXwlM3yBwkT+v63EveUC46NMI6rJ5PfnThKc3/Bm/IHbNrXy3k5iwksBy95f24c0uja0LDO1A27vQ6gnnr1BdNskTzrJsEqnuu0671zex14x7Aflfth05M0TVaIW54IMJ/e1pSbmaLlQEFJvnVJRvb8cftHGBcvH94GV89+xOqqlkGFSm7ELjcyShuZi4MoaOZi86ob6vkvwSbfFL7U8w1j36Qz9vBZ5e6dVK1AkkvJkKKxm2RL3uVLeDz1HIBV4yGnluVuVI7vfc09O9tfUuzg2KojVP9MF7dISfX3h3Fttx9E6xnLcaYdZmgzc49XlfSfMuHsREQMGT4NAlA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=bEl7paveOHylyyRXGVKtozPBzrcu8xkDidxcynB+u1Q=; b=m5vS1PosSG5y/OZasLOJ1WDOz+c7h1LdMsDsyGjxguwBNbNsfGqEwJU4BOIxGJ6YN7HqYZdG8W53ifESZpa4ReMl9kALRYYsBGVDpg9V+UQJ3UGYvAsm/vnLYuvgHCvu+TtaiBt007VlGN5SeBPX21wiFBvpKduT64+c4pA0XgbU3j83RcJpuiIEGG92kL1zqkG4K3767PeW4IO1YN3i84EYPShQPnN4ODOC6ELen/X9vkbl9YwqS478+ClGRMSqKgBTSBpjVvkHX4zzJGbinXTQWMozTPMiFY2GM1Pf+DlGA7S8MMLPbVxOHbrxo66llKjCJRBNg6dtrjG2bzThZg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=vivo.com; dmarc=pass action=none header.from=vivo.com; dkim=pass header.d=vivo.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vivo.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bEl7paveOHylyyRXGVKtozPBzrcu8xkDidxcynB+u1Q=; b=Fv/Upo97xxwZfcJg9/oeU1OyEKf7gEV26hSI0fFmiveAeEM+JJM4FRH9SM3UNzUtp/2Uj0ryC5L7KdAwvorUedqNgw9zLkQ3KWKc3IJO4lzYM7xFjryn4Iw/08gg4yPW5m6An9vZPA8vb3WiYx6kshx4afrsPc+JEbSAns4zosdhp4YscVMb7zW4TKQN2wi1tCKF1HSj0krQ+hKbr5bmm76d59UqKppFtYgqAPz2zLGwUFiil8hcenryz/7R6tWFE9ZCyJkiMwXf3FANze8IwFVxeLSwyv2Jtuz3SuVjzWl6QQLZGc4V34Cv3XI0Cu1Ae3beAgatprZ7STiHB6wWRg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=vivo.com; Received: from PUZPR06MB5676.apcprd06.prod.outlook.com (2603:1096:301:f8::10) by SG2PR06MB5359.apcprd06.prod.outlook.com (2603:1096:4:1d7::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7918.24; Tue, 3 Sep 2024 08:41:39 +0000 Received: from PUZPR06MB5676.apcprd06.prod.outlook.com ([fe80::a00b:f422:ac44:636f]) by PUZPR06MB5676.apcprd06.prod.outlook.com ([fe80::a00b:f422:ac44:636f%6]) with mapi id 15.20.7918.024; Tue, 3 Sep 2024 08:41:39 +0000 From: Huan Yang To: vivek.kasireddy@intel.com, Sumit Semwal , =?utf-8?q?Christian_K=C3=B6nig?= , Gerd Hoffmann , linux-media@vger.kernel.org, dri-devel@lists.freedesktop.org, linaro-mm-sig@lists.linaro.org, linux-kernel@vger.kernel.org Cc: opensource.kernel@vivo.com, Huan Yang Subject: [PATCH v5 1/7] udmabuf: pre-fault when first page fault Date: Tue, 3 Sep 2024 16:38:06 +0800 Message-ID: <20240903083818.3071759-2-link@vivo.com> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20240903083818.3071759-1-link@vivo.com> References: <20240903083818.3071759-1-link@vivo.com> X-ClientProxiedBy: SI1PR02CA0026.apcprd02.prod.outlook.com (2603:1096:4:1f4::11) To PUZPR06MB5676.apcprd06.prod.outlook.com (2603:1096:301:f8::10) Precedence: bulk X-Mailing-List: linux-media@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PUZPR06MB5676:EE_|SG2PR06MB5359:EE_ X-MS-Office365-Filtering-Correlation-Id: 70e5a525-5a94-4afe-000e-08dccbf43a70 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|1800799024|52116014|376014|38350700014; X-Microsoft-Antispam-Message-Info: n0bbmmjkjKt4uVm/XCez0FN/heKCMx0xc+JjlaHzB6/DrqsP3B4uHnOzrPieOZMu+dm/X7/MfNYWA+LuAuKU1pusLoalZOYivwf/w6Fpre8NBKMx5ruuGLQ1KTWCTDecNBeimKFjmJLYAELIRHZ1UjOs9CiB8bAucBE7OYEO6IM5yH/2Q/HXxkonAYMZTZ5/8CtlCopSjw6wQK1DszJLgxEukJ5WUJV7Da5yGnM5uZVRSvD44h4P1JdEHX/KLEVAUSj4FEkp6pu2g7QHLwjcr+95yEdkV48Dq5fUpyUAvk/A6fv7seug9kXLOMl9yu9RKgE34y04zWUyMgFTTCRh7cJtJ7pVIV9bNCSgDFb4n1/hfVZdgk3gKh5NQeqaQuX9epFRQQQOGIeITCUWLs123T+wJfjxL9B2YHHsrYd6L3dk1HqkpzTeUEv6QgkQ+6a0/F+P15ivXPnYevUmrJnhR3fkQmsN+lfwBfNzb4TA7pXiVGwYnZCjn5cftepsLuS1G5Dlg0684WMeOI6PYVk6v3hIfkXOnu2B4K+M7M29CBixWR73QZ8UGbsS0s+nMKl8VKnAMPYCs85lcq+8jCG7XHAr9bADJqeZCcCnB28B1zqwwU7wMrQ+8jHOXJgvk2GpqYNHP4E4K3ubqnm+axJoxmRUL+QVI+ljfCpZSF79pihv800s8a7WLhJdN/PO9VXUutWMo7KD0qLE0GiijsVqNoM6n49JD7WJ/ZW/FCtODmCrt6T/o1XXgM0gpT7hOWPcR3O0KNCJO2WTucGufIdsQ1n1e464VGZgUe4sxYpo8+NmoWHDNnfQtjHT+Gjxnr8F6SKQTKe1Ex44L+3rAI7XDjFqcaymrAjCc13RXi2uAlttnWRYEtgVQYBWxzhH0Qk6y6HnHi+kzA+RaensqhV/tXFi7iD4tc3FXuUJADMmR3bah+e6OfkyiU+aEK9vECv7OWMRv+2VADa5E5gkgeEsTA+BY055FlvkhZZy4vMCWiZl7Juc+Ex6ZpzZtaCqaf65aB8H1khkKX6Ov7hpD2un9gnRGbHf3Vb6GOBpWgCoB4HirdXh8FN0sbH8B/J3QV38UDFemskhR3hGU+ttNd2Be433K5tHk7o4nGzTNniYy01FdO+eFgNAZsbokjQ+x6V556U68vmhz3DnlIGdKEkDAwyuOsvZVfSqb6WophitY4WzpAnXSqUzsXsxSANHnDgWkhJ1JWV3N9UpN0M99kCVVpnLfsuxmcvuTrLrotPsgfbUOs/Wl0coR+i6tN37EfE3OB5tGzaQgw0GpU6wZh0TrHSBMYUuGleoqu9r9BOassauvK0Wji8U8XTSJd2dhR28VE+J72qkfEejIjWnDXIquF3za07ODtPZ3WRoYNjuDCf7eNTOJz5H4sYoc8zvSR36F6LZ3J6UGx0TB+P3vjqcRg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PUZPR06MB5676.apcprd06.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(1800799024)(52116014)(376014)(38350700014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: /FjlB/p7g7cEDaiVo6iRrh7piPy6QMGpL3o1N//x1MiHckANIDwj/KRShFWB9UlfVH6IKYzKxuQY2dMkMZ9uM3CXgXHjDjPHsgKLh+jlcLOBAFO0S+FWXnR+YhTQv5c+pN5e+xNx0r0V6a+/V854c+EP8H/3ydlmyWmaGzZgkWiGcTO+LtNLE8ddp5tg6PBx6L7inHqLW7Z7HXoWU4s785eaPHzDdNwLKHDMbkS49XCAp9y/QbV+F8B2+7T4d3GXZ/hjkMnRNeu1Vn3GvMEiSPRuisNtMKOjTUJZm76RmiDMpTV+i6ufSBTSEfsIpngOMSISQsw3xWGyf3+nJ8H27GSMhGOQ2TtCM3QoY2xHnybeJGx3e6THpIoi5Jwhxxm75S9zKxhbbE9nkBOQ2dypGQIN5YmiQpaaFabSpiQAj2G7UtpJlAJoZNfzZIYv/Jm/Ge4F4pekURLOu0JmEfyX5KOSnwEfkwHFceqiZFgM/E7lhWi9Udgwx2IkNruG48osmHEDihLgxV3fp13Yyli74HW0MdVyXor+aix38TrVir2E2iQxGPk5KhqjTDoqO3ifYOHd3P7ghNEWNS+BPqwuXcXgN1gluf8r2rO4ftkTHukThtyVvVCM9JSxQd6wJnzwcHKGiyRTrUKuGAWdGxfhGhFJXbQnol+YezCvGnUaBbSDXLH+Es04onBaUc4FX2fT4P+nXm2s0WCYam0oJB9+XZYInA3lfhr6wU72P9FHrjqbnCw+PT7sYMWApB/8Wu/FKjSWjqkrmoAYEbYw1SWs+gE+JgKfsIEVf89SVMUUfha1CDYij451f+BC05B7EOrE8X3lSZFd2GtNd7othV5o+xw7ZJTT60hNyOEeSdTjncTc6II7sd0nhjrtEpW4sCthh/NeBnft/Kn0ucO2lxYizAU5+EkqMOjaFXiLzUI1+0nbGwY6y4PA64PlFW8VMeH7vSQfEKI5/v89c9Q3q08rzqjIrny5daNnVvFV+0IolCAaxJh6geSSXqzcznYPilxuz3LOotWNxa1HYzatVyg18W3RPzW1Rd7RSk/lUtS23+29xbja/2sfVwNcx0bcceGWhvnkewMoqbZTUwQ0mtjQHFHsb6vGzSGSOY5Zuc61fRKl9iJ7ek1QZ5pwJHTElwnguMhdR6zCQeAlh+3Aiuoa9f4SxAIsBCquthnm2Urw6bay21KHsWBC1Lhwq1tMarwex0mFwqtCKWXtN8CGyHXaSCXPh7sCf6M53H5NgLlTixoU8kF4MVjC24ZBOr0SpdEeKpwKeEfzlYn9mxRbq91MevXqm4KmkfODFnVve7SPV6KMrCmtpO9pzlJE1pOjOzZ7Dzs+udUkKT6WzF32AMaX6osZMZFrhzfAe1oix7CuPpjKPWyPyVp5Cc+i6WlnRKiGAcIm25l3ZxKvRAFC/K4gNxKU0skuBBI/Y94qd0u3MsUl9jBw9mSKagGIJmTG+Yl9sk/5O+vt/inYJdhzcNBOjd4OcEDSBFm0dEtArt1v17vHy0GmfEvuX+R5SM9pvaJg84i3dJ5Y7J0i/0rKzzSyS7yw8jFO8XdZBS1AhSVlj95arzl9enF0d/J0ENXnlBXA X-OriginatorOrg: vivo.com X-MS-Exchange-CrossTenant-Network-Message-Id: 70e5a525-5a94-4afe-000e-08dccbf43a70 X-MS-Exchange-CrossTenant-AuthSource: PUZPR06MB5676.apcprd06.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 Sep 2024 08:41:39.4418 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 923e42dc-48d5-4cbe-b582-1a797a6412ed X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: HB1RjU6gXPuOyOclPsR25n9UHFNZwnzI/YocektBUbcXEcbGhldYC5C3PuniuW5pi2OTVMqmHNl2fXu2N52rdg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2PR06MB5359 The current udmabuf mmap uses a page fault to populate the vma. However, the current udmabuf has already obtained and pinned the folio upon completion of the creation.This means that the physical memory has already been acquired, rather than being accessed dynamically. As a result, the page fault has lost its purpose as a demanding page. Due to the fact that page fault requires trapping into kernel mode and filling in when accessing the corresponding virtual address in mmap, when creating a large size udmabuf, this represents a considerable overhead. This patch first the pfn into page table, and then pre-fault each pfn into vma, when first access. Should know, if anything wrong when pre-fault, will not report it's error, else, report when task access it at the first time. Suggested-by: Vivek Kasireddy Signed-off-by: Huan Yang Acked-by: Vivek Kasireddy --- drivers/dma-buf/udmabuf.c | 35 +++++++++++++++++++++++++++++++++-- 1 file changed, 33 insertions(+), 2 deletions(-) diff --git a/drivers/dma-buf/udmabuf.c b/drivers/dma-buf/udmabuf.c index 047c3cd2ceff..0a8c231a36e1 100644 --- a/drivers/dma-buf/udmabuf.c +++ b/drivers/dma-buf/udmabuf.c @@ -43,7 +43,8 @@ static vm_fault_t udmabuf_vm_fault(struct vm_fault *vmf) struct vm_area_struct *vma = vmf->vma; struct udmabuf *ubuf = vma->vm_private_data; pgoff_t pgoff = vmf->pgoff; - unsigned long pfn; + unsigned long addr, end, pfn; + vm_fault_t ret; if (pgoff >= ubuf->pagecount) return VM_FAULT_SIGBUS; @@ -51,7 +52,37 @@ static vm_fault_t udmabuf_vm_fault(struct vm_fault *vmf) pfn = folio_pfn(ubuf->folios[pgoff]); pfn += ubuf->offsets[pgoff] >> PAGE_SHIFT; - return vmf_insert_pfn(vma, vmf->address, pfn); + ret = vmf_insert_pfn(vma, vmf->address, pfn); + if (ret & VM_FAULT_ERROR) + return ret; + + /* pre fault */ + pgoff = vma->vm_pgoff; + end = vma->vm_end; + addr = vma->vm_start; + + for (; addr < end; pgoff++, addr += PAGE_SIZE) { + if (addr == vmf->address) + continue; + + if (WARN_ON(pgoff >= ubuf->pagecount)) + break; + + pfn = folio_pfn(ubuf->folios[pgoff]); + + pfn += ubuf->offsets[pgoff] >> PAGE_SHIFT; + + /** + * If something wrong, due to this vm fault success, + * do not report in here, report only when true access + * this addr. + * So, don't update ret here, just break. + */ + if (vmf_insert_pfn(vma, addr, pfn) & VM_FAULT_ERROR) + break; + } + + return ret; } static const struct vm_operations_struct udmabuf_vm_ops = {