From patchwork Thu Jul 4 16:37:24 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Martin Oliveira X-Patchwork-Id: 13724008 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 53096C30653 for ; Thu, 4 Jul 2024 16:39:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E03786B008C; Thu, 4 Jul 2024 12:39:22 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DB4016B0092; Thu, 4 Jul 2024 12:39:22 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C2C8D6B0093; Thu, 4 Jul 2024 12:39:22 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 9F59E6B008C for ; Thu, 4 Jul 2024 12:39:22 -0400 (EDT) Received: from smtpin02.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 52F58A18C6 for ; Thu, 4 Jul 2024 16:39:22 +0000 (UTC) X-FDA: 82302630564.02.37F8FAC Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2105.outbound.protection.outlook.com [40.107.236.105]) by imf14.hostedemail.com (Postfix) with ESMTP id 8A102100017 for ; Thu, 4 Jul 2024 16:39:19 +0000 (UTC) Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=eideticcom.onmicrosoft.com header.s=selector2-eideticcom-onmicrosoft-com header.b=ao5uGO4B; spf=pass (imf14.hostedemail.com: domain of Martin.Oliveira@eideticom.com designates 40.107.236.105 as permitted sender) smtp.mailfrom=Martin.Oliveira@eideticom.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=none ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1720111146; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=YueMmbvCvTSA1MKV+udXlu2nutuaCG4yOb4CpEEFNc0=; b=DLB8izHcnUTxiQUv6ZEHJzEXUzEW87I9W30+CyIUaRY/44Ko36a8myzCjaEiRvR9DKr41E HaIUeiqYsOQpbMTr8tlEK2eeN0Pd0Ndhc5Dcem/C94S9QbjdooOFGfIyTjlkv73W2ecBXC nfaYpQiR9Xcm9E1VQRghQuXwRM+fZmc= ARC-Authentication-Results: i=2; imf14.hostedemail.com; dkim=pass header.d=eideticcom.onmicrosoft.com header.s=selector2-eideticcom-onmicrosoft-com header.b=ao5uGO4B; spf=pass (imf14.hostedemail.com: domain of Martin.Oliveira@eideticom.com designates 40.107.236.105 as permitted sender) smtp.mailfrom=Martin.Oliveira@eideticom.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=none ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1720111146; a=rsa-sha256; cv=pass; b=fQY9hjBMVqiQHfp1sh8MPMlxHn1t8oiuDlR/SG9n0+uxdINL5hJAz87uf3BAfi19MJ6qFo 6P7bEwYiksHICq9LL3PvhYgqlrN0Ox/SkDbO6yHY1TEjlUg4hF71aCsyB7sB+3LI0O8tY3 +v+vjWIV3/UMfFuzyIcrTKFHwSdpp0c= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NssNFLK76PWVM8nRhYfj98qgVcJwUN0Z0kLLF3Nib9UBGU5kS/x6t3KxY/DJzr9iZbOUMF2aC+O2PwOhOz89swGOjvO6oIRVytbdErjp1kiTzJ7nmWhe/n0+tD2MhQyVcT39Khur+1HRpISTChIkOBmobkrffhloEAiQla0NXyV5ln+aiYof82SRaI1qfMmmPHhFAOg2drA2OEfoXGZ7z6hvAGHL2vjB6CIuy5TLs0EnlFa9ke2klQfiqJSj4187vS1/7PQoZjcveA6lJV9hx2gDRijTIbO1tW+ankSj+Y5jq3VNGexEY6KbqtoepwGWTRrw7QjT+k7hWN1564q1jw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=YueMmbvCvTSA1MKV+udXlu2nutuaCG4yOb4CpEEFNc0=; b=WKmeA+GMx7yTMbGvUrDt15a2Cfws5E8ACHuWZ869DUYvRIFOJthxWVOgSbmeJAyBFXouE/+3c8c3diMW2CVu78bQXp31J3AIUIaPwiXrMiaHu6rSMlh8989Ex+RZT39Sm4ckfTs9GNW83/ZiDYwR5sF4Mk4KJhEWT+7iigUiBgPi4e0uz7uWBDAFMvShvdknuJ4fKdZpB2lYu1GwYYYNbAn3lzja0TpFu1+ptvO0X9oeLJwVPnq5Pz8yL1OAUy63j9vvbaBv/HvWLo4yWIOEifruuetyzrRm61lGaNPUB+jyqJbeE0SZq5TSCJNfM8cI1RZs2zQ96hQuhlYJItrnDA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=eideticom.com; dmarc=pass action=none header.from=eideticom.com; dkim=pass header.d=eideticom.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eideticcom.onmicrosoft.com; s=selector2-eideticcom-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=YueMmbvCvTSA1MKV+udXlu2nutuaCG4yOb4CpEEFNc0=; b=ao5uGO4B1MVpMILxKMNbYBN6GzyAmPjGCSnplrCTjFWIHvDxBJmup+tkA7nnLxDo/LCIk2ekA7GGT1n6e9l7odt3GXMLVoTGZMN4sj4IQKn+mo/25xXgyJkEqhQANpjK/eB3TAQAwnlBpPqXiFUZ4UZAeYhpEP+xu67nh8hrWkw= Received: from MW3PR19MB4250.namprd19.prod.outlook.com (2603:10b6:303:46::16) by CH0PR19MB7850.namprd19.prod.outlook.com (2603:10b6:610:189::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7719.29; Thu, 4 Jul 2024 16:37:52 +0000 Received: from MW3PR19MB4250.namprd19.prod.outlook.com ([fe80::3280:d8d:de43:6376]) by MW3PR19MB4250.namprd19.prod.outlook.com ([fe80::3280:d8d:de43:6376%5]) with mapi id 15.20.7741.029; Thu, 4 Jul 2024 16:37:52 +0000 From: Martin Oliveira To: linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-rdma@vger.kernel.org Cc: Andrew Morton , Artemy Kovalyov , Greg Kroah-Hartman , Jason Gunthorpe , Leon Romanovsky , Logan Gunthorpe , Martin Oliveira , Michael Guralnik , Mike Marciniszyn , Shiraz Saleem , Tejun Heo , John Hubbard , Dan Williams , David Sloan , Jason Gunthorpe Subject: [PATCH v3 3/3] RDMA/umem: add support for P2P RDMA Date: Thu, 4 Jul 2024 10:37:24 -0600 Message-Id: <20240704163724.2462161-4-martin.oliveira@eideticom.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240704163724.2462161-1-martin.oliveira@eideticom.com> References: <20240704163724.2462161-1-martin.oliveira@eideticom.com> X-ClientProxiedBy: MW4PR03CA0078.namprd03.prod.outlook.com (2603:10b6:303:b6::23) To MW3PR19MB4250.namprd19.prod.outlook.com (2603:10b6:303:46::16) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: MW3PR19MB4250:EE_|CH0PR19MB7850:EE_ X-MS-Office365-Filtering-Correlation-Id: e5de9dfb-cf45-4925-6519-08dc9c47a5cf X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|52116014|366016|7416014|376014|1800799024|38350700014; X-Microsoft-Antispam-Message-Info: T46nsiwx1A7Y1lTFHcrR+KB5C95vi+7pEF/KvWB+habevjHSET3dlp43hu6joXokqmbZAFgqqso34+hbMpl/QQqt/4LCxJiR1XK/h5yH/3KvA5PogVImG9GwO0Qy5bgExmxxwBCCUx6JW4h8SEPy8hK6IdDKAOHymjoJhnbvlK640Ga3AwbSxwRC8Ljhm5wJoTNc36NnqcexmkpqN3G7LECO6RG+9XhTOZ5YOdsY1wZXYh8kMR4jFws6cKOKQ5Q/4MiKVLb+SDjAB5EdfhPT+ZbpiRNUuu8DYBM4gbMXlfaRYAU39fVb3CjbUDk5GwIlLGOo5xVwDWnfLLZCCJJ3YAb2gn7auei+r0+3j3zcZg6mA19vb/l080sg8p3o2/sSr9imVugg3qfFeMWOAMMIAoQVmKdPiDmDYopCk4xcSFt6ELSfGrqNhGirAZyRaHeFTlo/nE/gxpwpR0bIOd6UNmSTZb5QR8jwOyvMRuDvaAHxgGxi9KDgOLRKGpF1ziCLO9mbBnIJwZowi/GkB5jaiTSBF6gqbLc1CF4TpDz6QhFZvDldbIIfw/pmh0ZVUMSNkeU0YZPtnvCGO0sVISBipizq26W3JDVhWZ8Cj2nDp6awxF065ujbvk57A0NSeUnGfZlPO74vOpOLozw4qQC/hoEXx/8u2Sx8J6eTb8+dBKNLJ70OvUgj8gm9npAME28tCdCZEwWKjSqgsSOWDAkoq2dPAYlNZvipMUc5jSbrhNrCtLPO9aYo79T8HUtxsqq1tRsRvrdNqoOBiElCLQW6NIOPYvOhg0r356zBuNKq2VOgY8b47V9AyfWYXcO/NZ8otD+U14D7VqjsSSBsvI0e2jI8Phd/n3SQIej1aqe1XT7OPUUD4+GD+uVCkhBeH0GAFXy/6MH2Uu5abprUkV7LMDuHIQ2Ga4cywWJ4Wlcll4Xk+4wvzEazoWPVJfzPt0m4oz/ct/068VQZ7POLyf7NmO69I28+0Cbr0uVbdznbix7+E0YvXDqgtOq6jufmaVNWf4KxBsItMGtxjChAfrKm9kOrvG0manLvsS+E8PlU+k6p+3HkDvk8M42wlE4hThpjdFYBeJfeOGmicDrkAP5H+S4ZypSPtYJP8ME9lJ1/6tyv02mFdoRckqEyH2EMSkXYAo9LVlqytngKFyJ8yJ4pDi66ptvOoYprn23g0TvINLtushMx2j+1siXUonroewggFS4D4Cn05r4KmMJheMLf10iZ/6FTpb2i0QrBGuf+iklw2dp4PsUx0VKKeraZ6x5lIj2dd4Ff3j86XN5H6EQUL5Qt5j2sEzr3y3P/XfpSD2BSdEXjG0UahJvEEyBkZFSmW1uTthLUY4L/X2YW35hG6LIJ9jyryzkL/Neua6Ji6yfPDNprDxnUYVZK8VrGFBJstD8EErxUnkdN24TjJEJeDQ== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MW3PR19MB4250.namprd19.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(52116014)(366016)(7416014)(376014)(1800799024)(38350700014);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: iYV9ErrjxIeQIOsHo/0csBdP7EmNTFTsUWPXryGmIRAXUkrjpTXY/RXWNGS0lZ1v4YGgu14NqjFvDIrqNpfZ9N6GkUwA2pb1nS3eYDZ19n318evOVZUDBWQTlvJcjETUaA/+8/JmKbiMjg1HdUWSi2ytUIzSiSUjSGp2XuS9w/WjGsaWmFPEMEXijPSYXYA6WsR2G7IChTZqbrn4n60dpLrv+HOa7Q8IsUy9VoA0pT574LLpmJ++5t/M1ehzsJ/6D50O6+bj+o/B/a7R55+jKREp8o4zrkPkpM9RQqHDD6HbbHc4HQEaS9I/icPnYKwWvnUoCSmFuudWrSFrQxhPyx5i8VNKCFb8I9pZZwYtMNP3sxyoC9pTc0RMCK8YnNPLsnDKZ88/YQNykbJSUEnnDpKsvDwT5C8QgPYRVwJcOEb/0nW8+p3bDW5+mioMTfOEKawbFLZKXwc/O+PI50uWeoMCYAVDzvoD01dHbJudn1hnygccrz+3hnNCpTzkcrjWX/3YE7an2l2Oyu6ViF/OvOUepgt/DwU7bsgd6OPxjTwi7HQciTqpbvICRkwJua8tzPY4QC79iPTV/diCGJnWUQV46qa0tHKhallCyGeC91HAuJG8gPR6SySAiNDNtrYrV5uvSFqmrxxfOzKwVsourkdW89gJAO/oSnjtRmENN4on/upWe58KiPqcEwQ3nyIAzK0gyfPaIDv2VpTmD66OqIXk5EuZ8qKh0C4C1c6t/o1opGM1HlRqEe5fwR3PxPXXM8y9vq+UGNLiSHLtuWXnjp5ww/9oDBlsk1RambUrp3jlB0OJj2Fl4V3I+rqt/zaA7B/mTcBDfIKRVZHDGTuEF8fqpfxBqoByyC2HRXC4iA2qBWUbQk1/GiA/9AiEw1viUXtAhApoD0DwQzP5BZ7m2DBREuZKRSdX8ZnY+R6nD3XcRXolpAcJLsWw9qLOXG38qlHiP+oOR7V9j1vT5g7UH4Jlw34iTOsX3BMLmd3p01Ew95JjsXTuFoLDqImRiyOe23wH9dUicjYhf736AtV38ttglHnmVodRcKOoRPAMQyfuMfscRhq/Ht0h+tHvkyxvNjDlj9leWzyi2oiPNjevqKdW8VzRL/u1PXCmvG55Z9B4mivue4bJQIHGsjPwqj0h+lyXZzvZQcr587Sq/NIwiXzSxIcJmjyGc91vLtV7Dt1fxpei2v+sADJh0VQQSXaI5h1MmVk68SCw3wE2flSLS33b5YFveGxiPRRScQsre8DmRHAfFXtuYNdGVW6wrmxbgtB9Tp9aOMhx8f92FS6C+0/+zLDbBTYzgAy0BODH2gqETfvZ31drBFqxTNVSGiFgGwGrE9ApPWkcuo0Wj9EBqLHwlhmlwBx15U3LiMb8xAsDKrAdGUIcp6nEv4poylYQHbma2CZyWXgwahkLV3GpPLjJf1G6mD/XwcSdPWmufacj1ajv1HRTBt0HFlHtdPvE9TTwnfqNFmzxMJfxiRp1GpWC7khVZtM8lIbg9Fk9FX7yIaVwSOfqi/+b4cwYq8hLKyXK7ull66q6GiCVXSYTgRh+budvZHkmd2NPKGC7zSdUAhOrI0vO8/q1FE7D0iIoP0cN9EqLgCDh/c6O7ByYvQ== X-OriginatorOrg: eideticom.com X-MS-Exchange-CrossTenant-Network-Message-Id: e5de9dfb-cf45-4925-6519-08dc9c47a5cf X-MS-Exchange-CrossTenant-AuthSource: MW3PR19MB4250.namprd19.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Jul 2024 16:37:51.9383 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3490cd4b-0360-4377-abb1-15f8c5af8fc2 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: t+csYIwx7YAmDc0SyasvTCBKH5jlY56NwjLs78GcE8GogcFcGy10XcmUwRRa9efwo17qA1jb+inwu8TKWqw4AeO4JVyYpg8oKWzAioeQk4Q= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR19MB7850 X-Rspamd-Server: rspam11 X-Rspamd-Queue-Id: 8A102100017 X-Stat-Signature: s56fx9dzbb9nosf67xqem43r38wq3nxz X-Rspam-User: X-HE-Tag: 1720111159-586672 X-HE-Meta: U2FsdGVkX1/biaD+sUnM7/CC7u54voxrS3Bu+MypIq3/u5IUUWCL0LXpXj1dmz/+e3GPonozv48IGdI2KCuW65MNhvvXalawpxsFQd+bkzBd9f9VwgipQ68O1ZJ9kkH6/9d/OdS+WGVIIDT5AtM06+2VjJB9vi/fXUeIFHEOpIHjeP04Tb7XOdEtAN84aoYAqAehiXlqbjcuvNppFaMcrIeqpwqSt1Vi5xMbAapPuR+MHvcG7d7PSPE1uE3mbi1ucR2QRE8CRmsyLTY5GnU38ZmJN2YvudYMZEny02/GKBeDKIgUr76F4p5EUjOPO0O7BSgi59iYDEvZg7vwgy1KL+42N/SuoCWFb+J0GNAoKa//1lDoIgExrpXfIgH7tFGVzrT1wMAy40P60HolqUBxYX3aZ2gaKLOmb69bGMf2yCA2SQgsc3p9r2gk6jR8ZVUKoMVbnbGX+y0pWB3PJ6Vft6Tcq6KnY0Tegc6k2CQdY1824mfiYYEjo0eqKnQ0W3eEAbPjbjhBHCimMQBV/U8a2aBWTfKXeRaJLd1lo+a3O/lbFTf9Oe6dZrSHuXPD90nHyPUltXpMHe5Fe85whNMhb87CFvZ1RTGT3zey1Y+EekvducwsJE42SP9bz/57xj8h4WBjgKPakLjt6T+fh/nV+jjdGTFMhfygtGXHD9iXgVyWduzY4W8eoHVyA46eGASHZAN+fcgddxChVT2gIR+xQPDIv4k6RjmxsE4/uIcv8XscvC2vEV+glqJ4pWvT2zxhEYiHxtDL8spgnxw4dlkz+gi8q0dHZEbvADUWktb/6SQ3CViltCSJuLgUDkHYorMFQgJVMPYnfh2PAL9max+MSv/hbjGCYnMJt9XZsq6VOvJ5IoqezY8fb3Ogil/fZYhhg/bQTTn6B3pZRGYh+ucd+JuiL4mN0VcrMiuBXAjipjO/89gAiEI+marG6g1z5kylhZnz6niBRQMtzXRjK7B uNVqsHNv JjNtBrRT70+88W2MIasuGFFZGOlZJpi3f182VzDhaPn2ks8q32mEMdHmUCnSZmp92g49BHz+YHHlXsa+T0dB0pc4LVUcOJ8lyp5bsrBx0C8n4LOVxkwlTZARwLktl/MEf7Jtxs7X3GmfVgC83qGKNJIXgBkEcZaknfFwi0BLb5gpevtWN4oLFCi1r83mH40NFA1xHuXibEAoMR0ueSjf0UjMGh6/W+5btkgEuHfP6oGIeeOjAW2pyqGtb7nszPK9diLf67SvvP2Hooc/nFTaff1P7Lz8vOwPM2jx54ekXofHIZsFSI0gFiVJY4MNBOpDSlfX7D2/oHcL0awVOleV2keW0yH+zmRFSORTqF4hHVz0T5ni6nN+E2+Dx8QaieRXG0lg+0Y5f0UGlir7G4aJxGmSzPtg2cLiYQALB1J5XQEsQIlxMET8V3lyoSxK5OU54g7r1 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: If the device supports P2PDMA, add the FOLL_PCI_P2PDMA flag This allows ibv_reg_mr() and friends to use P2PDMA memory that has been mmaped into userspace for MRs in IB and RDMA transactions. Co-developed-by: Logan Gunthorpe Signed-off-by: Logan Gunthorpe Signed-off-by: Martin Oliveira Acked-by: Jason Gunthorpe --- drivers/infiniband/core/umem.c | 3 +++ 1 file changed, 3 insertions(+) diff --git a/drivers/infiniband/core/umem.c b/drivers/infiniband/core/umem.c index 07c571c7b699..b59bb6e1475e 100644 --- a/drivers/infiniband/core/umem.c +++ b/drivers/infiniband/core/umem.c @@ -208,6 +208,9 @@ struct ib_umem *ib_umem_get(struct ib_device *device, unsigned long addr, if (umem->writable) gup_flags |= FOLL_WRITE; + if (ib_dma_pci_p2p_dma_supported(device)) + gup_flags |= FOLL_PCI_P2PDMA; + while (npages) { cond_resched(); pinned = pin_user_pages_fast(cur_base,