From patchwork Thu Jan 26 16:21:15 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Aurelien Aptel X-Patchwork-Id: 13117422 X-Patchwork-Delegate: kuba@kernel.org Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4FA03C54E94 for ; Thu, 26 Jan 2023 16:22:24 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232664AbjAZQWW (ORCPT ); Thu, 26 Jan 2023 11:22:22 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:58136 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232660AbjAZQWS (ORCPT ); Thu, 26 Jan 2023 11:22:18 -0500 Received: from NAM04-BN8-obe.outbound.protection.outlook.com (mail-bn8nam04on2080.outbound.protection.outlook.com [40.107.100.80]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 719CF360A0 for ; Thu, 26 Jan 2023 08:22:13 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RXO6aUR/bBj7C4BLL5H+D7xDBVJwbdqhW8+tBg/OWo5xtSZy3GpmA2kws+5YeXQ7AiBWpb8+ElyLv6dUuGcLx/+es1+BYmTpq6BNQZdxtR57j+39lyYm3GOCjyrEPD4el5WDMACaawKF9JclERBDA3B4hB5CpJVt0ZNr+T53TeD3raM2r4/8vxawFBb7b7dAN22ymkPxBnYDLMIqfBh425e/UOswoyAXxUI9FxjLqzPSmOLpQVC8MuQd0oUF6iIuCdD3FJWHvawwkkiNuVljpa03x85cMbKVTBlA+Kz564jX7XRhgnJH2xZFa3JTgfyRGp63fW8ZhC1TxaDFbJqXaQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=VhBgPUr6NhBchARfJJusmljB/iUDGmqHRoK2+5/OBmo=; b=Gy3Le6WaRewrwqzj3xFhufP2zUvJ4E2WjjSU7bywIt1f8C9RjV/rjKEKoQRvnH7mX4m9ViH21SsCfu8GLpDncNDk05poIjJGwoYi7XoR3WFc8CYHrT7qqLv5+3AA92f8DtJh9bJC8eXDf/Fq5jkKfcRxnYCrhmBXzDPKK0pCiS0W7W6+UXVH4KuzrdT1NPs4Zv9yYTvQzwlqYpp31PtCrLaLuDIZSzZLZ5duy8qNI2rSE3XGgFc6CpBc3ZoIsTNAXVOCv2xn+6aD1bc/sFlg4EVfXt6wCKR3R5+lh5ONqJdwnC04VnOOqXzZf47o3UDAtXNQ4nSEQ0mq0WYgIidadQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=VhBgPUr6NhBchARfJJusmljB/iUDGmqHRoK2+5/OBmo=; b=FsKjtYOh3uprv4OBhXuzm+cSLSW2ngdYC9TYP5vo18iL8s5BJ3uVFGPIdQ/qs5Z2F25O78R3z+vjPXcKYZGCgQ4fs/qUMujT7W3DdHQHgZ0ERY47DVxVASZlmc2sVonOx/qeGLcT0uj67C2TTNxdeNv1oCd7ZnohKc/nC3JuzUw9Ub6flmFVo7qR9/RttiqcWAujqCb8XIjHvbiou3neKXbgbOnXbSMDqy6nH+4nesDB7G9gzkszhJKD1mVR7XqS0MNccyKBYGROQCxxilzomQBUOF41Ml/OZ5btl9c+qHrdLscsvsBhsKxUmPuuLck/hO8hiOkBQ8mB69sPdWwFYA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from SJ1PR12MB6075.namprd12.prod.outlook.com (2603:10b6:a03:45e::8) by SJ0PR12MB5422.namprd12.prod.outlook.com (2603:10b6:a03:3ac::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6043.22; Thu, 26 Jan 2023 16:22:11 +0000 Received: from SJ1PR12MB6075.namprd12.prod.outlook.com ([fe80::9fd9:dadc:4d8a:2d84]) by SJ1PR12MB6075.namprd12.prod.outlook.com ([fe80::9fd9:dadc:4d8a:2d84%6]) with mapi id 15.20.6043.022; Thu, 26 Jan 2023 16:22:11 +0000 From: Aurelien Aptel To: linux-nvme@lists.infradead.org, netdev@vger.kernel.org, sagi@grimberg.me, hch@lst.de, kbusch@kernel.org, axboe@fb.com, chaitanyak@nvidia.com, davem@davemloft.net, kuba@kernel.org Cc: Aurelien Aptel , aurelien.aptel@gmail.com, smalin@nvidia.com, malin1024@gmail.com, ogerlitz@nvidia.com, yorayz@nvidia.com, borisp@nvidia.com Subject: [PATCH v10 04/25] Documentation: document netlink ULP_DDP_GET/SET messages Date: Thu, 26 Jan 2023 18:21:15 +0200 Message-Id: <20230126162136.13003-5-aaptel@nvidia.com> X-Mailer: git-send-email 2.31.1 In-Reply-To: <20230126162136.13003-1-aaptel@nvidia.com> References: <20230126162136.13003-1-aaptel@nvidia.com> X-ClientProxiedBy: LO2P265CA0047.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:61::35) To SJ1PR12MB6075.namprd12.prod.outlook.com (2603:10b6:a03:45e::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ1PR12MB6075:EE_|SJ0PR12MB5422:EE_ X-MS-Office365-Filtering-Correlation-Id: ce76556f-be73-48ac-8731-08daffb97a87 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: UYYXYZzykXHJf+SZSNZogXAnIqLvO4cSdoay2hl+qo+d3gUFlTO9kZXmjJfVPpil1LvfoJ841QUtXAz4SFKLEwTpnNa5kFskPm4yorNu9uAO2TqZK3VSbGD5AS5uRoObmCBlYrD02+4GgRDHdKe1NVwM+Bi5DWyHgXeisEbLtivEIM/zNl+nde0bn+YeKH/i/q0REnMoCp8RDb2/EPqCkjKRjd3h2KRFwSTUmNq71fkhlWndPHW77uUfS3C/nXDx+JH8SOoPDc/HZBiMkCJUAVQjASIkHQURqxUSlgurUfQZMlHuM00PSGk6jK+hQFBxCM8R+5+I6nCAitsbKGI+ln6BUN4bOoniOT7wtRenTfdGAT2xW7pqRaO6T4e9bj6LDEyeBPby8bAv8kPUSaVkorAh+pM68wi47s5HmzqjtJIFYOrYpmUBOMUyt3EfgUfE9EDURopHuQegIG2bJQ/WtYzbFPRz9+aOwfU4hYStLysJBL28DNOXxgOQXCaMbL95qFILEitlFURfFgc3y1ndlgDTLFOfkAwEOQaJxBKJdorVUJTNdcaj5qLfTV/+ib80s4TLaOUerBnkasETq9mdQ/NmONH6jYkqzOI2ZTHr2rFVD+YKSY6glaqgyg1kJeWElRfQi9oE71XG4suJLqd6mw== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SJ1PR12MB6075.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230025)(4636009)(346002)(376002)(39860400002)(136003)(396003)(366004)(451199018)(316002)(38100700002)(41300700001)(15650500001)(8676002)(66556008)(66946007)(66476007)(4326008)(5660300002)(7416002)(36756003)(86362001)(8936002)(2906002)(6506007)(1076003)(26005)(6512007)(186003)(478600001)(6486002)(83380400001)(107886003)(2616005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: tBpmlHN4xCLXuPByCMD6WdjCqGA+0sDW3RJjHZ3mUHulIVYlEdtrcgWpqsk6FASAeC1L34S4GXd6bg06lePxVFmnMS9raeYMkFbHOLVYs3gizb9uVH+Nwocc8G+wXerZlZwEXPlIXDEZQNGZB5jRhH8vDruTzT3BcLxXjpQMnxOWCh4OPNM5orTthVAvVjBrgjBXAVnQcLZi7kHQJJidrdlETniyR1DzxgPM6tCUB7Fnotyl+XKLl16smSo0gHL5/tcmtKY7aJNxLxDAOtqAWel+aUlwwDB5Dc7MD34RnnoiioxiNk8bCfP6mBoz/P9+p9wQvxmFAiRajERrqMvJ9kkzM4L1Pp/pnF/0K+D74M9yTvHQ8Yod5RIXYMvTU/OATPxnL0tiG2+qsfAsPZPcBFNLgIXWTh+B2WV1ruI01CdgLZTk7pkBOzwWLfPzqrdG3KdMxH0/i1k2BDhZhpluOVPANv+m7r8Y4wm4DJNs22oK87PfpyFRL0TVnZHKuZvy1N7QKhaM3M+k3byMPcpFXR/hxw5tylknYTvGeX2wUaZ49kkyMSOTC0OhSQPPxWjhySPRMqPOwbjXo3skYGW9TDa1SehITTPyrFF9Hr9d5NgLu4F9nfEb6dY2agCaxruXAJlCfnP5/mzWmgMZ/At6N85qVyW77JqMqh8gh9qEHw8Y8azv6JgW2r1og9i9L4wB8L7Vq86yLHL/u11hUO88VQ4XznlhlMDE+KPRf1CLEaoG5lRK29/0VvIOyG6IvzDCtsXwg5kkAlz8wlIV7B3GGg3Nke6IbhyRcSJJnG3rNNcXTxqWaO5qHsnRgC9SiqKv3Edfw/OaRwbaPSchwEUgkMe4byd5ekVkoQlwEP9wVdm7KtU7Au9ZwGk3cX69QP+FPO8RgbTLsSe9zxdYmxBGr4y3FSsP6AY4yBdmxMTw6cdjo5ATSEHn1rTcwJAV+x+jMs9q+l6E5rPsIk0ynVRqiVnnlsCyOxK+JLQDFRkYIfOZyofF++isyTYKLLX5dOh82c+sGFEanbdh55EEJProSlNKNRGCg4G3KNYfjzyQRpna6ulIoMPWYedzDIxzgCQPT3X/N2xlltgRKh99N16Ab9Zcd4mtwOa1cPZp8KRiu/PWNVFzYIrWQGg7EKG0cXm1SIaG9hfyLJWgws/a/zZ30HnlTOT3wMJjd0T8PvsinRa5xyKUHr6S60xwIY+BK4It1QHtLHhg390Zuf/D/zo14dmyoCj1JVFPzEAhvJXpWprIldzdqvpuO8SJRoXXt3vFjTmFe/SxIVb0/97PtIJHWzaYufjPTPqQnijQsTN/MosENyIvDJhhzo+1/D8xc/0PEzTeS76tQvE1QlxE+fU7rcFNAWAZotQc6is0foc1W9qiOnjGUDkdmp/gdkmIMvEQQokmIQqRoyaW/YRfbsDITimkyzrrBBXh6g6xZXKDFX6+fJKMTOR6FV8QE08uWHDp9KD7DpA8Bmt/LKFZFzaBAFswVL5YTYNzrdGiK4IJ4QGRijlc4SW6oRj83heCf1/uSap9fTOfVRhPv0bRk+6fFi4yfX9VQwPx7wko9QPIiHXjsIzi1Yndxc3kSPTgQI7e X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: ce76556f-be73-48ac-8731-08daffb97a87 X-MS-Exchange-CrossTenant-AuthSource: SJ1PR12MB6075.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Jan 2023 16:22:11.7643 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: O1hafs8NBGkT+mwIY1R//B5/FJRRrKpf4qRaQWigOoyG5ojEXhGyNBI1ARJd3i1jvsoX/u15A56paN9/QauhAw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR12MB5422 Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org X-Patchwork-Delegate: kuba@kernel.org Add detailed documentation about: - ETHTOOL_MSG_ULP_DDP_GET and ETHTOOL_MSG_ULP_DDP_SET netlink messages - ETH_SS_ULP_DDP_CAPS and ETH_SS_ULP_DDP_STATS stringsets ETHTOOL_MSG_ULP_DDP_GET/SET messages are used to configure ULP DDP capabilities and retrieve ULP DDP statistics. Both statistics and capabilities names can be retrieved dynamically from the kernel via string sets (no need to hardcode them and keep them in sync in ethtool). Signed-off-by: Shai Malin Signed-off-by: Aurelien Aptel --- Documentation/networking/ethtool-netlink.rst | 91 ++++++++++++++++++++ Documentation/networking/statistics.rst | 1 + 2 files changed, 92 insertions(+) diff --git a/Documentation/networking/ethtool-netlink.rst b/Documentation/networking/ethtool-netlink.rst index 1626e863eec9..11120697911e 100644 --- a/Documentation/networking/ethtool-netlink.rst +++ b/Documentation/networking/ethtool-netlink.rst @@ -225,6 +225,8 @@ Userspace to kernel: ``ETHTOOL_MSG_RSS_GET`` get RSS settings ``ETHTOOL_MSG_MM_GET`` get MAC merge layer state ``ETHTOOL_MSG_MM_SET`` set MAC merge layer parameters + ``ETHTOOL_MSG_ULP_DDP_GET`` get ULP DDP capabilities and stats + ``ETHTOOL_MSG_ULP_DDP_SET`` set ULP DDP capabilities ===================================== ================================= Kernel to userspace: @@ -268,6 +270,8 @@ Kernel to userspace: ``ETHTOOL_MSG_PSE_GET_REPLY`` PSE parameters ``ETHTOOL_MSG_RSS_GET_REPLY`` RSS settings ``ETHTOOL_MSG_MM_GET_REPLY`` MAC merge layer status + ``ETHTOOL_MSG_ULP_DDP_GET_REPLY`` ULP DDP capabilities and stats + ``ETHTOOL_MSG_ULP_DDP_SET_REPLY`` optional reply to ULP_DDP_SET ======================================== ================================= ``GET`` requests are sent by userspace applications to retrieve device @@ -1973,6 +1977,93 @@ The attributes are propagated to the driver through the following structure: .. kernel-doc:: include/linux/ethtool.h :identifiers: ethtool_mm_cfg +ULP_DDP_GET +=========== + +Get ULP DDP capabilities for the interface and optional driver-defined stats. + +Request contents: + + ==================================== ====== ========================== + ``ETHTOOL_A_ULP_DDP_HEADER`` nested request header + ==================================== ====== ========================== + +Kernel response contents: + + ==================================== ====== ========================== + ``ETHTOOL_A_ULP_DDP_HEADER`` nested reply header + ``ETHTOOL_A_ULP_DDP_HW`` bitset dev->ulp_ddp_caps.hw + ``ETHTOOL_A_ULP_DDP_ACTIVE`` bitset dev->ulp_ddp_caps.active + ``ETHTOOL_A_ULP_DDP_STATS`` nested ULP DDP statistics + ==================================== ====== ========================== + + +* If ``ETHTOOL_FLAG_COMPACT_BITSETS`` was set in + ``ETHTOOL_A_HEADER_FLAG``, the bitsets of the reply are in compact + form. In that form, the names for the individual bits can be retrieved + via the ``ETH_SS_ULP_DDP_CAPS`` string set. +* ``ETHTOOL_A_ULP_DDP_STATS`` contains statistics which + are only reported if ``ETHTOOL_FLAG_STATS`` was set in + ``ETHTOOL_A_HEADER_FLAGS``. + +ULP DDP statistics content: + + ===================================================== === =============== + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_SK_ADD`` u64 sockets successfully prepared for offloading + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_SK_ADD_FAIL`` u64 sockets that failed to be prepared for offloading + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_SK_DEL`` u64 sockets where offloading has been removed + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_DDP_SETUP`` u64 PDUs successfully prepared for Direct Data Placement + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_DDP_SETUP_FAIL`` u64 PDUs that failed DDP preparation + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_DDP_TEARDOWN`` u64 PDUs done with DDP + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_DROP`` u64 PDUs dropped + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_RESYNC`` u64 resync + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_PACKETS`` u64 offloaded PDUs + ``ETHTOOL_A_ULP_DDP_STATS_RX_NVMEOTCP_BYTES`` u64 offloaded bytes + ===================================================== === =============== + +The names of each statistics are global. They can be retrieved via the +``ETH_SS_ULP_DDP_STATS`` string set. + +ULP_DDP_SET +=========== + +Request to set ULP DDP capabilities for the interface. + +Request contents: + + ==================================== ====== ========================== + ``ETHTOOL_A_ULP_DDP_HEADER`` nested request header + ``ETHTOOL_A_ULP_DDP_WANTED`` bitset requested capabilities + ==================================== ====== ========================== + +Kernel response contents: + + ==================================== ====== ========================== + ``ETHTOOL_A_ULP_DDP_HEADER`` nested reply header + ``ETHTOOL_A_ULP_DDP_WANTED`` bitset diff wanted vs. results + ``ETHTOOL_A_ULP_DDP_ACTIVE`` bitset diff old vs. new active + ==================================== ====== ========================== + +Request contains only one bitset which can be either value/mask pair +(request to change specific capabilities and leave the rest) or only a +value (request to set the complete capabilities provided literally). + +Requests are subject to sanity checks by drivers so an optional kernel +reply (can be suppressed by ``ETHTOOL_FLAG_OMIT_REPLY`` flag in +request header) informs client about the actual +results. + +* ``ETHTOOL_A_ULP_DDP_WANTED`` reports the difference between client + request and actual result: mask consists of bits which differ between + requested capability and result (dev->ulp_ddp_caps.active after the + operation), value consists of values of these bits in the request + (i.e. negated values from resulting capabilities). +* ``ETHTOOL_A_ULP_DDP_ACTIVE`` reports the difference between old and + new dev->ulp_ddp_caps.active: mask consists of bits which have + changed, values are their values in new dev->ulp_ddp_caps.active + (after the operation). + + Request translation =================== diff --git a/Documentation/networking/statistics.rst b/Documentation/networking/statistics.rst index 551b3cc29a41..9997c5e8d34e 100644 --- a/Documentation/networking/statistics.rst +++ b/Documentation/networking/statistics.rst @@ -172,6 +172,7 @@ statistics are supported in the following commands: - `ETHTOOL_MSG_PAUSE_GET` - `ETHTOOL_MSG_FEC_GET` - `ETHTOOL_MSG_MM_GET` + - `ETHTOOL_MSG_ULP_DDP_GET` debugfs -------