From patchwork Fri Aug 23 03:10:54 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jianbo Liu X-Patchwork-Id: 13774526 X-Patchwork-Delegate: kuba@kernel.org Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2087.outbound.protection.outlook.com [40.107.92.87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F1CE779C2 for ; Fri, 23 Aug 2024 03:11:22 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.92.87 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1724382684; cv=fail; b=k6hmwSUNqihHlp0kR1B4FqMJiJIO0QHPAI3fjnmgis02ioHZnWbk02aKitsHDJQPpFbgec/qaa1rwV7HXQ3xLozkTAvgO8/hSFLNy423sYR9IBaOvLn8iDi7pzQJ4z9UeuVR/JAOARFHfdBC6wLKHR1YuNrClbdwOF7ZDnSJrLk= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1724382684; c=relaxed/simple; bh=f79C9oDzFpjwrRYexsLQKbROlUZMeIzKjH5Lin56JTg=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=ozopyfzbUwnBxMqKyobAKx3bqmCcpkyj+mmusT34tOM379VGtsTxWZWy7dih7HqiWBpCaPTAbnfaVydAOUTsHG9QA+kqMZFB9hvHmOmJoomGEI1WTBcqgD3XGmm0UGMTrw30E8Yez5sCPJxuzYIiWgjC0A4mWacnjcCyHmpnBpU= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=QL89FLGp; arc=fail smtp.client-ip=40.107.92.87 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="QL89FLGp" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=sqATBsOxS14LxrUqeEbK4os+h+ZN/qBapyw5gf0gLEBZ5xkDkvdTEBR6Agurtt2BfNUZKd5VG1YfpeihLtUlL8dkyzuk0vVl9pSV0uTOs59mzTcmgqX9ZaflSGPscuVHWXctVazYF1IbxeZyxjiV1OcvfPOKBw0arfUbV8ZQunz870A+nCZc6ibisLLep5Pjb6BwbtusATaYPMFYn2nn5WwRw4C5LnSjZMnR1GUh/WtjKAyh2auyW3Lq3pkdMFcu86V188Hulxey7SR2F914ly+DY8ApCE9KlGtOUhg1uCbN9iwiVQ3I/ak/qk7sI0ldqm2etmKX9MzuyHITamvkFQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=H7d08GM5/URHa8M8uJdlew0gJhovW/gva1B4nFNmtiU=; b=C0SgFsCmOhtyzeTU4TJw0VvmLd2Bvry/+mSGB5idz/aG9hFBEK5jOj8oXKGeVo84qniD/rM3X2kU1j54dJcATWKdmKBM+2vFDfeFW8yULgYa+VjiroL93wDNpKjtHzLOfOdfAvQlNBGFZzt83LtNibkVX6cVKH+v44m2pwXkDOCwPbj9BGWR6CRP/EjTb5jHVwpUocH2tQmwRUh6ZpwQzzaNlJcUSi/62IDTlHHaC63NCpdLh6KxCJDwzpdi6wKZq83UDJoEqEC1fZYfRlnZb10evH453jMqtPFFDowGPx4MiDsuO+MCSoq3w87aCn9SI1uuf5hNyix8Ev6MZHTq+A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.118.233) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=H7d08GM5/URHa8M8uJdlew0gJhovW/gva1B4nFNmtiU=; b=QL89FLGpz9oErqjmyCRxdCPJC6z0J5MmvDUvs+5/rvVz5sgigvmSpWw4JoJRCEVczxbsrQMEuMp6TGmZjrfE3dmLVZEB6vTQKP4ZMPn/1wl5UX7Lufd/OPjN1JjGBIPrOxcC1G5Ke48lV7XxrLnwT6jfnorghhgrAASNwCABMuXk6vIl2FrM1Qkfj5FtRQdMTLcGox9hw0HHicQqKyrRiNXoO/upoiERJx0OZyDjsE2uJPh27oIpmOscY4fCti+2REYepH6jZIfJ2TnJtRwTw8i6TZbhrjdZSZiCKLIF+GDni1ELuzqrAVQxeIE1riiTXTI5zFPMA3raKFsjrtgvpQ== Received: from SJ0PR13CA0112.namprd13.prod.outlook.com (2603:10b6:a03:2c5::27) by DM4PR12MB5818.namprd12.prod.outlook.com (2603:10b6:8:62::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.18; Fri, 23 Aug 2024 03:11:18 +0000 Received: from SJ5PEPF000001D4.namprd05.prod.outlook.com (2603:10b6:a03:2c5:cafe::ab) by SJ0PR13CA0112.outlook.office365.com (2603:10b6:a03:2c5::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.19 via Frontend Transport; Fri, 23 Aug 2024 03:11:18 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.118.233) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.118.233 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.118.233; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.118.233) by SJ5PEPF000001D4.mail.protection.outlook.com (10.167.242.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.11 via Frontend Transport; Fri, 23 Aug 2024 03:11:18 +0000 Received: from drhqmail202.nvidia.com (10.126.190.181) by mail.nvidia.com (10.127.129.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 22 Aug 2024 20:11:14 -0700 Received: from drhqmail202.nvidia.com (10.126.190.181) by drhqmail202.nvidia.com (10.126.190.181) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 22 Aug 2024 20:11:14 -0700 Received: from mtl-vdi-603.wap.labs.mlnx (10.127.8.13) by mail.nvidia.com (10.126.190.181) with Microsoft SMTP Server id 15.2.1544.4 via Frontend Transport; Thu, 22 Aug 2024 20:11:11 -0700 From: Jianbo Liu To: , , , , , , CC: , , , , , Jianbo Liu Subject: [PATCH net V6 1/3] bonding: implement xdo_dev_state_free and call it after deletion Date: Fri, 23 Aug 2024 06:10:54 +0300 Message-ID: <20240823031056.110999-2-jianbol@nvidia.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20240823031056.110999-1-jianbol@nvidia.com> References: <20240823031056.110999-1-jianbol@nvidia.com> Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001D4:EE_|DM4PR12MB5818:EE_ X-MS-Office365-Filtering-Correlation-Id: 23fb639e-cfb2-4e3f-9050-08dcc32141c5 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|36860700013|1800799024|376014; X-Microsoft-Antispam-Message-Info: Chmvr/dtJVEO5Y+lhhvsx88KUEgOqecWXh5An3V67wYO/CWM99A1XCDXcfODg/AqDMYXmct8QpLAHyaz+uK5ZT9bdh4LEEpGx3PlcjnMTHRShy5ca0W9BhEFBguiyv+j7TjMWmqyjaDdBsCqb558/ZGkx3816xxcx3vN1nPrnVp6cGx1B4YfpmPSr6nsd9gnA8FKvJ2p/L6kRHsJ8U3tZD/RZ7KBo1J67HtsA30I89JWRJBaS5Cu4xzJP9phZzif4DmZJ2zRMD9RzzJsLnpcPOh/vkm7rKLr90JZgaY/bJGsqR2QSMUJtiE7c1aAol5MOj14Pu+IQwuxl4Xe6i1O1Cwot9Dlznw2vxbNG3SHtUJmHDcrjNkFbzOf5J0jq54OJi63MraeRzSpJrNbF7AR2SUcnL7sLKXAiabpw5C/FaszJtj/XMunQxUPLlSHiwzg/JCsZI5FnPbqTdIgHxIeytsGCtXGcKCipIgJJZ83deaN4o2Cfmy8Hk+6GIY24+z1LWi01teBL9eQc023aDYZpnEf1aIZ9D+a+Asju6sI3QMuXIBBtUZcD6XqqhXT6ge7SJApDyPMsTml8EGELMxS9Z5mg+NTpm2Yv/L6vEvzW5e/4fHST9d7KDbqy0JkxJLKq57ib5NGYrHDX5PC7SfWTfG9YBuFuOJftEy8imEcR6wF8Tmtj0jBxjFPLzPqqvLnUezUDtQHAhNJ6YAanIwpBHXuK7Y2xJc+vvXCKUGA3mVkHnf25gscHwmilm7czgElqp4TUs4748qakJLtBMPMfjWMwkgvidVLp8rPX1tuSXvEvCvBj13I+GBKrGdteNLa72/LeSiQqhV+KJETwOEiGXE/+kAJ88T6M/L2lp9hdP9g6cX3aAFXFUNrGaIbFkqe5GuP5z9xLKsx8rdjV+/qUjMQGmWo4OxqLlnYDE6tnsyAumhZRG8kCkQpYriceaR9Wc6WwRyw0LIuZx2l4OtNDWWacO9Clhq9dVoA0u93hS+zNIWs/GfV0Dk4/znMEdKb6ntw5ldNGg5wDzo9BQVGJGss71fy37D3bMOOK9JMOkNYaIuimaP6OXjg0QYEu/ffQVMC+cyADwXLmBZNoWPFUgMcOlUUO9jXMsD0PPwCDbM9rjDv/ogZ3x0bE2Y+odneB0n//zWjcONOaIp29UTFj8vdO3HrD4FDTNiYmCXNPxMXxKx1WSr7n0eWN/gGv92kzrs/W+jDBymNaxk9FaJydhcp1T+5DBl/C+rdN/kz8U5FeC1vNWM5ix226ytzOHnmFlpxzb2mxBFBZT/3xiNY+8rwMz0u/L7Z/qoSjCYKcWdiKUnDWxk3Lvzyfi8vxrno9gRyZukHZDSPK/LfZS7cyBUiKqKNEoSct9n+NHQzPAKG6ups3WZjGeVNE2etnDealw55R23Ms+JlEXhNpDSKLQCsRGFA8eNyAgZgglk6xICJx1Oj47KYEotRXKHjiFRU X-Forefront-Antispam-Report: CIP:216.228.118.233;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc7edge2.nvidia.com;CAT:NONE;SFS:(13230040)(82310400026)(36860700013)(1800799024)(376014);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Aug 2024 03:11:18.4415 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 23fb639e-cfb2-4e3f-9050-08dcc32141c5 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.118.233];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001D4.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB5818 X-Patchwork-Delegate: kuba@kernel.org Add this implementation for bonding, so hardware resources can be freed from the active slave after xfrm state is deleted. The netdev used to invoke xdo_dev_state_free callback, is saved in the xfrm state (xs->xso.real_dev), which is also the bond's active slave. To prevent it from being freed, acquire netdev reference before leaving RCU read-side critical section, and release it after callback is done. And call it when deleting all SAs from old active real interface while switching current active slave. Fixes: 9a5605505d9c ("bonding: Add struct bond_ipesc to manage SA") Signed-off-by: Jianbo Liu Signed-off-by: Tariq Toukan Reviewed-by: Hangbin Liu --- drivers/net/bonding/bond_main.c | 36 +++++++++++++++++++++++++++++++++ 1 file changed, 36 insertions(+) diff --git a/drivers/net/bonding/bond_main.c b/drivers/net/bonding/bond_main.c index f74bacf071fc..2b4b7ad9cd2d 100644 --- a/drivers/net/bonding/bond_main.c +++ b/drivers/net/bonding/bond_main.c @@ -581,12 +581,47 @@ static void bond_ipsec_del_sa_all(struct bonding *bond) __func__); } else { slave->dev->xfrmdev_ops->xdo_dev_state_delete(ipsec->xs); + if (slave->dev->xfrmdev_ops->xdo_dev_state_free) + slave->dev->xfrmdev_ops->xdo_dev_state_free(ipsec->xs); } } spin_unlock_bh(&bond->ipsec_lock); rcu_read_unlock(); } +static void bond_ipsec_free_sa(struct xfrm_state *xs) +{ + struct net_device *bond_dev = xs->xso.dev; + struct net_device *real_dev; + netdevice_tracker tracker; + struct bonding *bond; + struct slave *slave; + + if (!bond_dev) + return; + + rcu_read_lock(); + bond = netdev_priv(bond_dev); + slave = rcu_dereference(bond->curr_active_slave); + real_dev = slave ? slave->dev : NULL; + netdev_hold(real_dev, &tracker, GFP_ATOMIC); + rcu_read_unlock(); + + if (!slave) + goto out; + + if (!xs->xso.real_dev) + goto out; + + WARN_ON(xs->xso.real_dev != real_dev); + + if (real_dev && real_dev->xfrmdev_ops && + real_dev->xfrmdev_ops->xdo_dev_state_free) + real_dev->xfrmdev_ops->xdo_dev_state_free(xs); +out: + netdev_put(real_dev, &tracker); +} + /** * bond_ipsec_offload_ok - can this packet use the xfrm hw offload * @skb: current data packet @@ -627,6 +662,7 @@ static bool bond_ipsec_offload_ok(struct sk_buff *skb, struct xfrm_state *xs) static const struct xfrmdev_ops bond_xfrmdev_ops = { .xdo_dev_state_add = bond_ipsec_add_sa, .xdo_dev_state_delete = bond_ipsec_del_sa, + .xdo_dev_state_free = bond_ipsec_free_sa, .xdo_dev_offload_ok = bond_ipsec_offload_ok, }; #endif /* CONFIG_XFRM_OFFLOAD */ From patchwork Fri Aug 23 03:10:55 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jianbo Liu X-Patchwork-Id: 13774528 X-Patchwork-Delegate: kuba@kernel.org Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2056.outbound.protection.outlook.com [40.107.243.56]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 6E0EC364AE for ; Fri, 23 Aug 2024 03:11:30 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.243.56 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1724382692; cv=fail; b=RgTRNceV9LKyhMx+ULPl7mhTfn2xwWli2Lk+Ms9NHy/RrrRyHgxtVLLzaA59T4o5V8unepNi4KKDRfZEsdtKuWRe98Zj1Cq+hnKa6NxNpvhPXwitXqnaRCm95v8xuzm+yUexmrRxmthcWo2k2fQi2g7XA8dG0mq6tJWwtOcOkM8= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1724382692; c=relaxed/simple; bh=wfDBumN18Pr31KATDLFlAUc9OOxaFtbQm0dnjmPalP4=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=KJn1UvegeU+t7SbimuflMpQtzYx+FoVA+DTnOUB+6axb4qZhDvaz2AAlN8NIXi0IDV8pTkOrr3apzamblE9bMm1LZzfycqm9A1T4sFktypZXReeizYnh7nxvfpk02qXrrWmFShFz5DBZ8AdkBzwkwkevzvcVvEuvvsLV/r0mOhs= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=ur9URQvP; arc=fail smtp.client-ip=40.107.243.56 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="ur9URQvP" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=jbr445wYLTrJgypgmt3FgEtMuJGgGU9QJV3pqv0+apeSdpq0DY1aSK4UiAvKTHltp7PWEGjn9P8BoIuRi5aPkjulgEzZdFYWgA/lgAaK64Kvmi5sO6AUF/N6YVCzIsjLjHIwhgDwDXgsp6cOiLIm6Hc5SLGRWloK8nqxQqzzlOAMeZU5INFsbCPfhvwoSP7+nBKVXAFjcrtXVPxznR+vsWSi+zuObuLqAH85LIjk2L6n0XPXZOEvyVkjIyt7CC7ER2/v0ddITe3d7cg+ogDg7269uGGsfCrOc6fDbzniZat7Ti6VHlcGqafp8skVREal+xBJUNWuLUk3t/6Sy75yEA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=U7OnddbHJC6ePBbqzqzC8qsiWp/LYNbe8fb79oPz/94=; b=mr+YBk4JJf3+fIC25E/u1Xt42YBihtwJcwPNArJbBI0PrIS3nW1URfbFXQVIKXmYv9YQe0+s3HLOCk1q47fsu2a8fwvUdtpFFVA4E16gBEI6NHOlfIm21g+gESdA+22nme2xTiZwjweHNxTBfZZBTsiPN3yobu+ieaCQKj4eIg80Rc6haqsiW6orMlazSzxqAkn8b87sBvJuKRCwZwHcNrhBwAKpUnToKxG0AE5v8IHbA6NX98EgbzyQyJe+1Oa9zpqvbU68T+9DOkbqcjKK46EWd8gZmg5XVlCGkS9co8CYGOCmeEZYvHGXdTwlkPJfhU6eVtlmcqV8zw4c0cXyEg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.118.233) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=U7OnddbHJC6ePBbqzqzC8qsiWp/LYNbe8fb79oPz/94=; b=ur9URQvP4TvDPN7aZ4bbBnleXCUy9hLsaGYoresSnIyfP1XajY2v+wLGbMrX8MIDzlVOFtTGk6KAJg3iu0fsF+vxHgA4uswfsYktmgKrJYhOtfa1XXEgpf1SqqSe/oRVsh2saFSEjGWICGb/sVTKKNXc1JRnECNzV49tDa0D5SfNrbKa0QKthBoDrezuElPDDOoaD/fuSrFu2Sl97dw2TjZWxrgqN1qEiuwiGwQTxvkRNSd18Vz3KC98HOGuyF/x+/IGaIP03mI6JcdiNtRTIFMedqVr6xprrEd8ACG9kvNVhVDhNlYnoix6AMDenXfI7t2TIwDZVcAYFrgwNqosBw== Received: from SJ0PR13CA0105.namprd13.prod.outlook.com (2603:10b6:a03:2c5::20) by CY8PR12MB7492.namprd12.prod.outlook.com (2603:10b6:930:93::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.16; Fri, 23 Aug 2024 03:11:26 +0000 Received: from SJ5PEPF000001D4.namprd05.prod.outlook.com (2603:10b6:a03:2c5:cafe::a2) by SJ0PR13CA0105.outlook.office365.com (2603:10b6:a03:2c5::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.12 via Frontend Transport; Fri, 23 Aug 2024 03:11:26 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.118.233) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.118.233 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.118.233; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.118.233) by SJ5PEPF000001D4.mail.protection.outlook.com (10.167.242.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.11 via Frontend Transport; Fri, 23 Aug 2024 03:11:26 +0000 Received: from drhqmail202.nvidia.com (10.126.190.181) by mail.nvidia.com (10.127.129.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 22 Aug 2024 20:11:18 -0700 Received: from drhqmail202.nvidia.com (10.126.190.181) by drhqmail202.nvidia.com (10.126.190.181) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 22 Aug 2024 20:11:18 -0700 Received: from mtl-vdi-603.wap.labs.mlnx (10.127.8.13) by mail.nvidia.com (10.126.190.181) with Microsoft SMTP Server id 15.2.1544.4 via Frontend Transport; Thu, 22 Aug 2024 20:11:14 -0700 From: Jianbo Liu To: , , , , , , CC: , , , , , Jianbo Liu , Cosmin Ratiu Subject: [PATCH net V6 2/3] bonding: extract the use of real_device into local variable Date: Fri, 23 Aug 2024 06:10:55 +0300 Message-ID: <20240823031056.110999-3-jianbol@nvidia.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20240823031056.110999-1-jianbol@nvidia.com> References: <20240823031056.110999-1-jianbol@nvidia.com> Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001D4:EE_|CY8PR12MB7492:EE_ X-MS-Office365-Filtering-Correlation-Id: 5d05222b-3431-43c8-ab77-08dcc321468c X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|376014|1800799024|36860700013; X-Microsoft-Antispam-Message-Info: Zw6Yb9XWCysUcOTJFg8T8W4oLBLwK2EIibuMLCz/dsc3M+qsZzlRi7zfCixHdalcQlEdA7EirwOAco6pKD+Qu1eLvc8MwH6ppWlvR8DT2+ucmd/VdsKm0rJldXEC2x0vuyXUqrnBEbXH8Mwu6iB+9zTFpCHNU/T0YmdmDxhvjLa7+uizJsXYqHKgGsH2TpJVRFwfXhVtl2PIPbphBDsRw8aT8QmOucO/kwpdMvAnwgxKwVtMzfkbWatEgbNyXcdzsifIrgCRvY1L1vsy+FKzTAWST5HTpgDaKYI5w+dTdy0omRuYktTzRdgizy+M/ssaZ2jBQPBWZgeBi7yS27kCMDMO+661lL8xGPiEq8cWG1f/fmQAmAFZp6/mXobOEeIsHEnWWScs6d0tRIXypY8susaZ402bm47aVUafWbt0rUfA3nHy6wNIZuXQAqD5APL7iw49rhS6wvoMhRg6vOU13cEz6q24UtirihUyZdetmyw4nzHW25Zu57npB6QC0twO+Y7hg7IMjr/O/bFM8hG6unAMrC73ElJp8pLi6mSRyluu5Q93JSwB6zLrEC4Tc8z/a/gCrpi/CYcuYStCzXx+Q8mkShVAmT9uMkqTzeDIJD0x2Iw5CrG3J/j464LL+8kJmCBp+cgrAiaT9Oyb4/hN8NXod7PGA5CoPSaA/q49HMxghYFq8+fQxtOLIwhM+BYnV0SVhPXUCG5YK624Sy5Y2MS09Iq4x9YyT9nY/w0P7t6sOVYp9HQcp8Gf36bycBrar2mPRue36cYBHTIUuV7S9WO4y+d8cQlF9QyKP5LdecqYw2rBiERY1UBABd6hCDkcB0ue+H5ei/RNxmIBjDcuaxBbD4Vrvz4yUmqdmZMQfUCoQy+WRvUYDFmnYgZmlK6HyAeJvdOb9osgDuHAKCE//HzyKvRvaXv9XPTBINKyzLh3rF/sT5OOAkcX2UuBzZHkV7ycS8gecOAVNnXrPQ8TGOSl0poxcAQ4MmMHaeXWWcZduPxewmnUx+D1uuxdrBDFnUR2FKFPIa6eRE6EK4HGQAw2XGsPz0IFqbMWeVclPOK3G36Zd0FP9MIwbAI4aJ70lbVT0TJ6ewhQUKAIOGrU/xJtv7boL0LzRhmj0cp63fKQ916LlEQvzMGaNAUAbcCnCtTtyboh2Wy8rndtGgUQ6ON3HD2KRCyDRAyC90hfHi/v+c8kJSYf2fHN8ciai1MhpvSpVpcTQteAX0PRVCoSwkwImaDiL2HuEEyp/BD3HcbUP3V9gyEBhtpl7GHOsy1DFBGsjjdSFuonODRuiGh3oavWLlrecovPYZPDJglU+uxdbMz66eipRQsFVD4w1EDFoyezwgc2QfcxMfXPJqTBQZITpVV820WuX39dW+744ed71QGKjj66PFkJj3lX+Id8FeqOVTqVdyvlMLZRwRKomfRxUbxS9PBl4foITa4O6a5bp+vnCuJcWbWd71INP6lY X-Forefront-Antispam-Report: CIP:216.228.118.233;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc7edge2.nvidia.com;CAT:NONE;SFS:(13230040)(82310400026)(376014)(1800799024)(36860700013);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Aug 2024 03:11:26.4572 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 5d05222b-3431-43c8-ab77-08dcc321468c X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.118.233];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001D4.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY8PR12MB7492 X-Patchwork-Delegate: kuba@kernel.org Add a local variable for slave->dev, to prepare for the lock change in the next patch. There is no functionality change. Fixes: 9a5605505d9c ("bonding: Add struct bond_ipesc to manage SA") Signed-off-by: Jianbo Liu Reviewed-by: Cosmin Ratiu Signed-off-by: Tariq Toukan Reviewed-by: Hangbin Liu --- drivers/net/bonding/bond_main.c | 58 +++++++++++++++++++-------------- 1 file changed, 33 insertions(+), 25 deletions(-) diff --git a/drivers/net/bonding/bond_main.c b/drivers/net/bonding/bond_main.c index 2b4b7ad9cd2d..f98491748420 100644 --- a/drivers/net/bonding/bond_main.c +++ b/drivers/net/bonding/bond_main.c @@ -427,6 +427,7 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, struct netlink_ext_ack *extack) { struct net_device *bond_dev = xs->xso.dev; + struct net_device *real_dev; struct bond_ipsec *ipsec; struct bonding *bond; struct slave *slave; @@ -443,9 +444,10 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, return -ENODEV; } - if (!slave->dev->xfrmdev_ops || - !slave->dev->xfrmdev_ops->xdo_dev_state_add || - netif_is_bond_master(slave->dev)) { + real_dev = slave->dev; + if (!real_dev->xfrmdev_ops || + !real_dev->xfrmdev_ops->xdo_dev_state_add || + netif_is_bond_master(real_dev)) { NL_SET_ERR_MSG_MOD(extack, "Slave does not support ipsec offload"); rcu_read_unlock(); return -EINVAL; @@ -456,9 +458,9 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, rcu_read_unlock(); return -ENOMEM; } - xs->xso.real_dev = slave->dev; - err = slave->dev->xfrmdev_ops->xdo_dev_state_add(xs, extack); + xs->xso.real_dev = real_dev; + err = real_dev->xfrmdev_ops->xdo_dev_state_add(xs, extack); if (!err) { ipsec->xs = xs; INIT_LIST_HEAD(&ipsec->list); @@ -475,6 +477,7 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, static void bond_ipsec_add_sa_all(struct bonding *bond) { struct net_device *bond_dev = bond->dev; + struct net_device *real_dev; struct bond_ipsec *ipsec; struct slave *slave; @@ -483,12 +486,13 @@ static void bond_ipsec_add_sa_all(struct bonding *bond) if (!slave) goto out; - if (!slave->dev->xfrmdev_ops || - !slave->dev->xfrmdev_ops->xdo_dev_state_add || - netif_is_bond_master(slave->dev)) { + real_dev = slave->dev; + if (!real_dev->xfrmdev_ops || + !real_dev->xfrmdev_ops->xdo_dev_state_add || + netif_is_bond_master(real_dev)) { spin_lock_bh(&bond->ipsec_lock); if (!list_empty(&bond->ipsec_list)) - slave_warn(bond_dev, slave->dev, + slave_warn(bond_dev, real_dev, "%s: no slave xdo_dev_state_add\n", __func__); spin_unlock_bh(&bond->ipsec_lock); @@ -497,9 +501,9 @@ static void bond_ipsec_add_sa_all(struct bonding *bond) spin_lock_bh(&bond->ipsec_lock); list_for_each_entry(ipsec, &bond->ipsec_list, list) { - ipsec->xs->xso.real_dev = slave->dev; - if (slave->dev->xfrmdev_ops->xdo_dev_state_add(ipsec->xs, NULL)) { - slave_warn(bond_dev, slave->dev, "%s: failed to add SA\n", __func__); + ipsec->xs->xso.real_dev = real_dev; + if (real_dev->xfrmdev_ops->xdo_dev_state_add(ipsec->xs, NULL)) { + slave_warn(bond_dev, real_dev, "%s: failed to add SA\n", __func__); ipsec->xs->xso.real_dev = NULL; } } @@ -515,6 +519,7 @@ static void bond_ipsec_add_sa_all(struct bonding *bond) static void bond_ipsec_del_sa(struct xfrm_state *xs) { struct net_device *bond_dev = xs->xso.dev; + struct net_device *real_dev; struct bond_ipsec *ipsec; struct bonding *bond; struct slave *slave; @@ -532,16 +537,17 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) if (!xs->xso.real_dev) goto out; - WARN_ON(xs->xso.real_dev != slave->dev); + real_dev = slave->dev; + WARN_ON(xs->xso.real_dev != real_dev); - if (!slave->dev->xfrmdev_ops || - !slave->dev->xfrmdev_ops->xdo_dev_state_delete || - netif_is_bond_master(slave->dev)) { - slave_warn(bond_dev, slave->dev, "%s: no slave xdo_dev_state_delete\n", __func__); + if (!real_dev->xfrmdev_ops || + !real_dev->xfrmdev_ops->xdo_dev_state_delete || + netif_is_bond_master(real_dev)) { + slave_warn(bond_dev, real_dev, "%s: no slave xdo_dev_state_delete\n", __func__); goto out; } - slave->dev->xfrmdev_ops->xdo_dev_state_delete(xs); + real_dev->xfrmdev_ops->xdo_dev_state_delete(xs); out: spin_lock_bh(&bond->ipsec_lock); list_for_each_entry(ipsec, &bond->ipsec_list, list) { @@ -558,6 +564,7 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) static void bond_ipsec_del_sa_all(struct bonding *bond) { struct net_device *bond_dev = bond->dev; + struct net_device *real_dev; struct bond_ipsec *ipsec; struct slave *slave; @@ -568,21 +575,22 @@ static void bond_ipsec_del_sa_all(struct bonding *bond) return; } + real_dev = slave->dev; spin_lock_bh(&bond->ipsec_lock); list_for_each_entry(ipsec, &bond->ipsec_list, list) { if (!ipsec->xs->xso.real_dev) continue; - if (!slave->dev->xfrmdev_ops || - !slave->dev->xfrmdev_ops->xdo_dev_state_delete || - netif_is_bond_master(slave->dev)) { - slave_warn(bond_dev, slave->dev, + if (!real_dev->xfrmdev_ops || + !real_dev->xfrmdev_ops->xdo_dev_state_delete || + netif_is_bond_master(real_dev)) { + slave_warn(bond_dev, real_dev, "%s: no slave xdo_dev_state_delete\n", __func__); } else { - slave->dev->xfrmdev_ops->xdo_dev_state_delete(ipsec->xs); - if (slave->dev->xfrmdev_ops->xdo_dev_state_free) - slave->dev->xfrmdev_ops->xdo_dev_state_free(ipsec->xs); + real_dev->xfrmdev_ops->xdo_dev_state_delete(ipsec->xs); + if (real_dev->xfrmdev_ops->xdo_dev_state_free) + real_dev->xfrmdev_ops->xdo_dev_state_free(ipsec->xs); } } spin_unlock_bh(&bond->ipsec_lock); From patchwork Fri Aug 23 03:10:56 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jianbo Liu X-Patchwork-Id: 13774529 X-Patchwork-Delegate: kuba@kernel.org Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2064.outbound.protection.outlook.com [40.107.243.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 78FC3364AE for ; Fri, 23 Aug 2024 03:11:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.243.64 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1724382696; cv=fail; b=RO484nt01t9KzGKL3oplbjqRz51eYwHacUxDwhppZokzpQqsvE29Ti/WT6UJsNK75crqk0Qr/+hxT6fyI6AGKJSd0N+1eRz0XsK7U+om0E1XLqt8+H6OUAg4oi4SYDpuM7mdIQKHbUcfr+NugcnuQ5/l7w9ROAship//AfXyj0s= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1724382696; c=relaxed/simple; bh=LjW6m0xff0Q6t0jvxr8tdbegiRqS7+Qvdsk9vmIXZJc=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=prKrXOwcdUAdpeEQHVt2fD5n376awnEjQvheh2LN6+b/udAupvJfXWZ9JuCvwXjYxE2XaNDDSjo2P2lOM1TFMec1utstRtuECgEB36+mtpPHoNQXQU4Wwz5RxhIR3O82Q6KB26b1wd9vhDEOFNyoPcNrkpmfV2iTkTncUbKJkeM= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=JZa0Wpa0; arc=fail smtp.client-ip=40.107.243.64 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="JZa0Wpa0" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=r8xwDGuj7dAbfhWhQqe2L3oOZu85r967LUw9wLOefp0IzwagCF04X2I33svPVLI6s/b60rEwe6LU4yelQFvwboe7nwNDu94/9mmagDrmbRyejPjwEFZwpxNtJRx0GpuYupAuvoGRA5fSr4vOuSWOUeLVkN6PY8mLdPtk/FAckmSdkIOIVvPTfuFB3VbDylVp98O3G48BL7LFWH5ZMUtyyfg9WBNbWm2giHUXlYBlk/fP6LTY/SqMgDUnAOfbVk5T3XzG0/kOzkfZBLW3IMhTisCX+oGB/tlTpnUwjNsM7ckn4ASzFIoRNwqnBkGSQe51F1g0yziuPZylfoyS6ecZjw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=a/yjKAqdE4Xtu4G9+fEwFj7rEaZi/+iSe5mpRv7GZjs=; b=OsJoogXvjyjhF/XH9arwLCJw+iLnGeUD2lywtAexkgiZKPWjTewv3ME73Uvh7exCcLe0a93ihResCf7xbTnZHDZWR39z4TEMAqjvsbNuctbiyhH3hJaatRmttwwJH1S90YzMuusRvbiiv9P1Omng3wtcDTB1iutvHawVx6bVeJVYlBgpNfgawPA9tbRUxl4a+LhslQyXApkA+Djf/UKCfSaORDN1UyBdsDYUIaM5R+VMn3T9XeAsGhilYbwn6v5lzq1d0W2FY5tGvrAHkq6ZJPPWA5t9NFLe3BueB4IoMYh2naWz6kv8lTSPw9AsVFuP84PFkUW2XEo9657NJN5s/Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.118.233) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=a/yjKAqdE4Xtu4G9+fEwFj7rEaZi/+iSe5mpRv7GZjs=; b=JZa0Wpa0KxuQwl/CJrpj+6tT6vxTx/R2FAdCUKTs82lYH+X589A+B92bN2kzBKEdEefbpvnrb/0R0VYqqLP+MvWIeHA1VGADGY3yV+WuNlTBZ2l71fsb65uXkzOhnAWS+IRmKcJSOwQP9wgy0OE+xIC8lh1LNStnzHIKkoD8ycrFj6LOUAfW0sR6jaWbojaMKzhOuFHnheL/FKSIM41/coTVGfYxJdfLPXpf/jWd7c0zHaFigYT6Ff1pMMdrWdRuuL3za0Zxq9S5zwvF6RUbZieZZAjrzJg+ySIBcoH4/yN9DmnTcrwb7j2F41TZRX5xA9mHzzEvohQLuTWISv7xAw== Received: from SJ0PR13CA0094.namprd13.prod.outlook.com (2603:10b6:a03:2c5::9) by DM4PR12MB6136.namprd12.prod.outlook.com (2603:10b6:8:a9::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7849.22; Fri, 23 Aug 2024 03:11:30 +0000 Received: from SJ5PEPF000001D4.namprd05.prod.outlook.com (2603:10b6:a03:2c5:cafe::d2) by SJ0PR13CA0094.outlook.office365.com (2603:10b6:a03:2c5::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.19 via Frontend Transport; Fri, 23 Aug 2024 03:11:29 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.118.233) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.118.233 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.118.233; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.118.233) by SJ5PEPF000001D4.mail.protection.outlook.com (10.167.242.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.11 via Frontend Transport; Fri, 23 Aug 2024 03:11:29 +0000 Received: from drhqmail201.nvidia.com (10.126.190.180) by mail.nvidia.com (10.127.129.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 22 Aug 2024 20:11:22 -0700 Received: from drhqmail202.nvidia.com (10.126.190.181) by drhqmail201.nvidia.com (10.126.190.180) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 22 Aug 2024 20:11:21 -0700 Received: from mtl-vdi-603.wap.labs.mlnx (10.127.8.13) by mail.nvidia.com (10.126.190.181) with Microsoft SMTP Server id 15.2.1544.4 via Frontend Transport; Thu, 22 Aug 2024 20:11:18 -0700 From: Jianbo Liu To: , , , , , , CC: , , , , , Jianbo Liu Subject: [PATCH net V6 3/3] bonding: change ipsec_lock from spin lock to mutex Date: Fri, 23 Aug 2024 06:10:56 +0300 Message-ID: <20240823031056.110999-4-jianbol@nvidia.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20240823031056.110999-1-jianbol@nvidia.com> References: <20240823031056.110999-1-jianbol@nvidia.com> Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001D4:EE_|DM4PR12MB6136:EE_ X-MS-Office365-Filtering-Correlation-Id: b93282e4-d2b3-4d91-4843-08dcc321486e X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|82310400026|36860700013|1800799024; X-Microsoft-Antispam-Message-Info: 5Gjcg+y87KcB2xnoh1purBEP9ydndh93Zn4rjdg3njyD4+w63/CDPzOL5nSFN62E6NzIhe7HfOu2z8ZNeMzYqsOodgBRpwH89cQ5Rl4XQ8Hc0xR5gkpyzZC73G5vsnJg9BQXZdujhvClMHI2ISs69DhpvssnWLiFpGzU+M4vh6/BK8CMQSyI0yZ5jiY4w1l78RIc1BaTXnEu3SpMZydFImTaKbQ7RHcCE1xm6fqQ31trULIuZxDaRIBJtpfMg19/oQVQsYXAvF4F5kqpmmGkuA88aF9XgLgovHvjIC4fU+ju/uEswZl3tH43PRy5XEJEzEvI80kHeuvqIkjpuuw116+fgcbiejSOkBEPAEYSmqL+TZg4MdOtRElVi7hrpw2BfbK3MP6PL4qEy1PYSPFDUFZsegUQmImZeTfc6i3PynIKu6J6I8t0qyFbDDEZYF664jFsbGyC67SdQJLo8URMnI1fBaQL72L5mPQOzoSEvuFa4KTplKmxkGgXCMS+/Qn7TOhTKEx8J4ZT07A02wZ6c6BP/WociRTVRI2Ux4CRXzGL2oW1FMowzRcTsdlgnJEGkRmnBBGEn8q/l1P8wPlLgyJ/MesrDsyrSxCVWTqTZMBLcvTP21hgQOnfuaLztZmOdLhoDHXoUvIn2UXIyb5S6EZuXrq4tIPdkGrS32foP3bkm9Ewm7jJHd20gIPn69a3Ils5CTXb1Nvk6dUlzSPVwM4t26NdxKcjfKjKMgEIayg2wI1EmFxKxhNdWpnPyvSNKWaTJpRc1XEoGgNcHmG8Pq6HTTpxZuxhUGWtaGETscLyUdZa8g2q4VT7bnEsrtAIUBmupmsSNbO++gsUkloep1QQ9l8TRUCsoF1s04F4B6EBL1HjuMQY3JoIVv1h51M/LEBPr1THATzHmCq11i3W8wwMLEPZQroEc/f1OBGXp9RX5f3/IL6J9DPA/QRjnHxh7CmImyEvpBZNNTEbOSpDR903a76XYJOsSdodevDe8gyHy4QeJOksdyfp9oKpYERWZtkLhpG8t0WbWDNxgT14MMgaoSJ8gB6sDNi2RC/0aJMkmrJDAQtfMA8/1GDt22GdnP7lqIXaNiLsgLu7A5Xdkip2bRWJwkPDM1/9xiUSDLtE0IQWLvdtNk4em2TRNxWZy6lTHRMQuxWTL1s7SmbZq2QahLtbSqKOHUvkH4td3wgzBFgTPUYVE21uA7ldcnoxMdyqpQ6yM/O/7PWH65+hhaxQBAJE7yKYnqRjQrGeE2iXdF3yt6HB1gKZKzJFEmzeBpjMmJLnp6J4HoER+PUA1YD8reYHcgP3W+EMS9YFGpyxZzLC5/lOPQjRB7qsmZj3Gfy3Ebyr0fwBi0I5Ip7FDUWEPafJsGa/MQOdGtret48lCKvklRuItgy9+0iAEAP0yTCkOhQXa0xneli+QwqucsBn/6oOLdBpkylztFmjx3bKgnviubSCSlT9fcpbJ9Yq X-Forefront-Antispam-Report: CIP:216.228.118.233;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc7edge2.nvidia.com;CAT:NONE;SFS:(13230040)(376014)(82310400026)(36860700013)(1800799024);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Aug 2024 03:11:29.6135 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: b93282e4-d2b3-4d91-4843-08dcc321486e X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.118.233];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001D4.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB6136 X-Patchwork-Delegate: kuba@kernel.org In the cited commit, bond->ipsec_lock is added to protect ipsec_list, hence xdo_dev_state_add and xdo_dev_state_delete are called inside this lock. As ipsec_lock is a spin lock and such xfrmdev ops may sleep, "scheduling while atomic" will be triggered when changing bond's active slave. [ 101.055189] BUG: scheduling while atomic: bash/902/0x00000200 [ 101.055726] Modules linked in: [ 101.058211] CPU: 3 PID: 902 Comm: bash Not tainted 6.9.0-rc4+ #1 [ 101.058760] Hardware name: [ 101.059434] Call Trace: [ 101.059436] [ 101.060873] dump_stack_lvl+0x51/0x60 [ 101.061275] __schedule_bug+0x4e/0x60 [ 101.061682] __schedule+0x612/0x7c0 [ 101.062078] ? __mod_timer+0x25c/0x370 [ 101.062486] schedule+0x25/0xd0 [ 101.062845] schedule_timeout+0x77/0xf0 [ 101.063265] ? asm_common_interrupt+0x22/0x40 [ 101.063724] ? __bpf_trace_itimer_state+0x10/0x10 [ 101.064215] __wait_for_common+0x87/0x190 [ 101.064648] ? usleep_range_state+0x90/0x90 [ 101.065091] cmd_exec+0x437/0xb20 [mlx5_core] [ 101.065569] mlx5_cmd_do+0x1e/0x40 [mlx5_core] [ 101.066051] mlx5_cmd_exec+0x18/0x30 [mlx5_core] [ 101.066552] mlx5_crypto_create_dek_key+0xea/0x120 [mlx5_core] [ 101.067163] ? bonding_sysfs_store_option+0x4d/0x80 [bonding] [ 101.067738] ? kmalloc_trace+0x4d/0x350 [ 101.068156] mlx5_ipsec_create_sa_ctx+0x33/0x100 [mlx5_core] [ 101.068747] mlx5e_xfrm_add_state+0x47b/0xaa0 [mlx5_core] [ 101.069312] bond_change_active_slave+0x392/0x900 [bonding] [ 101.069868] bond_option_active_slave_set+0x1c2/0x240 [bonding] [ 101.070454] __bond_opt_set+0xa6/0x430 [bonding] [ 101.070935] __bond_opt_set_notify+0x2f/0x90 [bonding] [ 101.071453] bond_opt_tryset_rtnl+0x72/0xb0 [bonding] [ 101.071965] bonding_sysfs_store_option+0x4d/0x80 [bonding] [ 101.072567] kernfs_fop_write_iter+0x10c/0x1a0 [ 101.073033] vfs_write+0x2d8/0x400 [ 101.073416] ? alloc_fd+0x48/0x180 [ 101.073798] ksys_write+0x5f/0xe0 [ 101.074175] do_syscall_64+0x52/0x110 [ 101.074576] entry_SYSCALL_64_after_hwframe+0x4b/0x53 As bond_ipsec_add_sa_all and bond_ipsec_del_sa_all are only called from bond_change_active_slave, which requires holding the RTNL lock. And bond_ipsec_add_sa and bond_ipsec_del_sa are xfrm state xdo_dev_state_add and xdo_dev_state_delete APIs, which are in user context. So ipsec_lock doesn't have to be spin lock, change it to mutex, and thus the above issue can be resolved. Fixes: 9a5605505d9c ("bonding: Add struct bond_ipesc to manage SA") Signed-off-by: Jianbo Liu Signed-off-by: Tariq Toukan Reviewed-by: Hangbin Liu --- drivers/net/bonding/bond_main.c | 79 ++++++++++++++++++--------------- include/net/bonding.h | 2 +- 2 files changed, 44 insertions(+), 37 deletions(-) diff --git a/drivers/net/bonding/bond_main.c b/drivers/net/bonding/bond_main.c index f98491748420..bb9c3d6ef435 100644 --- a/drivers/net/bonding/bond_main.c +++ b/drivers/net/bonding/bond_main.c @@ -428,6 +428,7 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, { struct net_device *bond_dev = xs->xso.dev; struct net_device *real_dev; + netdevice_tracker tracker; struct bond_ipsec *ipsec; struct bonding *bond; struct slave *slave; @@ -439,24 +440,26 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, rcu_read_lock(); bond = netdev_priv(bond_dev); slave = rcu_dereference(bond->curr_active_slave); - if (!slave) { - rcu_read_unlock(); - return -ENODEV; + real_dev = slave ? slave->dev : NULL; + netdev_hold(real_dev, &tracker, GFP_ATOMIC); + rcu_read_unlock(); + if (!real_dev) { + err = -ENODEV; + goto out; } - real_dev = slave->dev; if (!real_dev->xfrmdev_ops || !real_dev->xfrmdev_ops->xdo_dev_state_add || netif_is_bond_master(real_dev)) { NL_SET_ERR_MSG_MOD(extack, "Slave does not support ipsec offload"); - rcu_read_unlock(); - return -EINVAL; + err = -EINVAL; + goto out; } - ipsec = kmalloc(sizeof(*ipsec), GFP_ATOMIC); + ipsec = kmalloc(sizeof(*ipsec), GFP_KERNEL); if (!ipsec) { - rcu_read_unlock(); - return -ENOMEM; + err = -ENOMEM; + goto out; } xs->xso.real_dev = real_dev; @@ -464,13 +467,14 @@ static int bond_ipsec_add_sa(struct xfrm_state *xs, if (!err) { ipsec->xs = xs; INIT_LIST_HEAD(&ipsec->list); - spin_lock_bh(&bond->ipsec_lock); + mutex_lock(&bond->ipsec_lock); list_add(&ipsec->list, &bond->ipsec_list); - spin_unlock_bh(&bond->ipsec_lock); + mutex_unlock(&bond->ipsec_lock); } else { kfree(ipsec); } - rcu_read_unlock(); +out: + netdev_put(real_dev, &tracker); return err; } @@ -481,35 +485,35 @@ static void bond_ipsec_add_sa_all(struct bonding *bond) struct bond_ipsec *ipsec; struct slave *slave; - rcu_read_lock(); - slave = rcu_dereference(bond->curr_active_slave); - if (!slave) - goto out; + slave = rtnl_dereference(bond->curr_active_slave); + real_dev = slave ? slave->dev : NULL; + if (!real_dev) + return; - real_dev = slave->dev; + mutex_lock(&bond->ipsec_lock); if (!real_dev->xfrmdev_ops || !real_dev->xfrmdev_ops->xdo_dev_state_add || netif_is_bond_master(real_dev)) { - spin_lock_bh(&bond->ipsec_lock); if (!list_empty(&bond->ipsec_list)) slave_warn(bond_dev, real_dev, "%s: no slave xdo_dev_state_add\n", __func__); - spin_unlock_bh(&bond->ipsec_lock); goto out; } - spin_lock_bh(&bond->ipsec_lock); list_for_each_entry(ipsec, &bond->ipsec_list, list) { + /* If new state is added before ipsec_lock acquired */ + if (ipsec->xs->xso.real_dev == real_dev) + continue; + ipsec->xs->xso.real_dev = real_dev; if (real_dev->xfrmdev_ops->xdo_dev_state_add(ipsec->xs, NULL)) { slave_warn(bond_dev, real_dev, "%s: failed to add SA\n", __func__); ipsec->xs->xso.real_dev = NULL; } } - spin_unlock_bh(&bond->ipsec_lock); out: - rcu_read_unlock(); + mutex_unlock(&bond->ipsec_lock); } /** @@ -520,6 +524,7 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) { struct net_device *bond_dev = xs->xso.dev; struct net_device *real_dev; + netdevice_tracker tracker; struct bond_ipsec *ipsec; struct bonding *bond; struct slave *slave; @@ -530,6 +535,9 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) rcu_read_lock(); bond = netdev_priv(bond_dev); slave = rcu_dereference(bond->curr_active_slave); + real_dev = slave ? slave->dev : NULL; + netdev_hold(real_dev, &tracker, GFP_ATOMIC); + rcu_read_unlock(); if (!slave) goto out; @@ -537,7 +545,6 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) if (!xs->xso.real_dev) goto out; - real_dev = slave->dev; WARN_ON(xs->xso.real_dev != real_dev); if (!real_dev->xfrmdev_ops || @@ -549,7 +556,8 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) real_dev->xfrmdev_ops->xdo_dev_state_delete(xs); out: - spin_lock_bh(&bond->ipsec_lock); + netdev_put(real_dev, &tracker); + mutex_lock(&bond->ipsec_lock); list_for_each_entry(ipsec, &bond->ipsec_list, list) { if (ipsec->xs == xs) { list_del(&ipsec->list); @@ -557,8 +565,7 @@ static void bond_ipsec_del_sa(struct xfrm_state *xs) break; } } - spin_unlock_bh(&bond->ipsec_lock); - rcu_read_unlock(); + mutex_unlock(&bond->ipsec_lock); } static void bond_ipsec_del_sa_all(struct bonding *bond) @@ -568,15 +575,12 @@ static void bond_ipsec_del_sa_all(struct bonding *bond) struct bond_ipsec *ipsec; struct slave *slave; - rcu_read_lock(); - slave = rcu_dereference(bond->curr_active_slave); - if (!slave) { - rcu_read_unlock(); + slave = rtnl_dereference(bond->curr_active_slave); + real_dev = slave ? slave->dev : NULL; + if (!real_dev) return; - } - real_dev = slave->dev; - spin_lock_bh(&bond->ipsec_lock); + mutex_lock(&bond->ipsec_lock); list_for_each_entry(ipsec, &bond->ipsec_list, list) { if (!ipsec->xs->xso.real_dev) continue; @@ -593,8 +597,7 @@ static void bond_ipsec_del_sa_all(struct bonding *bond) real_dev->xfrmdev_ops->xdo_dev_state_free(ipsec->xs); } } - spin_unlock_bh(&bond->ipsec_lock); - rcu_read_unlock(); + mutex_unlock(&bond->ipsec_lock); } static void bond_ipsec_free_sa(struct xfrm_state *xs) @@ -5921,7 +5924,7 @@ void bond_setup(struct net_device *bond_dev) /* set up xfrm device ops (only supported in active-backup right now) */ bond_dev->xfrmdev_ops = &bond_xfrmdev_ops; INIT_LIST_HEAD(&bond->ipsec_list); - spin_lock_init(&bond->ipsec_lock); + mutex_init(&bond->ipsec_lock); #endif /* CONFIG_XFRM_OFFLOAD */ /* don't acquire bond device's netif_tx_lock when transmitting */ @@ -5970,6 +5973,10 @@ static void bond_uninit(struct net_device *bond_dev) __bond_release_one(bond_dev, slave->dev, true, true); netdev_info(bond_dev, "Released all slaves\n"); +#ifdef CONFIG_XFRM_OFFLOAD + mutex_destroy(&bond->ipsec_lock); +#endif /* CONFIG_XFRM_OFFLOAD */ + bond_set_slave_arr(bond, NULL, NULL); list_del_rcu(&bond->bond_list); diff --git a/include/net/bonding.h b/include/net/bonding.h index b61fb1aa3a56..8bb5f016969f 100644 --- a/include/net/bonding.h +++ b/include/net/bonding.h @@ -260,7 +260,7 @@ struct bonding { #ifdef CONFIG_XFRM_OFFLOAD struct list_head ipsec_list; /* protecting ipsec_list */ - spinlock_t ipsec_lock; + struct mutex ipsec_lock; #endif /* CONFIG_XFRM_OFFLOAD */ struct bpf_prog *xdp_prog; };