From patchwork Sun Sep 15 04:56:24 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shradha Gupta X-Patchwork-Id: 13804647 Received: from linux.microsoft.com (linux.microsoft.com [13.77.154.182]) by smtp.subspace.kernel.org (Postfix) with ESMTP id B73911B85CD; Sun, 15 Sep 2024 04:56:25 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=13.77.154.182 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1726376187; cv=none; b=n5ywVrWrdZTvRTiSqpVXn4Li+lUAdvrveCj1Ki6xNcVLZZtMkA4cCx5oar6m4QPxajxRE5QsmZpx5Qtsv/Hm4V+20NODd5bxQx0RWrjHjp6grIlJVsRMlpzFmnCyFD6xRYZDkT4Cl13Ctaie7Vln9rgIRgXyqHTndqyCJhdDBUo= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1726376187; c=relaxed/simple; bh=9w30dChxYIMmPxhl67+/YhDv8UAzy02LRnlwADKHBNg=; h=From:To:Cc:Subject:Date:Message-Id; b=Tbt3iMr1STSbA9v2n5zE58Idlhf49eUqmUL2Ia6X53ixYpSsylOs/HhDex3pXXjTzaKv047kadHbXzmSIXHBeHJMG0//9iadOtMwAAacMqksnwgXNBcF4DsR4BbIeHORDIBCX5Sl4/i4Gm3BGnCGj94C1m/Y+xdHKR9RYZdUOsI= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.microsoft.com; spf=pass smtp.mailfrom=linux.microsoft.com; dkim=pass (1024-bit key) header.d=linux.microsoft.com header.i=@linux.microsoft.com header.b=W6Dd31fd; arc=none smtp.client-ip=13.77.154.182 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.microsoft.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.microsoft.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.microsoft.com header.i=@linux.microsoft.com header.b="W6Dd31fd" Received: by linux.microsoft.com (Postfix, from userid 1134) id 2ED1D20C08A3; Sat, 14 Sep 2024 21:56:25 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com 2ED1D20C08A3 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1726376185; bh=N+lwgWnXJnJIv3ORmL8lZsGxIiQ/BGyrO1aZxWResDM=; h=From:To:Cc:Subject:Date:From; b=W6Dd31fdlCYaoBHGnUNiNgYBg4SHFoHewSeoHayK7WCFR7ECh3Bfk+yRFdiI3D/++ Je6I0S9nR6LcT6MrU8LyY/0/d4yHDuYCMe6a17I4Xp7vK6OuDtsX3iI+aETGDkUgP5 UQRO3XlqkPP4bFxi2Xsa3Yj9xYEbLyeYjxuPafzw= From: Shradha Gupta To: linux-hyperv@vger.kernel.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org, linux-rdma@vger.kernel.org Cc: Shradha Gupta , "K. Y. Srinivasan" , Haiyang Zhang , Wei Liu , Dexuan Cui , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Long Li , Simon Horman , Konstantin Taranov , Souradeep Chakrabarti , Erick Archer , Pavan Chebbi , Ahmed Zaki , Colin Ian King , Shradha Gupta Subject: [PATCH net-next] net: mana: Increase the DEF_RX_BUFFERS_PER_QUEUE to 1024 Date: Sat, 14 Sep 2024 21:56:24 -0700 Message-Id: <1726376184-14874-1-git-send-email-shradhagupta@linux.microsoft.com> X-Mailer: git-send-email 1.8.3.1 Precedence: bulk X-Mailing-List: linux-rdma@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Through some experiments, we found out that increasing the default RX buffers count from 512 to 1024, gives slightly better throughput and significantly reduces the no_wqe_rx errs on the receiver side. Along with these, other parameters like cpu usage, retrans seg etc also show some improvement with 1024 value. Following are some snippets from the experiments ntttcp tests with 512 Rx buffers --------------------------------------- connections| throughput| no_wqe errs| --------------------------------------- 1 | 40.93Gbps | 123,211 | 16 | 180.15Gbps | 190,120 128 | 180.20Gbps | 173,508 | 256 | 180.27Gbps | 189,884 | ntttcp tests with 1024 Rx buffers --------------------------------------- connections| throughput| no_wqe errs| --------------------------------------- 1 | 44.22Gbps | 19,864 | 16 | 180.19Gbps | 4,430 | 128 | 180.21Gbps | 2,560 | 256 | 180.29Gbps | 1,529 | So, increasing the default RX buffers per queue count to 1024 Signed-off-by: Shradha Gupta Reviewed-by: Haiyang Zhang --- include/net/mana/mana.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/include/net/mana/mana.h b/include/net/mana/mana.h index f2a5200d8a0f..9b0faa24b758 100644 --- a/include/net/mana/mana.h +++ b/include/net/mana/mana.h @@ -43,7 +43,7 @@ enum TRI_STATE { * size beyond this value gets rejected by __alloc_page() call. */ #define MAX_RX_BUFFERS_PER_QUEUE 8192 -#define DEF_RX_BUFFERS_PER_QUEUE 512 +#define DEF_RX_BUFFERS_PER_QUEUE 1024 #define MIN_RX_BUFFERS_PER_QUEUE 128 /* This max value for TX buffers is derived as the maximum allocatable