From patchwork Wed Apr 24 20:35:55 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Tony Nguyen X-Patchwork-Id: 13642495 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 68F27C4345F for ; Wed, 24 Apr 2024 20:36:38 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4ED736B00E3; Wed, 24 Apr 2024 16:36:30 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 3BB108D002F; Wed, 24 Apr 2024 16:36:30 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E85EA8D002E; Wed, 24 Apr 2024 16:36:29 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id C3C4C6B02FD for ; Wed, 24 Apr 2024 16:36:29 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 706DD121167 for ; Wed, 24 Apr 2024 20:36:29 +0000 (UTC) X-FDA: 82045583298.30.DA56E75 Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.17]) by imf05.hostedemail.com (Postfix) with ESMTP id 4E48210000F for ; Wed, 24 Apr 2024 20:36:27 +0000 (UTC) Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=cEQBSwPL; spf=pass (imf05.hostedemail.com: domain of anthony.l.nguyen@intel.com designates 192.198.163.17 as permitted sender) smtp.mailfrom=anthony.l.nguyen@intel.com; dmarc=pass (policy=none) header.from=intel.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1713990987; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=142KBqKmeED8aNufxkkZesL9bIZnO51QELfcptf2pvw=; b=NiQB7jjznFWvirpUlwDw2jibmzabAuHczxq+A2/kgnMupwV7j0MlS4c4qX/uWVgub1hshg UWrq0Z9w639rqQRfOwMjRJbn6I1rXo6e8CpT2KG/XJZqY0RmrvXmViy0ItcY2M43MuROxC 1wcOg0/Brt86ScLzQeugYolMlMeDXPs= ARC-Authentication-Results: i=1; imf05.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=cEQBSwPL; spf=pass (imf05.hostedemail.com: domain of anthony.l.nguyen@intel.com designates 192.198.163.17 as permitted sender) smtp.mailfrom=anthony.l.nguyen@intel.com; dmarc=pass (policy=none) header.from=intel.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1713990987; a=rsa-sha256; cv=none; b=Umf7wO2KA/G6w8P2hVUlN2MQJLYSsnQ/jdFhHPm0ptS4xAgHpJO8NrsqQTYMc9w66UIFly MGixkMLKbxSl3pDfj71PQz1sgKNwC1at90Tz1LQuCvd5UmETMt9x6w2ZiQ9UPexJzQF7oz xSZD1Tu31+PKUvTpXlKNFC3we+fxZ6k= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1713990987; x=1745526987; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=SR/txrItjji3b1VBUabdl8RvbDYOnvGXLR2JMpM/4iY=; b=cEQBSwPLpoAPUqBvLH0gFGSv5IFgWRm2ZE6cbjz8yDoOaAzYxCo8swAr l18FMr6lh0awEj8HWr+KySCGQaZJOa3HdLyiITCHd9aKVwfPU+oaSQrBH /tmwYUdqLgGvr2FnyLAkjNuYm+N4q8oV5GjFQ2DHu9zXKSh/TIdVpqBl1 TUFQjAA1n0aNE+G75Cx4+6HSV8ucNgBt4nKZbWwti7VYbiQiPjzf1Vyqk L1VUG26cP+ZkhBPihoT3yur8oarKETTyOm2Nvx8+JZTjo0CmoDCqtToMK Kh0yW4+Aa6kdkVO386VtfntnecJjUKEw+qN2Wb+e8Uqx+gG7lIBOUKKdD Q==; X-CSE-ConnectionGUID: 1UuV1MCZRIy3giM8XGbsAA== X-CSE-MsgGUID: 5pGak6EuSMaEew8DvCKVBQ== X-IronPort-AV: E=McAfee;i="6600,9927,11054"; a="9511985" X-IronPort-AV: E=Sophos;i="6.07,227,1708416000"; d="scan'208";a="9511985" Received: from fmviesa003.fm.intel.com ([10.60.135.143]) by fmvoesa111.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 24 Apr 2024 13:36:21 -0700 X-CSE-ConnectionGUID: pn5kNLIEQjGCY7TKZz+bUQ== X-CSE-MsgGUID: 8133M7oxTLetwLo+T87sig== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.07,227,1708416000"; d="scan'208";a="29314999" Received: from anguy11-upstream.jf.intel.com ([10.166.9.133]) by fmviesa003.fm.intel.com with ESMTP; 24 Apr 2024 13:36:20 -0700 From: Tony Nguyen To: davem@davemloft.net, kuba@kernel.org, pabeni@redhat.com, edumazet@google.com, netdev@vger.kernel.org Cc: Alexander Lobakin , anthony.l.nguyen@intel.com, hawk@kernel.org, linux-mm@kvack.org, przemyslaw.kitszel@intel.com, alexanderduyck@fb.com, ilias.apalodimas@linaro.org, linux-kernel@vger.kernel.org, linyunsheng@huawei.com, nex.sw.ncis.osdt.itp.upstreaming@intel.com, cl@linux.com, akpm@linux-foundation.org, vbabka@suse.cz Subject: [PATCH net-next v11 08/10] iavf: pack iavf_ring more efficiently Date: Wed, 24 Apr 2024 13:35:55 -0700 Message-ID: <20240424203559.3420468-9-anthony.l.nguyen@intel.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20240424203559.3420468-1-anthony.l.nguyen@intel.com> References: <20240424203559.3420468-1-anthony.l.nguyen@intel.com> MIME-Version: 1.0 X-Stat-Signature: ck859cku3dzf1sc1ejmd3zjc8h1mpk3d X-Rspamd-Queue-Id: 4E48210000F X-Rspamd-Server: rspam02 X-Rspam-User: X-HE-Tag: 1713990987-994893 X-HE-Meta: U2FsdGVkX1/oI+8VLrqCn3uKi71hsB0w4psIWn4U6npA+oRXoJB6OoO6BbiuFGRVq1I3YohqFAnchpFWSx+5ovNtdc9kCup1IIlYZRdnzseV4bqBaru5+1YomczGAy9SwC5RqgZYnOeejip9vSntlY6n+Dqptx0YfLxKjuuPtShfgwJCzxia99YkMmeloqTKV4crNL0Q4jgLn227iKkXzUWG5d7vDa3xz9MycPHbYTw/sLDzX3/1YCgiby6epNNXyRPw1cEdRwCS1GNakXfcpGVrs6nIzxKYbrF3m/jqLKO+uBgRysSs2+aObD5f6jaBzA4M1feof7XOrtmziEAgsak4PQA6lEEN9+n9/Ed08W/wE8268tklT2LBKSPGAw7OUzwLlFfbfpdHkas8xdZBfGBDptgppC9gzkjASZQk/gcDtTCMOwBBBhk1Yl5lucdCyHM3ib8k7JU1hHhJ7kzZk/X7ubiNNZEZyT7FiYbuuMzX2YZfnnx/5Ormrr20VLmOC+v/LaAcvkF3zU+aNTKxs0scRjeZMyDoX4IXucU7E9k1ZWcyWYOUx8SYgu+++Yo/6ddyw4uLLol8n5Jmdn0U34uLQpmw7l2yNqhyfBUYZ3kGMadbBpV+ONe7kABwA8D/er3c5fj0jUjQP7gqB7a1dzXZod9DrTX5eM9hBUQ1CqgZk4NhO93ZpjdRo7BStUJ256nHKTy3L1+kX7MtAUsF7tE37exgUed3RzBr6/ol2R5m+sTopgEZAn4L6JqRI6FoMRtrtAdgocAqdF6iqApQrHX5d4GV1Q3ZGzpGVMpgGQqbUMxiItj1zxLYgvifFEbrOh7Mo04eTH9FCdzmXjtffyZd7XkCdvwuoGHHEBwhrOOB6hRoSCHH7L1UI2xDwgFVCi/yIzR4r5WD/V0Bz7vOFLcBwBfXOAGKsjanASFDf9yhOL5234Iw0D/XyLSEbRiHf2mkBhphRDyPFBnBDH5 vZoB9mJ6 TlO7UPshsMxZxxXSZw9WbQZhWCn3ycb8M7c3H2QCqip40neUPPa1Kj6ZRQnv1SBElQHM5iMP41t/2ccjN9MKkAZacjSUJxwjLXdw2OqIzojx8n9YgLQZUh79AUV+X5ahQUBWBL8xvp4/wQdJHVgwW7YRqlfwDSDYg9P4v8zBTFz+X4vw3nUBdtnl7Zkz+3MHfTUxABMH8KIJB0eM= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Alexander Lobakin Before replacing the Rx buffer management with libie, clean up &iavf_ring a bit. There are several fields not used anywhere in the code -- simply remove them. Move ::tail up to remove a hole. Replace ::arm_wb boolean with 1-bit flag in ::flags to free 1 more byte. Finally, move ::prev_pkt_ctr out of &iavf_tx_queue_stats -- it doesn't belong there (used for Tx stall detection). Place it next to the stats on the ring itself to fill the 4-byte slot. The result: no holes and all the hot fields fit into the first 64-byte cacheline. Signed-off-by: Alexander Lobakin Signed-off-by: Tony Nguyen --- drivers/net/ethernet/intel/iavf/iavf_txrx.c | 12 +++++------ drivers/net/ethernet/intel/iavf/iavf_txrx.h | 22 +++------------------ 2 files changed, 9 insertions(+), 25 deletions(-) diff --git a/drivers/net/ethernet/intel/iavf/iavf_txrx.c b/drivers/net/ethernet/intel/iavf/iavf_txrx.c index c7602c173420..2ec68b51bebe 100644 --- a/drivers/net/ethernet/intel/iavf/iavf_txrx.c +++ b/drivers/net/ethernet/intel/iavf/iavf_txrx.c @@ -185,7 +185,7 @@ void iavf_detect_recover_hung(struct iavf_vsi *vsi) * pending work. */ packets = tx_ring->stats.packets & INT_MAX; - if (tx_ring->tx_stats.prev_pkt_ctr == packets) { + if (tx_ring->prev_pkt_ctr == packets) { iavf_force_wb(vsi, tx_ring->q_vector); continue; } @@ -194,7 +194,7 @@ void iavf_detect_recover_hung(struct iavf_vsi *vsi) * to iavf_get_tx_pending() */ smp_rmb(); - tx_ring->tx_stats.prev_pkt_ctr = + tx_ring->prev_pkt_ctr = iavf_get_tx_pending(tx_ring, true) ? packets : -1; } } @@ -320,7 +320,7 @@ static bool iavf_clean_tx_irq(struct iavf_vsi *vsi, ((j / WB_STRIDE) == 0) && (j > 0) && !test_bit(__IAVF_VSI_DOWN, vsi->state) && (IAVF_DESC_UNUSED(tx_ring) != tx_ring->count)) - tx_ring->arm_wb = true; + tx_ring->flags |= IAVF_TXR_FLAGS_ARM_WB; } /* notify netdev of completed buffers */ @@ -675,7 +675,7 @@ int iavf_setup_tx_descriptors(struct iavf_ring *tx_ring) tx_ring->next_to_use = 0; tx_ring->next_to_clean = 0; - tx_ring->tx_stats.prev_pkt_ctr = -1; + tx_ring->prev_pkt_ctr = -1; return 0; err: @@ -1491,8 +1491,8 @@ int iavf_napi_poll(struct napi_struct *napi, int budget) clean_complete = false; continue; } - arm_wb |= ring->arm_wb; - ring->arm_wb = false; + arm_wb |= !!(ring->flags & IAVF_TXR_FLAGS_ARM_WB); + ring->flags &= ~IAVF_TXR_FLAGS_ARM_WB; } /* Handle case where we are called by netpoll with a budget of 0 */ diff --git a/drivers/net/ethernet/intel/iavf/iavf_txrx.h b/drivers/net/ethernet/intel/iavf/iavf_txrx.h index e01777531635..ed559fa6f214 100644 --- a/drivers/net/ethernet/intel/iavf/iavf_txrx.h +++ b/drivers/net/ethernet/intel/iavf/iavf_txrx.h @@ -227,7 +227,6 @@ struct iavf_tx_queue_stats { u64 tx_done_old; u64 tx_linearize; u64 tx_force_wb; - int prev_pkt_ctr; u64 tx_lost_interrupt; }; @@ -237,12 +236,6 @@ struct iavf_rx_queue_stats { u64 alloc_buff_failed; }; -enum iavf_ring_state_t { - __IAVF_TX_FDIR_INIT_DONE, - __IAVF_TX_XPS_INIT_DONE, - __IAVF_RING_STATE_NBITS /* must be last */ -}; - /* some useful defines for virtchannel interface, which * is the only remaining user of header split */ @@ -264,10 +257,8 @@ struct iavf_ring { struct iavf_tx_buffer *tx_bi; struct iavf_rx_buffer *rx_bi; }; - DECLARE_BITMAP(state, __IAVF_RING_STATE_NBITS); - u16 queue_index; /* Queue number of ring */ - u8 dcb_tc; /* Traffic class of ring */ u8 __iomem *tail; + u16 queue_index; /* Queue number of ring */ /* high bit set means dynamic, use accessors routines to read/write. * hardware only supports 2us resolution for the ITR registers. @@ -277,22 +268,14 @@ struct iavf_ring { u16 itr_setting; u16 count; /* Number of descriptors */ - u16 reg_idx; /* HW register index of the ring */ /* used in interrupt processing */ u16 next_to_use; u16 next_to_clean; - u8 atr_sample_rate; - u8 atr_count; - - bool ring_active; /* is ring online or not */ - bool arm_wb; /* do something to arm write back */ - u8 packet_stride; - u16 flags; #define IAVF_TXR_FLAGS_WB_ON_ITR BIT(0) -/* BIT(1) is free, was IAVF_RXR_FLAGS_BUILD_SKB_ENABLED */ +#define IAVF_TXR_FLAGS_ARM_WB BIT(1) /* BIT(2) is free */ #define IAVF_TXRX_FLAGS_VLAN_TAG_LOC_L2TAG1 BIT(3) #define IAVF_TXR_FLAGS_VLAN_TAG_LOC_L2TAG2 BIT(4) @@ -306,6 +289,7 @@ struct iavf_ring { struct iavf_rx_queue_stats rx_stats; }; + int prev_pkt_ctr; /* For Tx stall detection */ unsigned int size; /* length of descriptor ring in bytes */ dma_addr_t dma; /* physical address of ring */