From patchwork Mon Jul 8 11:25:27 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Xuan Zhuo X-Patchwork-Id: 13726430 Received: from out30-119.freemail.mail.aliyun.com (out30-119.freemail.mail.aliyun.com [115.124.30.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D392C7E103; Mon, 8 Jul 2024 11:25:46 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=115.124.30.119 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1720437949; cv=none; b=JQYzNQOrjg/pfj5LGdCq++5DBS4c3MdMEc6LNcJ+DV85wlRfe3HHzhjU0RQ5d6iH+K8g6wR/YxZjdcymhrhD3DybtcSG2nKylu94U36rRhh55pj/67qd8KKUscbvUmfUzKS/fuvrWoab/xrNRWXLQzgTm8uxY59BInlWHj4mJEI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1720437949; c=relaxed/simple; bh=jAeCdnQZODykeWWnC1inHxoKt7YbwmGF84FTe1a71Fg=; h=From:To:Cc:Subject:Date:Message-Id:MIME-Version; b=NSVYphHeHfj5/S+D5mblM38GiUt94GFtEP+i4zToUvQ4wOr09Vwa+I8pUN6WeqG6WjZssZaLOG1dwFzyDvq9Xz0jI1xrmjoz8+CR/tOUS9pZd9uQ7GZT0dcwdWvNG+aldUJkAZ2bpEK8NV8BJvfvyDjHDwF+ohqQnNKswxRXvDk= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.alibaba.com; spf=pass smtp.mailfrom=linux.alibaba.com; dkim=pass (1024-bit key) header.d=linux.alibaba.com header.i=@linux.alibaba.com header.b=t8vmdIRm; arc=none smtp.client-ip=115.124.30.119 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.alibaba.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.alibaba.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.alibaba.com header.i=@linux.alibaba.com header.b="t8vmdIRm" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.alibaba.com; s=default; t=1720437939; h=From:To:Subject:Date:Message-Id:MIME-Version; bh=VbdS6zELmWbuEAa6vOpUDpsiNWhHK7bVVek4TZEw204=; b=t8vmdIRmulMpmmNEADMLFuwo1AdIAcFuh2gGXN8BuNLY0dcG+Y8MGpYcLpa2o2mqfGUGlYyfC0QUz7eEI7ial3SMYm6G53V7ewMSxNJ3qCDlxVTKRQAjfsaVBeiBEhNJxPXeOrrpg2IBV8WNP7B8d1+QQN5wLF0udXzHx/AnM2Q= X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R101e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=maildocker-contentspam033037067112;MF=xuanzhuo@linux.alibaba.com;NM=1;PH=DS;RN=15;SR=0;TI=SMTPD_---0WA5oE5X_1720437937; Received: from localhost(mailfrom:xuanzhuo@linux.alibaba.com fp:SMTPD_---0WA5oE5X_1720437937) by smtp.aliyun-inc.com; Mon, 08 Jul 2024 19:25:38 +0800 From: Xuan Zhuo To: netdev@vger.kernel.org Cc: "Michael S. Tsirkin" , Jason Wang , Xuan Zhuo , =?utf-8?q?Eugenio_P=C3=A9rez?= , "David S. Miller" , Eric Dumazet , Jakub Kicinski , Paolo Abeni , Alexei Starovoitov , Daniel Borkmann , Jesper Dangaard Brouer , John Fastabend , virtualization@lists.linux.dev, bpf@vger.kernel.org Subject: [PATCH net-next v8 00/10] virtio-net: support AF_XDP zero copy Date: Mon, 8 Jul 2024 19:25:27 +0800 Message-Id: <20240708112537.96291-1-xuanzhuo@linux.alibaba.com> X-Mailer: git-send-email 2.32.0.3.g01195cf9f Precedence: bulk X-Mailing-List: bpf@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Git-Hash: 74fbc055cff2 X-Patchwork-Delegate: kuba@kernel.org v8: 1. virtnet_add_recvbuf_xsk() always return err, when encounters error v7: 1. some small fixes v6: 1. start from supporting the rx zerocopy v5: 1. fix the comments of last version http://lore.kernel.org/all/20240611114147.31320-1-xuanzhuo@linux.alibaba.com v4: 1. remove the commits that introduce the independent directory 2. remove the supporting for the rx merge mode (for limit 15 commits of net-next). Let's start with the small mode. 3. merge some commits and remove some not important commits ## AF_XDP XDP socket(AF_XDP) is an excellent bypass kernel network framework. The zero copy feature of xsk (XDP socket) needs to be supported by the driver. The performance of zero copy is very good. mlx5 and intel ixgbe already support this feature, This patch set allows virtio-net to support xsk's zerocopy xmit feature. At present, we have completed some preparation: 1. vq-reset (virtio spec and kernel code) 2. virtio-core premapped dma 3. virtio-net xdp refactor So it is time for Virtio-Net to complete the support for the XDP Socket Zerocopy. Virtio-net can not increase the queue num at will, so xsk shares the queue with kernel. On the other hand, Virtio-Net does not support generate interrupt from driver manually, so when we wakeup tx xmit, we used some tips. If the CPU run by TX NAPI last time is other CPUs, use IPI to wake up NAPI on the remote CPU. If it is also the local CPU, then we wake up napi directly. This patch set includes some refactor to the virtio-net to let that to support AF_XDP. ## Run & Test Because there are too many commits, the work of virtio net supporting af-xdp is split to rx part and tx part. This patch set is for rx part. So the flag NETDEV_XDP_ACT_XSK_ZEROCOPY is not added, if someone want to test for af-xdp rx, the flag needs to be adding locally. ## performance ENV: Qemu with vhost-user(polling mode). Host CPU: Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz ### virtio PMD in guest with testpmd testpmd> show port stats all ######################## NIC statistics for port 0 ######################## RX-packets: 19531092064 RX-missed: 0 RX-bytes: 1093741155584 RX-errors: 0 RX-nombuf: 0 TX-packets: 5959955552 TX-errors: 0 TX-bytes: 371030645664 Throughput (since last show) Rx-pps: 8861574 Rx-bps: 3969985208 Tx-pps: 8861493 Tx-bps: 3969962736 ############################################################################ ### AF_XDP PMD in guest with testpmd testpmd> show port stats all ######################## NIC statistics for port 0 ######################## RX-packets: 68152727 RX-missed: 0 RX-bytes: 3816552712 RX-errors: 0 RX-nombuf: 0 TX-packets: 68114967 TX-errors: 33216 TX-bytes: 3814438152 Throughput (since last show) Rx-pps: 6333196 Rx-bps: 2837272088 Tx-pps: 6333227 Tx-bps: 2837285936 ############################################################################ But AF_XDP consumes more CPU for tx and rx napi(100% and 86%). Please review. Thanks. v3 1. virtio introduces helpers for virtio-net sq using premapped dma 2. xsk has more complete support for merge mode 3. fix some problems v2 1. wakeup uses the way of GVE. No send ipi to wakeup napi on remote cpu. 2. remove rcu. Because we synchronize all operat, so the rcu is not needed. 3. split the commit "move to virtio_net.h" in last patch set. Just move the struct/api to header when we use them. 4. add comments for some code v1: 1. remove two virtio commits. Push this patchset to net-next 2. squash "virtio_net: virtnet_poll_tx support rescheduled" to xsk: support tx 3. fix some warnings Xuan Zhuo (10): virtio_net: replace VIRTIO_XDP_HEADROOM by XDP_PACKET_HEADROOM virtio_net: separate virtnet_rx_resize() virtio_net: separate virtnet_tx_resize() virtio_net: separate receive_buf virtio_net: separate receive_mergeable virtio_net: xsk: bind/unbind xsk for rx virtio_net: xsk: support wakeup virtio_net: xsk: rx: support fill with xsk buffer virtio_net: xsk: rx: support recv small mode virtio_net: xsk: rx: support recv merge mode drivers/net/virtio_net.c | 770 ++++++++++++++++++++++++++++++++++----- 1 file changed, 676 insertions(+), 94 deletions(-) Acked-by: Michael S. Tsirkin --- 2.32.0.3.g01195cf9f