From patchwork Thu Jun 17 21:27:45 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Toke_H=C3=B8iland-J=C3=B8rgensen?= X-Patchwork-Id: 12329577 X-Patchwork-Delegate: bpf@iogearbox.net Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.9 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E1F07C48BE5 for ; Thu, 17 Jun 2021 21:28:21 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id CB662611BE for ; Thu, 17 Jun 2021 21:28:21 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S233125AbhFQVaZ (ORCPT ); Thu, 17 Jun 2021 17:30:25 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:43762 "EHLO us-smtp-delivery-124.mimecast.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233131AbhFQVaO (ORCPT ); Thu, 17 Jun 2021 17:30:14 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1623965286; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4E0BLtcqynOO11TlkwRy31SmQKgoTi4+6vdURBBEN5E=; b=F+hgpmXLTPhxl0vwX11AGC9DUnN1AX6ORLgFeDaOBnVfb6QmSBEcI0iy8EFqlsMUe8nI74 Qw79JhaFE+ezIP4yt5fb4Wf5nfG1pBbE792oYYd220MTDzFDp06mutxk52HWc9kS5/IwyV 6nxjWGHSkVM/Y24Z8lkuqRfIXkeq/ZY= Received: from mail-ed1-f72.google.com (mail-ed1-f72.google.com [209.85.208.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-213-EYRR2OAxNbuFfuR0sWeSqQ-1; Thu, 17 Jun 2021 17:28:04 -0400 X-MC-Unique: EYRR2OAxNbuFfuR0sWeSqQ-1 Received: by mail-ed1-f72.google.com with SMTP id a16-20020aa7cf100000b0290391819a774aso802975edy.8 for ; Thu, 17 Jun 2021 14:28:04 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=4E0BLtcqynOO11TlkwRy31SmQKgoTi4+6vdURBBEN5E=; b=XOECHVLYetIfYfpb8Hxw/aRu7Y3mjHVkdpsOn10kPZKLcYcBd0xcXQCY8K7G4eiF+5 hqD4pZBXl3eiRrNEBVcafwzQ2iaLpXN8pSa3YXS991uQJBuPN3uuepU//YebmOJMPJR2 PEU6SJ7IODkxCMajrGO0cv1cBJjlgL5Jci6lf5qnXKTvmM7yIWJwHfaOPvufNi0B4yLW eO8WoT4iLu/My/Rek3MgGtdhGQMNpI15hIiI5cmn9nLJ44VXuPSF6otAiphI5NGX2CIc hf1Tr0bNUnAL/qAST9CZqLgweCfAeha6AL1zu0U5Muob/BBT1IcrD4fIfN3WQkV+d/Si c3eA== X-Gm-Message-State: AOAM531+8lMcdReH53uQAra5UNIHt7Lr0haEfT34XPxBT4tMEWrqY/9r 2F/R5xc6GtGet3C/rGNJh17G5gQlbjQUzX1+aPzvBa2pls53W9t2oaKTSAkQMCZeR32HoomiUP8 7aCIMM9j5hc5F X-Received: by 2002:aa7:dc0a:: with SMTP id b10mr480326edu.134.1623965283765; Thu, 17 Jun 2021 14:28:03 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwm3xB3xkhsrXomg6vyS9qjizIuVw9HAdz+x5dP1AwlFGrfqO5qySP880NPEtyTVT7G1MUUUw== X-Received: by 2002:aa7:dc0a:: with SMTP id b10mr480311edu.134.1623965283649; Thu, 17 Jun 2021 14:28:03 -0700 (PDT) Received: from alrua-x1.borgediget.toke.dk ([45.145.92.2]) by smtp.gmail.com with ESMTPSA id e6sm111671ejm.35.2021.06.17.14.27.59 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 17 Jun 2021 14:28:01 -0700 (PDT) Received: by alrua-x1.borgediget.toke.dk (Postfix, from userid 1000) id CCF49180736; Thu, 17 Jun 2021 23:27:54 +0200 (CEST) From: =?utf-8?q?Toke_H=C3=B8iland-J=C3=B8rgensen?= To: bpf@vger.kernel.org, netdev@vger.kernel.org Cc: Martin KaFai Lau , Hangbin Liu , Jesper Dangaard Brouer , Magnus Karlsson , "Paul E . McKenney" , Jakub Kicinski , =?utf-8?q?Toke_H=C3=B8iland-J=C3=B8rgensen?= , Edward Cree , Martin Habets Subject: [PATCH bpf-next v3 13/16] sfc: remove rcu_read_lock() around XDP program invocation Date: Thu, 17 Jun 2021 23:27:45 +0200 Message-Id: <20210617212748.32456-14-toke@redhat.com> X-Mailer: git-send-email 2.32.0 In-Reply-To: <20210617212748.32456-1-toke@redhat.com> References: <20210617212748.32456-1-toke@redhat.com> MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: bpf@vger.kernel.org X-Patchwork-Delegate: bpf@iogearbox.net The sfc driver has rcu_read_lock()/rcu_read_unlock() pairs around XDP program invocations. However, the actual lifetime of the objects referred by the XDP program invocation is longer, all the way through to the call to xdp_do_flush(), making the scope of the rcu_read_lock() too small. This turns out to be harmless because it all happens in a single NAPI poll cycle (and thus under local_bh_disable()), but it makes the rcu_read_lock() misleading. Rather than extend the scope of the rcu_read_lock(), just get rid of it entirely. With the addition of RCU annotations to the XDP_REDIRECT map types that take bh execution into account, lockdep even understands this to be safe, so there's really no reason to keep it around. Cc: Edward Cree Cc: Martin Habets Acked-by: Edward Cree Signed-off-by: Toke Høiland-Jørgensen --- drivers/net/ethernet/sfc/rx.c | 12 +++++------- 1 file changed, 5 insertions(+), 7 deletions(-) diff --git a/drivers/net/ethernet/sfc/rx.c b/drivers/net/ethernet/sfc/rx.c index 17b8119c48e5..3e5b88ab42db 100644 --- a/drivers/net/ethernet/sfc/rx.c +++ b/drivers/net/ethernet/sfc/rx.c @@ -260,18 +260,14 @@ static bool efx_do_xdp(struct efx_nic *efx, struct efx_channel *channel, s16 offset; int err; - rcu_read_lock(); - xdp_prog = rcu_dereference(efx->xdp_prog); - if (!xdp_prog) { - rcu_read_unlock(); + xdp_prog = rcu_dereference_bh(efx->xdp_prog); + if (!xdp_prog) return true; - } rx_queue = efx_channel_get_rx_queue(channel); if (unlikely(channel->rx_pkt_n_frags > 1)) { /* We can't do XDP on fragmented packets - drop. */ - rcu_read_unlock(); efx_free_rx_buffers(rx_queue, rx_buf, channel->rx_pkt_n_frags); if (net_ratelimit()) @@ -295,8 +291,10 @@ static bool efx_do_xdp(struct efx_nic *efx, struct efx_channel *channel, xdp_prepare_buff(&xdp, *ehp - EFX_XDP_HEADROOM, EFX_XDP_HEADROOM, rx_buf->len, false); + /* This code is invoked within a single NAPI poll cycle and thus under + * local_bh_disable(), which provides the needed RCU protection. + */ xdp_act = bpf_prog_run_xdp(xdp_prog, &xdp); - rcu_read_unlock(); offset = (u8 *)xdp.data - *ehp;