From patchwork Thu Feb 20 18:34:54 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Selvin Xavier X-Patchwork-Id: 13984417 Received: from mail-pl1-f181.google.com (mail-pl1-f181.google.com [209.85.214.181]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DC37F265622 for ; Thu, 20 Feb 2025 18:56:16 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.181 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1740077778; cv=none; b=KBJWKsXpawrkbT+dbyZy0C5JFq1z9qqnDQbUW6jutvFfK3QEdI51raVtMG0NRpzOV0AQSyLrJf0dLQbP6faTIhHrLijZpZvRuCQi81aFKGB/vtWLSn/7l2kRTQ9fYzFYQTOXWvQ8gBnAoFih+1ooJFozb9qm6Mq6P3dRlOAbUPw= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1740077778; c=relaxed/simple; bh=qQmOt74s8s7ggF+1kRfXXp1O+t46qBBm4OZfmbYtmr0=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References; b=HASXP0GgFoTkyKW+3l4OFJaHfebYP3Dt18EeZZ/HBN5hxb1Xp34A7ZqQwLco1HXEg07L+TmEI/WXJT8kKkzUr/C4DvTSGHJAHtwdBSdX4iUcAO82gUP0SBp5yBMxA/OyP1OIS/ciwN0pNHon4hup2QA13oReBHinYnPLFKmTOWU= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com; spf=fail smtp.mailfrom=broadcom.com; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b=g8WdLfBS; arc=none smtp.client-ip=209.85.214.181 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=broadcom.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=broadcom.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=broadcom.com header.i=@broadcom.com header.b="g8WdLfBS" Received: by mail-pl1-f181.google.com with SMTP id d9443c01a7336-221057b6ac4so24353275ad.2 for ; Thu, 20 Feb 2025 10:56:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; t=1740077776; x=1740682576; darn=vger.kernel.org; h=references:in-reply-to:message-id:date:subject:cc:to:from:from:to :cc:subject:date:message-id:reply-to; bh=62gcd1c9eE38mVAGq05LCRcGvvb8fU0AO/xGYZf2u2I=; b=g8WdLfBSnGkXhRa46Gf+ocEWvUmmbxaAwBXO94k4mjRdWnGkklA70e7cTXCqco8ZNq LHveT4YHnR9e3wj6sbBsw8+2mQgfnqNvP8JNC8CLc8XJGw3qh+hJp2t3dQIIef6/tNHy SuQueltiNBy5U6Yf8YaYc6dpsi1fGWlhjdQPs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1740077776; x=1740682576; h=references:in-reply-to:message-id:date:subject:cc:to:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=62gcd1c9eE38mVAGq05LCRcGvvb8fU0AO/xGYZf2u2I=; b=CnhBc+VpbNjmHQZ69Q6sqiBzlqB+DPgpkRMfE70yKsfR6DlPiSEhSiSqXu3CWxv6BT KN08WjMmtKvtYcBz2vTzME69L6YIz1/6duPt7SvXS4GLFAb9If1l+Lk3jPc1ANolixd3 bNe3q8bIIBw65m8JRAt+ZCh8mTVtr0BTXV4SVUn0UX1OVBni8C6cXtU+/b06I27E3FyV chWiv5/8d6e8g8DQc8pqwAda+U038timS9QQ0Zsg4/pdWYjietdO1j+XUjkCvbqbybI9 dvGS+LAPRP05VSwPZqU1FY3w4VtPRdExdasYev1yhtgmH6Vdf58RZgpMr8sJBAMW/sXY nlDw== X-Gm-Message-State: AOJu0YwW5EpQUv0DD2boUI4xlh2OP6dxrmw98zKeRZnLbL9/YvAyNIhF 9RJJpEa88qBiHiuV2zwOtgnf5FBscmxHeJQyVPp6ahzQ1rVVpyhFFWDkeSEMXA== X-Gm-Gg: ASbGncuoYuVGXuE4yqALhg97SZuXcpIc4g7Z/3zEcRjjelw3Z0RaDjMGmfoqRVdaz4K 7TUPoXjXP6eFpaXp2EBBfqg4Ra4VmllarYo/Nfl7VmYKmou4uLSwXdCAa1KAC70o4uReG3651vp aqWWtEMyNZpHf2YY3n+bJw1yuc00rTjOkA/3Gp3MufvPErO3Yy3JkDELQ8i6simm6v0fNK183aa abdKLLM43eYub4h0PxmSqhWb1VBirLHq7T9xPzK5wZWoXoWy7DngsaKRp4f5LosIgRgAFrPyxCi 4cCupTujlwcq7VayD99TrlFvQ1Jmz+OGhbgS/SpYhjgJE+DQwjG1Zq+4+sPkUk3JNFhMcT8= X-Google-Smtp-Source: AGHT+IEqTR1Tj8xQJb09Um5L3+18Y3HeubsWUM4BCPraVepPaC1Lc0gQGeDiUUcGWKdFr4E2tzR1LQ== X-Received: by 2002:a05:6a21:6b0f:b0:1ee:e24d:8fd2 with SMTP id adf61e73a8af0-1eef3cbdfbdmr519522637.25.1740077776052; Thu, 20 Feb 2025 10:56:16 -0800 (PST) Received: from sxavier-dev.dhcp.broadcom.net ([192.19.234.250]) by smtp.gmail.com with ESMTPSA id 41be03b00d2f7-addee79a984sm9572262a12.32.2025.02.20.10.56.12 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 20 Feb 2025 10:56:15 -0800 (PST) From: Selvin Xavier To: leon@kernel.org, jgg@ziepe.ca Cc: linux-rdma@vger.kernel.org, andrew.gospodarek@broadcom.com, kalesh-anakkur.purayil@broadcom.com, netdev@vger.kernel.org, davem@davemloft.net, edumazet@google.com, kuba@kernel.org, abeni@redhat.com, horms@kernel.org, michael.chan@broadcom.com, Saravanan Vajravel , Selvin Xavier Subject: [PATCH rdma-next 7/9] RDMA/bnxt_re: Dump the debug information in snapdump Date: Thu, 20 Feb 2025 10:34:54 -0800 Message-Id: <1740076496-14227-8-git-send-email-selvin.xavier@broadcom.com> X-Mailer: git-send-email 2.5.5 In-Reply-To: <1740076496-14227-1-git-send-email-selvin.xavier@broadcom.com> References: <1740076496-14227-1-git-send-email-selvin.xavier@broadcom.com> Precedence: bulk X-Mailing-List: linux-rdma@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: From: Saravanan Vajravel Dump the cached debug information when the L2 driver invokes the get_dump_data hook. Signed-off-by: Saravanan Vajravel Signed-off-by: Selvin Xavier --- drivers/infiniband/hw/bnxt_re/main.c | 109 +++++++++++++++++++++++++++++++++++ 1 file changed, 109 insertions(+) diff --git a/drivers/infiniband/hw/bnxt_re/main.c b/drivers/infiniband/hw/bnxt_re/main.c index 76dd0fa..afde0ef 100644 --- a/drivers/infiniband/hw/bnxt_re/main.c +++ b/drivers/infiniband/hw/bnxt_re/main.c @@ -508,6 +508,106 @@ static void bnxt_re_dump_ctx(struct bnxt_re_dev *rdev, u32 seg_id, void *buf, { } +/* + * bnxt_re_snapdump_qp - Log QP dump to the coredump buffer + * @rdev - Pointer to RoCE device instance + * @buf - Pointer to dump buffer + * @buf_len - Buffer length + * + * This function will invoke ULP logger to capture snapshot of + * SQ/RQ/SCQ/RCQ of a QP in ASCII format. + * + * Returns: Buffer length + */ +static u32 bnxt_re_snapdump_qp(struct bnxt_re_dev *rdev, void *buf, u32 buf_len) +{ + u32 index, len = 0, count = 0; + struct qdump_qpinfo *qpinfo; + struct qdump_array *qdump; + + if (!rdev->qdump_head.qdump) + return 0; + + mutex_lock(&rdev->qdump_head.lock); + index = rdev->qdump_head.index; + while (count < rdev->qdump_head.max_elements) { + count++; + index = (!index) ? (rdev->qdump_head.max_elements - 1) : (index - 1); + qdump = &rdev->qdump_head.qdump[index]; + if (!qdump->valid || qdump->is_mr) + continue; + + qpinfo = &qdump->qpinfo; + len += snprintf(buf + len, buf_len - len, + "qp_handle 0x%.8x 0x%.8x (xid %d) dest_qp %d type %s state %s ", + (u32)(qpinfo->qp_handle >> 32), + (u32)(qpinfo->qp_handle & 0xFFFFFFFF), + qpinfo->id, qpinfo->dest_qpid, + __to_qp_type_str(qpinfo->type), + __to_qp_state_str(qpinfo->state)); + len += snprintf(buf + len, buf_len - len, + "is_usr %d scq_handle 0x%llx rcq_handle 0x%llx", + qpinfo->is_user, qpinfo->scq_handle, qpinfo->rcq_handle); + len += snprintf(buf + len, buf_len - len, + "scq_id %d rcq_id %d\n", + qpinfo->scq_id, qpinfo->rcq_id); + if (len >= buf_len) + goto dump_full; + + if (len >= buf_len) + goto dump_full; + } + mutex_unlock(&rdev->qdump_head.lock); + return len; + +dump_full: + mutex_unlock(&rdev->qdump_head.lock); + return buf_len; +} + +/* + * bnxt_re_snapdump_mr - Log PBL of MR to the coredump buffer + * @rdev - Pointer to RoCE device instance + * @buf - Pointer to dump buffer + * @buf_len - Buffer length + * + * This function will invoke ULP logger to capture PBL list of + * Memory Region in ASCII format. + * + * Returns: Buffer length + */ +static u32 bnxt_re_snapdump_mr(struct bnxt_re_dev *rdev, void *buf, u32 buf_len) +{ + u32 index, count = 0, len = 0; + struct qdump_array *qdump; + + if (!rdev->qdump_head.qdump) + return 0; + + mutex_lock(&rdev->qdump_head.lock); + index = rdev->qdump_head.index; + while (count < rdev->qdump_head.max_elements) { + count++; + index = (!index) ? (rdev->qdump_head.max_elements - 1) : (index - 1); + qdump = &rdev->qdump_head.qdump[index]; + if (!qdump->valid || !qdump->is_mr) + continue; + + len += snprintf(buf + len, buf_len - len, + "**MemoryRegion: type %d lkey 0x%x rkey 0x%x tot_sz %llu **\n", + qdump->mrinfo.type, qdump->mrinfo.lkey, + qdump->mrinfo.rkey, qdump->mrinfo.total_size); + if (len >= buf_len) + goto dump_full; + } + mutex_unlock(&rdev->qdump_head.lock); + return len; + +dump_full: + mutex_unlock(&rdev->qdump_head.lock); + return buf_len; +} + /* bnxt_re_snapdump - Collect RoCE debug data for coredump. * @rdev - rdma device instance * @buf - Pointer to dump buffer @@ -520,6 +620,15 @@ static void bnxt_re_dump_ctx(struct bnxt_re_dev *rdev, u32 seg_id, void *buf, */ static void bnxt_re_snapdump(struct bnxt_re_dev *rdev, void *buf, u32 buf_len) { + u32 len = 0; + + len += bnxt_re_snapdump_qp(rdev, buf + len, buf_len - len); + if (len >= buf_len) + return; + + len += bnxt_re_snapdump_mr(rdev, buf + len, buf_len - len); + if (len >= buf_len) + return; } #define BNXT_RE_TRACE_DUMP_SIZE 0x2000000