From patchwork Fri Feb 7 19:39:51 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Frank Li X-Patchwork-Id: 13965640 X-Patchwork-Delegate: kw@linux.com Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2076.outbound.protection.outlook.com [40.107.21.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id DEAFB19EEBF; Fri, 7 Feb 2025 19:41:21 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.21.76 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738957284; cv=fail; b=ouS2y7M+AtY590tnjhliNzY6FPq1Zn+bUoYRikuyZ1b/9p4Ag0e5K+NzM+ZRWOpRxSUYY9B6NNbiuQ56dSK0r7JeLKaRDdrwt8iHSufh9h2y5N4iCzb5uMIKwmjJ3Bl3KoC+mb+wstsYrkOohhUL4vygJnkaP4sncvmqHc8eNoU= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738957284; c=relaxed/simple; bh=d2xjjyNTJZsGn1kAFZa3ob7gS3KSYxktodeMrPpodR8=; h=From:Date:Subject:Content-Type:Message-Id:References:In-Reply-To: To:Cc:MIME-Version; b=giIoUUUMtGuNDoi3/zzcBYy5eslPHS0WutBCkJM39uGzAOgKkGj0FqssKd452X9Cu221wsjd97iQBR/rhZuJWSRgtVJ4fGXhZ2vBX9DTkv8ND/vvfNaXfI1H84yzeuRgztbRTgK42MujuLYQOH+il/g7VQI4UdziDF5+D6ogcuw= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com; spf=pass smtp.mailfrom=nxp.com; dkim=pass (2048-bit key) header.d=nxp.com header.i=@nxp.com header.b=LyayMiQm; arc=fail smtp.client-ip=40.107.21.76 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=nxp.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=nxp.com header.i=@nxp.com header.b="LyayMiQm" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=WfC3YASZNuv+z5oQh+7JyBT2ZJZ3PtzpPvOuqYYbV8RuswOfy4iaCwywfZWdm1OaDTsFxjGHoYuVa+AagC+tQ7yDR7iaFxRC7HF9934oekvdA9Cgko9BALIOU8mBvZ6sHjE1NH9XHNuTXkGroXZiWzGi9OeHdljIeS1DbfhIzCi3L4cOd2u11GrZ0Ohxve+9nodK0deWJXeJ94viVD/+OFmBf/yWOFHJxj4/ShIDeS3jZMkL2jqGAd45LtoXv6oYTlwA5F3pavC5QHT+BhOmyz/RZmwkkd2Ii5+VhNEfLbfYs65kzkq5zJiK3D0ZOhJ+3A99HFrmEHySAfRanvrYBA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=3pMYycU/icqBmMl3n6WN4hCtVJg4Dno0o86n1YcETS8=; b=RE63rDB17EiMWtLcI0SoY8Fu86djTCElxncK6nMEe4/mpZwpKKf0jlc4LFYoWcISc1Ck2zICsVs7S7Jtx9iGKfsr8ib2YDZUuVxPWK8rohnpXC5/9F5BebIPiz4oE4qIKaKDT374jVz+xImkdsBXaEaeiruZezoaKBbjUwz2wIS/ZcJmxbZ8DL3YFy/X+cnA/Q7tJ+UA4QziaY+ECqZ/nLmc5RymMbRbeeSWP/rkz4AzH+QnNExPQvR6CfLUX6du1Wqix8Xm55WWQ/OK0dopWQ6Vgez33Ocf3t8jXEokZ4rXwvyrv4ZSJ1BBC7vgpBuVPyHZlJCk4DfFtA6vxgwhdw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nxp.com; dmarc=pass action=none header.from=nxp.com; dkim=pass header.d=nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3pMYycU/icqBmMl3n6WN4hCtVJg4Dno0o86n1YcETS8=; b=LyayMiQmI6yRSsYbMa4vnD15057a7c+UfO9rzyHb7m1AhryzOOEE2stCUD6qM2wBjWPDaolX9RFwXVTx/cLOlDA16xegw2DR5Q4W8BZ9aaB6L+D1O5dXgKz9AeSROrz1j84ttDGuj+xJxuH15czgl2/dkHtgVkBWnU7/CWCTdvTME3CKaJZgnJZiLDh4nLAyQQvmvMqBmuwgueb1yHnOfWFL0vJPrioHebGJBpJA2prsXyutcNfslFb8XGTbakZmwp6PKkPED+PS8z0uXMnCn3qxcXAsWVThqkDuDKuhVC87whcz+gTmX3uIaNFePn2KOzsv+sKp9FXqCN4bgNMVjQ== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nxp.com; Received: from PAXPR04MB9642.eurprd04.prod.outlook.com (2603:10a6:102:240::14) by VI1PR04MB9787.eurprd04.prod.outlook.com (2603:10a6:800:1d8::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8422.14; Fri, 7 Feb 2025 19:41:19 +0000 Received: from PAXPR04MB9642.eurprd04.prod.outlook.com ([fe80::9126:a61e:341d:4b06]) by PAXPR04MB9642.eurprd04.prod.outlook.com ([fe80::9126:a61e:341d:4b06%6]) with mapi id 15.20.8422.012; Fri, 7 Feb 2025 19:41:19 +0000 From: Frank Li Date: Fri, 07 Feb 2025 14:39:51 -0500 Subject: [PATCH v14 09/15] PCI: endpoint: pci-epf-test: Add doorbell test support Message-Id: <20250207-ep-msi-v14-9-9671b136f2b8@nxp.com> References: <20250207-ep-msi-v14-0-9671b136f2b8@nxp.com> In-Reply-To: <20250207-ep-msi-v14-0-9671b136f2b8@nxp.com> To: Kishon Vijay Abraham I , "Rafael J. Wysocki" , Thomas Gleixner , Anup Patel , Kishon Vijay Abraham I , Marc Zyngier , Greg Kroah-Hartman , "Rafael J. Wysocki" , Danilo Krummrich , Manivannan Sadhasivam , =?utf-8?q?Krzysz?= =?utf-8?q?tof_Wilczy=C5=84ski?= , Kishon Vijay Abraham I , Bjorn Helgaas , Arnd Bergmann , Shuah Khan , Richard Zhu , Lucas Stach , Lorenzo Pieralisi , Rob Herring , Shawn Guo , Sascha Hauer , Pengutronix Kernel Team , Fabio Estevam , Krzysztof Kozlowski , Conor Dooley Cc: Niklas Cassel , dlemoal@kernel.org, jdmason@kudzu.us, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-pci@vger.kernel.org, linux-kselftest@vger.kernel.org, imx@lists.linux.dev, devicetree@vger.kernel.org, Frank Li X-Mailer: b4 0.13-dev-e586c X-Developer-Signature: v=1; a=ed25519-sha256; t=1738957203; l=8224; i=Frank.Li@nxp.com; s=20240130; h=from:subject:message-id; bh=d2xjjyNTJZsGn1kAFZa3ob7gS3KSYxktodeMrPpodR8=; b=yrPDShs4Q95rASE0p3F81wDoU2lzXDLCz1qCSCI93hrT7eAqrYiZWHjatkbOBW3ZgHck9I0OS qyR8NgyVnKsBltMATuWcpDx+1hoUQZoYPtJ4W6aHffwaDzg8vjIvzCn X-Developer-Key: i=Frank.Li@nxp.com; a=ed25519; pk=I0L1sDUfPxpAkRvPKy7MdauTuSENRq+DnA+G4qcS94Q= X-ClientProxiedBy: SJ0P220CA0004.NAMP220.PROD.OUTLOOK.COM (2603:10b6:a03:41b::9) To PAXPR04MB9642.eurprd04.prod.outlook.com (2603:10a6:102:240::14) Precedence: bulk X-Mailing-List: linux-pci@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PAXPR04MB9642:EE_|VI1PR04MB9787:EE_ X-MS-Office365-Filtering-Correlation-Id: f10a6c1c-985b-45c7-5a43-08dd47af6497 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|7416014|366016|376014|52116014|921020|38350700014; X-Microsoft-Antispam-Message-Info: =?utf-8?q?gLfEgSBfz3b79b7oUQs4wMg23eUHeLu?= =?utf-8?q?2x5o3Cpn74a49uzEIWrI1g+oaEBZoDkqmsbWgDpWyWkcZitXiOz+JqZZDtf38nUsM?= =?utf-8?q?+NTHoYQrnCTR2ixmTTj1m4zFkc48lC1T2JSPOYm6PyArC2ea4CCEg1vaW3/sJTSRc?= =?utf-8?q?rbqLUCoRDHj7ntJ6byd9znv6XowiJ1OshzO64eVAWNSba+FXERAmkdVyj/FfoCz2a?= =?utf-8?q?YwLuZ1s7TnxE9IILeUAeClc/TjqUsVSrGxeRMPGUyx0+OietFEv6l1i0wn/5ClKMd?= =?utf-8?q?x6httAMNWECLyFTQbhtLHP5ZgKmWlR0dmmDM4oDCU89xJxU4wNGaOTC/kFT/1yyTO?= =?utf-8?q?Rn6RgQmp0BKhNqEKSytV4GSFLjSORr6pWj1N18tRTydweeA9WoDlYIkdd8FQ5T53D?= =?utf-8?q?aEY95JjPnyqU6SzsH+dFW6CTo/0ImJwV8wu8n+2coQITc0WHPEE9nGVV7WbxsECma?= =?utf-8?q?Kd0I8MSJvsPH5xNT0ERsnxwjJUDKDbtv/CHgv1YR5OvquJzKawumy0Fheu4ObdCTP?= =?utf-8?q?Ael8QWYjIhS1ximK749J+T9KoiThdoH+3O2tq0k8AY4YbwQsWAvGwhL73SXD4fB5U?= =?utf-8?q?JGuadxEf7PbAqfftPYaa+gVj3BX128QOb48JNiKFKQTGSmprx+Qoy7g3IASGvcRYp?= =?utf-8?q?dkzHOs96quTTnIVMp8yObXKkmbcXGdubUEwP/pJ2xjJDozJMB1lm0ZrYyof7ac/i3?= =?utf-8?q?a7/TPID9PLtWgMV17svLElvG5mHude+7S0TGmoNhSHDDB+hibNrYhFHxImiDK1hQ+?= =?utf-8?q?x1kk1+qKx7qCCIGG6o+6nAsTZV+UwI195G2pZ3vDPfCn0sPh9bNhr4vVvrd4npJ3B?= =?utf-8?q?U2U548G0k2G5DnZ0LauIVztC2cxkcPoK/xaLnVk6m/9hAbA9x6Y71MO7jU+RXmUav?= =?utf-8?q?thRSH4eR1irpG0d9HLfAKAkL0AVuQLlAc7HN1Hxb3v4OGj9CEMa1PIGka816n9Qd/?= =?utf-8?q?VkwSPdPshZFu3t/4nLOPDJk8XdBGF835P5utNaSdLAzQTbLxifVig/Kcq2M3Suzai?= =?utf-8?q?axXkf59dWDvEQRie/oi4LfCMnNAsuAeXcKEYnnkW1xoiSrl7xv9epFppAlzz9+U+H?= =?utf-8?q?Y9k6ZfxZexx0IsD0kKIUOiwwQDu2r3q647ACleS5fZbkEkZylmOjbwcLhV73bZRlQ?= =?utf-8?q?aCalnl8iP+9eF0I32kSiDEiP4oVWTG2RyYePtEAuvLN+ueME83apN2BYPg0PClqci?= =?utf-8?q?J6/zYzxJn0YJF8jktWFf1i65rBjX60Cs0mukSeVorpXIvjQ5dRLl+LxItzw4G2cwc?= =?utf-8?q?xDnR1LnnCS526438YFrPm8UoJSpDGvTqOdS3dkKW2Bp1/IRtPKWWuwW6YtlEs+cKS?= =?utf-8?q?KmSIAQkhV39EGR6/DkFrJVRJZmgk3FfYaHranTRMmIuIAsQDOdyMFyQsXkHxPg4p6?= =?utf-8?q?ujKoOJQ2inAWbXBXHKV4OHOg6tBsIZ2JA=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PAXPR04MB9642.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(7416014)(366016)(376014)(52116014)(921020)(38350700014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?q?8HQz/YaXXLodGW64ze84prBOoQk9?= =?utf-8?q?902JMvLEtJrV4AnxYkvVRl1/2U4p260/mmt2bWKwVR80QwUhY+wyUJ5NT0X2pFjA+?= =?utf-8?q?fhh0wN3VvIDgNIR9b/VINR2IdtbtHVJDxW/yzdFGhzC/OWta8OQ551bFzj6wjZkKw?= =?utf-8?q?4Uin69ciHa4UnT8UCQBRzeOVjRyA2MKQIHGWAAvErywPtM/qPrltzg9SJdjOhK2SS?= =?utf-8?q?jZFNYlo2NCR/IjZ5nBgTc/gZz8IHD+/ryyzOkycuvlbMeIRMw8r0Hsn9ZbwGuiBdz?= =?utf-8?q?OeZcrrhPpYLtPNNzuVhPkzkL85TAESZ6jpZH0PKyf/PXll8lTMH0dlmmRviIyXTdk?= =?utf-8?q?P6EPwdXWinvlydmkV/yFQdovvhWKe6X6Jyvj7zehD0UsIvheaf2VC5jnjw7HC5D4c?= =?utf-8?q?9NoSYKUKBF9dG/Jo6ODnuyZi8xw0RLb5WN+2XBvKrlW+Zt/COF0ch8/e4gBHP1Loh?= =?utf-8?q?DzJaXCeEKimH3DVNYulp7bKH+zlatMq+WIgjvZ4URNsYDatCr5aru6CS0m77n8qJ7?= =?utf-8?q?sY6lgf+bHSzDE7UzzkSMe4drc57Qz+mG/lnC4SijhHHjim94Zw82v0IiUYqDSECdX?= =?utf-8?q?o6hybB9doLYWeHLZpbhKIqUKCLVM1RyfgoyK2574yK10VbrxzKxJ+sdAYHGhe9sPo?= =?utf-8?q?sbk8ANGOQt+o1RP2tgjU2MTpb382novBVHb3aWfNYrK7HrAClj3KlMoYi/MooeXyc?= =?utf-8?q?O2MmUAZw4P0NO1us/mUffImuQwuIr3D0S/xSX2mqVdgHmxBcs+S8DdOwDmaEWSDKM?= =?utf-8?q?QrHaTYmWok00ibtYimGXk4dzyof2KbMVIYIhKMXCSKSxklDl4gXJIt1Bb+f9RC6Cc?= =?utf-8?q?I6eVVoPgZv3+rdaV1lOAF8ALJVdjDD7AY1zWt2Sbx6vJff4zOC4HjO09DzBjlCgwz?= =?utf-8?q?c2kCH++MfW3owFm1EHTrlKmFCvgrYXWudjQZdxNfuyO5CvDbBnHEcwTOvyLWPXC5l?= =?utf-8?q?mf75TEDzu6dn0fbaIleQnaUi8igpVjvdf2bAwwrGCcJL7LQfygcCGFK75JQheAS6l?= =?utf-8?q?Pxu2xzXChkToO15aWeIh+C3cg9jPfkWVmjIfXk+zpeLN7V9XNiDfax6G1cSQ7b7N2?= =?utf-8?q?yqQ0mlLmP0EFoUp1oYkTG3sAtcPTfmTphRwDO0b4hQAxbV0x1fnj4uHfPC5rN/99y?= =?utf-8?q?pn5pe5ykwrG8XOcHRrKchBV4vMcJgJoK42VJR8qaKlsQWbvbiuinJnzhfWnIB44Sn?= =?utf-8?q?fdn3AXd2A6hwvDDuGIh197VbVsXVtOQuKQ0cYOx4EDNlVwW06CwOB7yF+ONWiDJSV?= =?utf-8?q?JUdWf44P95hKY0rPF6PquIlJffCyLkYS9qSVVkLqDJxx+HEx4xFBdkWMOxkc3sryY?= =?utf-8?q?qgCyFMwfwUHzlHt2MqOf0jDPXOrXtS58xH96/er8PaDa9fcEo9PXv6VexQl2GrD3Y?= =?utf-8?q?pVExex8kmI74judOns7a78DmRecWoik3TicY3T1Xzz/2tLoihSnmBVdxLkb+v5N95?= =?utf-8?q?Z0m79zuKHfVT7UwY8d6q6ahsLaJ67rWBonmAiJ11tjSR0Ckt2l+BdsbxA8tpr9B4p?= =?utf-8?q?/D2Ve88c2TRZ?= X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: f10a6c1c-985b-45c7-5a43-08dd47af6497 X-MS-Exchange-CrossTenant-AuthSource: PAXPR04MB9642.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Feb 2025 19:41:19.0625 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 6NJG8ZT1zdZYgogazv8+c41VrBv0X0UNu8dWfL3Wm9OEWC2oALup5M+e/S5pX5qVIz1K1RB8KY8Gp5xT+mKRnQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR04MB9787 Add three registers: doorbell_bar, doorbell_addr, and doorbell_data. Use pci_epf_alloc_doorbell() to allocate a doorbell address space. Enable the Root Complex (RC) side driver to trigger pci-epc-test's doorbell callback handler by writing doorbell_data to the mapped doorbell_bar's address space. Set STATUS_DOORBELL_SUCCESS in the doorbell callback to indicate completion. Avoid breaking compatibility between host and endpoint, add new command COMMAND_ENABLE_DOORBELL and COMMAND_DISABLE_DOORBELL. Host side need send COMMAND_ENABLE_DOORBELL to map one bar's inbound address to MSI space. the command COMMAND_DISABLE_DOORBELL to recovery original inbound address mapping. Host side new driver Host side old driver EP: new driver S F EP: old driver F F S: If EP side support MSI, 'pci_endpoint_test -f pcie_ep_doorbell' return success. If EP side doesn't support MSI, the same to 'F'. F: 'pci_endpoint_test -f pcie_ep_doorbell' return failure, other case as usual. Tested-by: Niklas Cassel Signed-off-by: Frank Li --- Change from v9 to v14 - update commit message by use pci_endpoint_test -f pcie_ep_doorbell Change from v8 to v9 - move pci_epf_alloc_doorbell() into pci_epf_{enable/disable}_doorbell(). - remove doorbell_done in commit message. - rename pci_epf_{enable/disable}_doorbell() to pci_epf_test_{enable/disable}_doorbell() to align corrent code style. Change from v7 to v8 - rename to pci_epf_align_inbound_addr_lo_hi() Change from v6 to v7 - use help function pci_epf_align_addr_lo_hi() Change from v5 to v6 - rename doorbell_addr to doorbell_offset Chagne from v4 to v5 - Add doorbell free at unbind function. - Move msi irq handler to here to more complex user case, such as differece doorbell can use difference handler function. - Add Niklas's code to handle fixed bar's case. If need add your signed-off tag or co-developer tag, please let me know. change from v3 to v4 - remove revid requirement - Add command COMMAND_ENABLE_DOORBELL and COMMAND_DISABLE_DOORBELL. - call pci_epc_set_bar() to map inbound address to MSI space only at COMMAND_ENABLE_DOORBELL. --- drivers/pci/endpoint/functions/pci-epf-test.c | 132 ++++++++++++++++++++++++++ 1 file changed, 132 insertions(+) diff --git a/drivers/pci/endpoint/functions/pci-epf-test.c b/drivers/pci/endpoint/functions/pci-epf-test.c index b94e205ae10b9..bba1229c46f14 100644 --- a/drivers/pci/endpoint/functions/pci-epf-test.c +++ b/drivers/pci/endpoint/functions/pci-epf-test.c @@ -11,12 +11,14 @@ #include #include #include +#include #include #include #include #include #include +#include #include #define IRQ_TYPE_INTX 0 @@ -29,6 +31,8 @@ #define COMMAND_READ BIT(3) #define COMMAND_WRITE BIT(4) #define COMMAND_COPY BIT(5) +#define COMMAND_ENABLE_DOORBELL BIT(6) +#define COMMAND_DISABLE_DOORBELL BIT(7) #define STATUS_READ_SUCCESS BIT(0) #define STATUS_READ_FAIL BIT(1) @@ -39,6 +43,11 @@ #define STATUS_IRQ_RAISED BIT(6) #define STATUS_SRC_ADDR_INVALID BIT(7) #define STATUS_DST_ADDR_INVALID BIT(8) +#define STATUS_DOORBELL_SUCCESS BIT(9) +#define STATUS_DOORBELL_ENABLE_SUCCESS BIT(10) +#define STATUS_DOORBELL_ENABLE_FAIL BIT(11) +#define STATUS_DOORBELL_DISABLE_SUCCESS BIT(12) +#define STATUS_DOORBELL_DISABLE_FAIL BIT(13) #define FLAG_USE_DMA BIT(0) @@ -63,6 +72,7 @@ struct pci_epf_test { bool dma_supported; bool dma_private; const struct pci_epc_features *epc_features; + struct pci_epf_bar db_bar; }; struct pci_epf_test_reg { @@ -77,6 +87,9 @@ struct pci_epf_test_reg { u32 irq_number; u32 flags; u32 caps; + u32 doorbell_bar; + u32 doorbell_offset; + u32 doorbell_data; } __packed; static struct pci_epf_header test_header = { @@ -645,6 +658,116 @@ static void pci_epf_test_raise_irq(struct pci_epf_test *epf_test, } } +static irqreturn_t pci_epf_test_doorbell_handler(int irq, void *data) +{ + struct pci_epf_test *epf_test = data; + enum pci_barno test_reg_bar = epf_test->test_reg_bar; + struct pci_epf_test_reg *reg = epf_test->reg[test_reg_bar]; + + reg->status |= STATUS_DOORBELL_SUCCESS; + pci_epf_test_raise_irq(epf_test, reg); + + return IRQ_HANDLED; +} + +static void pci_epf_test_doorbell_cleanup(struct pci_epf_test *epf_test) +{ + struct pci_epf_test_reg *reg = epf_test->reg[epf_test->test_reg_bar]; + struct pci_epf *epf = epf_test->epf; + + if (reg->doorbell_bar > 0) { + free_irq(epf->db_msg[0].virq, epf_test); + reg->doorbell_bar = NO_BAR; + } + + if (epf->db_msg) + pci_epf_free_doorbell(epf); +} + +static void pci_epf_test_enable_doorbell(struct pci_epf_test *epf_test, + struct pci_epf_test_reg *reg) +{ + struct pci_epf *epf = epf_test->epf; + struct pci_epc *epc = epf->epc; + struct msi_msg *msg; + enum pci_barno bar; + size_t offset; + int ret; + + ret = pci_epf_alloc_doorbell(epf, 1); + if (ret) { + reg->status |= STATUS_DOORBELL_ENABLE_FAIL; + return; + } + + msg = &epf->db_msg[0].msg; + bar = pci_epc_get_next_free_bar(epf_test->epc_features, epf_test->test_reg_bar + 1); + if (bar < BAR_0 || bar == epf_test->test_reg_bar || !epf->db_msg) { + reg->status |= STATUS_DOORBELL_ENABLE_FAIL; + return; + } + + ret = request_irq(epf->db_msg[0].virq, pci_epf_test_doorbell_handler, 0, + "pci-test-doorbell", epf_test); + if (ret) { + dev_err(&epf->dev, + "Failed to request irq %d, doorbell feature is not supported\n", + epf->db_msg[0].virq); + reg->status |= STATUS_DOORBELL_ENABLE_FAIL; + pci_epf_test_doorbell_cleanup(epf_test); + return; + } + + reg->doorbell_data = msg->data; + reg->doorbell_bar = bar; + + msg = &epf->db_msg[0].msg; + ret = pci_epf_align_inbound_addr(epf, bar, ((u64)msg->address_hi << 32) | msg->address_lo, + &epf_test->db_bar.phys_addr, &offset); + + if (ret) { + reg->status |= STATUS_DOORBELL_ENABLE_FAIL; + pci_epf_test_doorbell_cleanup(epf_test); + return; + } + + reg->doorbell_offset = offset; + + epf_test->db_bar.barno = bar; + epf_test->db_bar.size = epf->bar[bar].size; + epf_test->db_bar.flags = epf->bar[bar].flags; + + ret = pci_epc_set_bar(epc, epf->func_no, epf->vfunc_no, &epf_test->db_bar); + if (ret) { + reg->status |= STATUS_DOORBELL_ENABLE_FAIL; + pci_epf_test_doorbell_cleanup(epf_test); + } else { + reg->status |= STATUS_DOORBELL_ENABLE_SUCCESS; + } +} + +static void pci_epf_test_disable_doorbell(struct pci_epf_test *epf_test, + struct pci_epf_test_reg *reg) +{ + enum pci_barno bar = reg->doorbell_bar; + struct pci_epf *epf = epf_test->epf; + struct pci_epc *epc = epf->epc; + int ret; + + if (bar < BAR_0 || bar == epf_test->test_reg_bar || !epf->db_msg) { + reg->status |= STATUS_DOORBELL_DISABLE_FAIL; + return; + } + + ret = pci_epc_set_bar(epc, epf->func_no, epf->vfunc_no, &epf->bar[bar]); + if (ret) + reg->status |= STATUS_DOORBELL_DISABLE_FAIL; + else + reg->status |= STATUS_DOORBELL_DISABLE_SUCCESS; + + pci_epf_test_doorbell_cleanup(epf_test); +} + static void pci_epf_test_cmd_handler(struct work_struct *work) { u32 command; @@ -691,6 +814,14 @@ static void pci_epf_test_cmd_handler(struct work_struct *work) pci_epf_test_copy(epf_test, reg); pci_epf_test_raise_irq(epf_test, reg); break; + case COMMAND_ENABLE_DOORBELL: + pci_epf_test_enable_doorbell(epf_test, reg); + pci_epf_test_raise_irq(epf_test, reg); + break; + case COMMAND_DISABLE_DOORBELL: + pci_epf_test_disable_doorbell(epf_test, reg); + pci_epf_test_raise_irq(epf_test, reg); + break; default: dev_err(dev, "Invalid command 0x%x\n", command); break; @@ -953,6 +1084,7 @@ static void pci_epf_test_unbind(struct pci_epf *epf) pci_epf_test_clean_dma_chan(epf_test); pci_epf_test_clear_bar(epf); } + pci_epf_test_doorbell_cleanup(epf_test); pci_epf_test_free_space(epf); }