From patchwork Tue Feb 4 13:54:04 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mykyta Poturai X-Patchwork-Id: 13959283 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id DA52CC0219B for ; Tue, 4 Feb 2025 13:54:19 +0000 (UTC) Received: from list by lists.xenproject.org with outflank-mailman.881484.1291666 (Exim 4.92) (envelope-from ) id 1tfJNT-00005F-M1; Tue, 04 Feb 2025 13:54:11 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 881484.1291666; Tue, 04 Feb 2025 13:54:11 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1tfJNT-0008Uq-Eq; Tue, 04 Feb 2025 13:54:11 +0000 Received: by outflank-mailman (input) for mailman id 881484; Tue, 04 Feb 2025 13:54:11 +0000 Received: from se1-gles-flk1-in.inumbo.com ([94.247.172.50] helo=se1-gles-flk1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1tfJNS-0007bp-RW for xen-devel@lists.xenproject.org; Tue, 04 Feb 2025 13:54:10 +0000 Received: from EUR03-DBA-obe.outbound.protection.outlook.com (mail-dbaeur03on20630.outbound.protection.outlook.com [2a01:111:f403:260d::630]) by se1-gles-flk1.inumbo.com (Halon) with ESMTPS id 81bd75d7-e2ff-11ef-99a4-01e77a169b0f; Tue, 04 Feb 2025 14:54:09 +0100 (CET) Received: from PAVPR03MB10102.eurprd03.prod.outlook.com (2603:10a6:102:30d::12) by AS8PR03MB10120.eurprd03.prod.outlook.com (2603:10a6:20b:57f::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8398.24; Tue, 4 Feb 2025 13:54:04 +0000 Received: from PAVPR03MB10102.eurprd03.prod.outlook.com ([fe80::35ac:8893:c31c:b971]) by PAVPR03MB10102.eurprd03.prod.outlook.com ([fe80::35ac:8893:c31c:b971%7]) with mapi id 15.20.8398.021; Tue, 4 Feb 2025 13:54:04 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 81bd75d7-e2ff-11ef-99a4-01e77a169b0f ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Sp1p61tVokaBL06B1HQvSy9aVcEX1YZMc2tCv8/DYRzH2pcxp/5gOTVMnCQf/SdiSI5uLKRNptmMj+G8nPwwFyFzqgKVasKUquH9w9hYeMotKdFmGOjgaR4Jj14BC1kaXUxB6hpYlJ/ejMHAACrw6lTYgsi41WUCsdugEezVIHPaNS7Hb7UAt3Kie4Ijxj+Xc4EzZqP8WDrWMg1ZsR8Q6XGL6hlSsulm9u0YTFhTXb9zLZ5mADfn9lCaN78GmSbbbF02ucXzGfWKOCWCw6IokPf9wKY6zn7PGL/z6dwKk5cYDI0TjnW5BLzw9VZs9He0Wfhf1soMhEb4zzuJIfFt/w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fSwUIuX/M6++bKUnXBVsSIP1yPfNpCUPLwGuNZ2HAX0=; b=jMTfQg/RbWyNeIp4aSu0yD3JWS1jlnQmtstTxWrdzA1L2cdRGa7ZcHkdowvS8CkGDAmeigtT9RP4+69YhHMxdzL3hk2BZP/WraNGhAGkF21fKrRjuBsko4fgrKW2q36CC00J1RFuifHXzDCJmLMC2suOmU9mJl77MGFS3twDJu3ijgWv8wj7i+E61maw63/W6RZ9b8oAI/I3lgmIZFe5PyLMY3KfRkfxML/LJ/MGfLOSwriLn/QXpJvRWozlMIod/W8Ppyru5p5nR5yQegD7CP55Wg2HJLu0PfNrxLgoDY0hGca+TGb2TtJu10pfeuSxYQClvpoA8VRBnaNVcGtxvQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=epam.com; dmarc=pass action=none header.from=epam.com; dkim=pass header.d=epam.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=epam.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fSwUIuX/M6++bKUnXBVsSIP1yPfNpCUPLwGuNZ2HAX0=; b=GSGAgOHj7n+McKeo3o63qiu+oYO2rltkf06PaySXHpA2fJMYHy1d7QWQq044mjh/xSlc75XXp8ij7IOcZI0piJvlkh4dL+TYrfnYOPqhD/Ee9rwpLAmP35rO6rVtDeoq6z2dkfZMRyOFqWXtuSr2pO+bSFBP/4EdGqOF6CxU7+TJ1aDPJpfO+1OJAZuSFX4VUvMg41zsh8OwKLatsOfiHC8mwToSmfU1HQs1RoPyEvDEcbmM6Vhfb1zSPkDbw+I4YyOk45AEj9sKC/lpp1Zm2b4dmyzwh4CFXR5BMJVYwojNvkykT0MLce9m0tvm9Q+R1yRngsmtJ1AhDHXBm/3v6g== From: Mykyta Poturai To: "xen-devel@lists.xenproject.org" CC: Stewart Hildebrand , Rahul Singh , Bertrand Marquis , Stefano Stabellini , Julien Grall , Michal Orzel , Volodymyr Babchuk , Mykyta Poturai Subject: [PATCH v7 5/8] xen/arm: smmuv3: Add PCI devices support for SMMUv3 Thread-Topic: [PATCH v7 5/8] xen/arm: smmuv3: Add PCI devices support for SMMUv3 Thread-Index: AQHbdwxAgXXfAs39tUOCWD0oIla8JQ== Date: Tue, 4 Feb 2025 13:54:04 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=epam.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PAVPR03MB10102:EE_|AS8PR03MB10120:EE_ x-ms-office365-filtering-correlation-id: 008fadee-28c0-47d8-916e-08dd4523631e x-ld-processed: b41b72d0-4e9f-4c26-8a69-f949f367c91d,ExtAddr x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0;ARA:13230040|1800799024|376014|366016|38070700018; x-microsoft-antispam-message-info: =?iso-8859-1?q?YufnP8kIm9mQpl9Ocso8U/6yzY?= =?iso-8859-1?q?CLLk91lgIgWnuwJORFd2EG8yRriRT/X2uxbLmgdp94m4pkcNb3VXFPFTHFhx?= =?iso-8859-1?q?4YtxPvoJocPdd8osIZ09cUCx2GSIvtqO7g6Xu/g2j5kYhFs6JGj16/sVVntu?= =?iso-8859-1?q?F9Qo9n6OV5Zt58ONPMfW+StJ8nT3jLuU/pZP4FGQiSjo9xIwFMZLwIZSAxfb?= =?iso-8859-1?q?mQGw4Rqkve128DGq9ebUXyn+vPebbyavt+vMtjSRlt5MmcYX4JJGn20l6UME?= =?iso-8859-1?q?AYwup5EWDT/40BtM1N1oC2/nJqmaMr9NGhMIDc5W++MUY7h9aYn1Txp2frXh?= =?iso-8859-1?q?Ln/amkGKcIZZ0J0mLXnguKJJOzeZSCi2TXlQdCED2RKTI+7M7Za/7fvMTZIz?= =?iso-8859-1?q?W6aWzDvwSYPg1O5S7aurmQ4Xorwa1yitTQtke7nW/B+UwYkSX8uuI18E5AjS?= =?iso-8859-1?q?Pzvywi4Mhcz5LfsqhUN5tkm3kLMqQBQ2s5/o03xPZ9JUODXXFza+Q+hiCzaV?= =?iso-8859-1?q?4xpX7TfXfCy65CMN7Y3fK6hyoEGhRF26kH7wbl5frTQRf41qQJMuHwmp/nO0?= =?iso-8859-1?q?XVMTJguVJXy5S0qWFBQ+tjAWca+bIEdFcQ/DLeEorcM3UJTmv9z6u4/Vp23g?= =?iso-8859-1?q?EC3nX1WlzFyxNYPJlTlGd+GKoZK03Mezrn7OIDV196wYRtgxhB+GCQhFkAxF?= =?iso-8859-1?q?rZIPYv28h6UBsXQLa5A5hZLTNs5RHtSDf47342xFbbQzDki1DwgJMnsCm/40?= =?iso-8859-1?q?hdhgSOWULUlG121fhbvSBmSFHXQ27KR3GNgpamFK3juZwGyLQnXFa+dFaC2E?= =?iso-8859-1?q?vT2oZI8VVaRzqnW7ojLddoxuM6XtWnmcC11tM/IL8adUB+lWGy1JcLZlTVMV?= =?iso-8859-1?q?03ETUJio/0SOS5Pvegw/zrW1tBZy2NgiSXiilaMxfk2tm534iLwSqyyLXTA1?= =?iso-8859-1?q?VZpYnNWtHMN7PWgFYhVRnIeVjOvpVKlF61FTF4yA9IHTFTXAHBXeZsqSurFd?= =?iso-8859-1?q?qJbmrVVE6n/MFcjQhAKsVcc2wGKGcCi6sZydiLYlbpt46ZQKm/uQu8SacZZP?= =?iso-8859-1?q?cAGbNGjZ7Cl8DTaDVW5kKtmGHbgAX7IrSZPx8d0sLgc5ejhHUVCksjBRLLf/?= =?iso-8859-1?q?FKzPz6dmCaD8YSYQRrAfi2WZUq/Z3X0sfrQoMzT0L+X29nQVuln1X2zTqoXy?= =?iso-8859-1?q?qQ5J/48mAu8CEWp6bq4YdW2oH+n/VYYijOhHby/NDJRLon7VKW1jDygNviTM?= =?iso-8859-1?q?mfrY1ocOISWLl07RGuNtwu1RDBJgp4DWmtkil6cYHR0nfA337CKPL/AA/xQz?= =?iso-8859-1?q?1GT5Hq4sYY0+cEQrs0GGgeNgp9pHF9gVrmb3j/TMC29Mv5n/YFD4nN7o3u3W?= =?iso-8859-1?q?o95MFQ19Ls90XvUfdpCaCR5nMyhaQcX0pb1/nODgLPi7ghWg4UsWjIgI2KGR?= =?iso-8859-1?q?m6WPCrcen2xMzUwlKqoG+WjYyqEoo+bh/xrAGquv5P6e1yUOiAHPu7MKe/3M?= =?iso-8859-1?q?E+/E7O?= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PAVPR03MB10102.eurprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(366016)(38070700018);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?q?kJ56hI5vUuFlXndZFRuE4GW?= =?iso-8859-1?q?duZrmR9MqhBhgUfH63kVKAsHf8bK4GRyjxYoExipN/jrjRHYHX/OmTh5igne?= =?iso-8859-1?q?icNP20l94Z+D3jCueteZNnhbDM59bSHUKqm38SDzDfu/wUtsg6vBAIa+eGFC?= =?iso-8859-1?q?ue23zsUX6QEmq25n0rtyH0mGg2rDhrULetzAAVd0BwHNnCYTWfGIty53Pik/?= =?iso-8859-1?q?xmDlSGtFTnq5DIxqxaDhWVl0KiWi6yUNvW3g6jea+gsshDzSHHaF0VApzV08?= =?iso-8859-1?q?u4ChBpJ48Z/rt7BJS/AQjB8O+3otpKT/5iJBqDxp+FrFOOb54kY2nMIiukcM?= =?iso-8859-1?q?qFneuKbAEWDsWIezAHIH1siUu43s/ys4i4afQUg+cgUxLYUaAP8wDvlbSJR2?= =?iso-8859-1?q?F06pdzxwV5UmjdmyLU1cl5LBNqtt3wbMTTsVXjKDNnHpI4U9hptC/TO7wLFv?= =?iso-8859-1?q?qXYQss271S4o/VD4aW/YlJ+Zk0iVD2kuahZrioTgr0VkRH0I6BXIQPXIg2Ub?= =?iso-8859-1?q?l8tVATHzsrBLsyHJW0nAWXyuR8AW60Ui+ooUPtzOO2dP8GbletaS8sz5lQso?= =?iso-8859-1?q?9+3r+OkwDJa9+VqLObHT5ySbDMxwIZLS6ZNgLKCJqF4LtF3yvcsptqt3LPAr?= =?iso-8859-1?q?wD6/PREelrB7speWe3PEeD9CIiYecdYnMUn1Fg+LoIMH1o0RA/ixyumioy9w?= =?iso-8859-1?q?7eMRAuuMY/MpqmtoGMchZgGW8syYnM2NsXpXfFBgbbOuewCYUo939qyQovan?= =?iso-8859-1?q?qKgt/Ggt8mTjtwPd9l6Ze+w9EGCZAqmAyO1eS4xynmfuk+3PjGpyzRnL6fhE?= =?iso-8859-1?q?syinzZxWcfnsYcLxAOyf92mFXrAKjJNsgOZTE8JZH5IovGVqzHeaXAo0cdhY?= =?iso-8859-1?q?pDHIdi0ZNAjaId0UPwrjYya50ZZTXRvi+L1gPpFWG9NdjDJOqnbRePJ6V7uN?= =?iso-8859-1?q?lJAnbbDNYMAdPWYzF1jX9BOi6IEevjRrl4+ifH4UFNFEQANnhfQYTUNQQGIS?= =?iso-8859-1?q?1MG5VFJim9Nf9nN8OpFCwp89VG02ewjdVyJShIBCd8+YRSpJMPXzbo/ihbYQ?= =?iso-8859-1?q?WXmf9mUfctrpFnKCqnFaXGqPWuJd4RQ+LtLmB55WtDSs99H/CtGGPdEGodqn?= =?iso-8859-1?q?skMOTG5iqKm13U3jQtkJwnRNgXJMOmv78MEsIinrQV3es7Ihv/emPy2u7EeJ?= =?iso-8859-1?q?Zl70CFA+Zp8FdhtEkec+iSvwTgUyHCZxRnXuvntZAKcfZknNvYQwkNU46Esz?= =?iso-8859-1?q?TW3RiT1ZeVl0on6FAIorIyhDfCYfNzLs7nYRzN7N/GYODzYipSEud+jfFJEz?= =?iso-8859-1?q?Te1+ycASCkoizZMlrzboACwF43lcjl+KynXU/ZW2CJdeIMjMwkwehmCgqcPo?= =?iso-8859-1?q?+uA7rdenDpD28KrgwVjJztljX+SaiUIDQ+tV6m505ijGC/oPbWSO52DS0HRg?= =?iso-8859-1?q?0rNZWKoNQxYF+cN5SnvYUlBDcfY7n37J+YyI5Shsb0X3Pj/OxK940nTHZ24h?= =?iso-8859-1?q?pVWYgisaUKInS6Rm0PREeJgi/YFRf4tB9rYwu73KnTLz3ZyobnO/YQKwxqnU?= =?iso-8859-1?q?V2mDVpeO/9Yjkg55904hVgNGjnJtq8IRRexg6o91o9jmF79UEErGAT9BLeAv?= =?iso-8859-1?q?1q0/qqxX82e68MZzzorBhq1xnD1XrBNRyS/52Qw=3D=3D?= MIME-Version: 1.0 X-OriginatorOrg: epam.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PAVPR03MB10102.eurprd03.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 008fadee-28c0-47d8-916e-08dd4523631e X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Feb 2025 13:54:04.0604 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: b41b72d0-4e9f-4c26-8a69-f949f367c91d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: h11mjg/UeGn0vqBjmuOB4Nnt9yWTkKxtQIRGX9l/GAdByIqONwDaDqpUn+YdUGQPuk9jDXPBIFJMScO8QZxCPA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8PR03MB10120 From: Rahul Singh Implement support for PCI devices in the SMMU driver. Trigger iommu-map parsing when new PCI device is added. Add checks to assign/deassign functions to ensure PCI devices are handled correctly. Implement basic quarantining. All pci devices are automatically assigned to hardware domain if it exists to ensure it can probe them. TODO: Implement scratch page quarantining support. Signed-off-by: Rahul Singh Signed-off-by: Stewart Hildebrand Signed-off-by: Mykyta Poturai --- v6->v7: * address TODO: use d->pci_lock in arm_smmu_assign_dev() * remove !is_hardware_domain and pdev->domain == d checks in assign to support future dom0less use case when dom0 is using vPCI * check if pdev->domain exists before assigning to it * don't print "" * change assign logic to remove reassign reimplementation * explain pdev->devfn check * make reassign check stricter and update comment v5->v6: * check for hardware_domain == NULL (dom0less test case) * locking: assign pdev->domain before list_add() v4->v5: * deassign from hwdom * add TODO regarding locking * fixup after dropping ("xen/arm: Move is_protected flag to struct device") v3->v4: * no change v2->v3: * rebase * invoke iommu_add_pci_sideband_ids() from add_device hook v1->v2: * ignore add_device/assign_device/reassign_device calls for phantom functions (i.e. devfn != pdev->devfn) downstream->v1: * rebase * move 2 replacements of s/dt_device_set_protected(dev_to_dt(dev))/device_set_protected(dev)/ from this commit to ("xen/arm: Move is_protected flag to struct device") so as to not break ability to bisect * adjust patch title (remove stray space) * arm_smmu_(de)assign_dev: return error instead of crashing system * remove arm_smmu_remove_device() stub * update condition in arm_smmu_reassign_dev * style fixup (cherry picked from commit 7ed6c3ab250d899fe6e893a514278e406a2893e8 from the downstream branch poc/pci-passthrough from https://gitlab.com/xen-project/people/bmarquis/xen-arm-poc.git) --- xen/drivers/passthrough/arm/smmu-v3.c | 117 +++++++++++++++++++++++--- 1 file changed, 106 insertions(+), 11 deletions(-) diff --git a/xen/drivers/passthrough/arm/smmu-v3.c b/xen/drivers/passthrough/arm/smmu-v3.c index cee5724022..9c7c13f800 100644 --- a/xen/drivers/passthrough/arm/smmu-v3.c +++ b/xen/drivers/passthrough/arm/smmu-v3.c @@ -1467,14 +1467,35 @@ static bool arm_smmu_sid_in_range(struct arm_smmu_device *smmu, u32 sid) } /* Forward declaration */ static struct arm_smmu_device *arm_smmu_get_by_dev(const struct device *dev); +static int arm_smmu_assign_dev(struct domain *d, u8 devfn, struct device *dev, + u32 flag); +static int arm_smmu_deassign_dev(struct domain *d, uint8_t devfn, + struct device *dev); static int arm_smmu_add_device(u8 devfn, struct device *dev) { int i, ret; struct arm_smmu_device *smmu; struct arm_smmu_master *master; - struct iommu_fwspec *fwspec = dev_iommu_fwspec_get(dev); + struct iommu_fwspec *fwspec; + +#ifdef CONFIG_HAS_PCI + if ( dev_is_pci(dev) ) + { + struct pci_dev *pdev = dev_to_pci(dev); + int ret; + + /* Ignore calls for phantom functions */ + if ( devfn != pdev->devfn ) + return 0; + + ret = iommu_add_pci_sideband_ids(pdev); + if ( ret < 0 ) + iommu_fwspec_free(dev); + } +#endif + fwspec = dev_iommu_fwspec_get(dev); if (!fwspec) return -ENODEV; @@ -1519,17 +1540,38 @@ static int arm_smmu_add_device(u8 devfn, struct device *dev) */ arm_smmu_enable_pasid(master); - if (dt_device_is_protected(dev_to_dt(dev))) { - dev_err(dev, "Already added to SMMUv3\n"); - return -EEXIST; - } + if ( !dev_is_pci(dev) ) + { + if (dt_device_is_protected(dev_to_dt(dev))) { + dev_err(dev, "Already added to SMMUv3\n"); + return -EEXIST; + } - /* Let Xen know that the master device is protected by an IOMMU. */ - dt_device_set_protected(dev_to_dt(dev)); + /* Let Xen know that the master device is protected by an IOMMU. */ + dt_device_set_protected(dev_to_dt(dev)); + } dev_info(dev, "Added master device (SMMUv3 %s StreamIds %u)\n", dev_name(fwspec->iommu_dev), fwspec->num_ids); +#ifdef CONFIG_HAS_PCI + if ( dev_is_pci(dev) ) + { + struct pci_dev *pdev = dev_to_pci(dev); + + /* + * During PHYSDEVOP_pci_device_add, Xen does not assign the + * device, so we must do it here. + */ + if ( pdev->domain ) + { + ret = arm_smmu_assign_dev(pdev->domain, devfn, dev, 0); + if (ret) + goto err_free_master; + } + } +#endif + return 0; err_free_master: @@ -2622,6 +2664,42 @@ static int arm_smmu_assign_dev(struct domain *d, u8 devfn, struct arm_smmu_domain *smmu_domain; struct arm_smmu_xen_domain *xen_domain = dom_iommu(d)->arch.priv; +#ifdef CONFIG_HAS_PCI + if ( dev_is_pci(dev) ) + { + struct pci_dev *pdev = dev_to_pci(dev); + + /* Ignore calls for phantom functions */ + if ( devfn != pdev->devfn ) + return 0; + + ASSERT(pcidevs_locked()); + + write_lock(&pdev->domain->pci_lock); + list_del(&pdev->domain_list); + write_unlock(&pdev->domain->pci_lock); + + pdev->domain = d; + + write_lock(&d->pci_lock); + list_add(&pdev->domain_list, &d->pdev_list); + write_unlock(&d->pci_lock); + + /* dom_io is used as a sentinel for quarantined devices */ + if ( d == dom_io ) + { + struct arm_smmu_master *master = dev_iommu_priv_get(dev); + if ( !iommu_quarantine ) + return 0; + + if ( master && master->domain ) + arm_smmu_deassign_dev(master->domain->d, devfn, dev); + + return 0; + } + } +#endif + spin_lock(&xen_domain->lock); /* @@ -2655,7 +2733,7 @@ out: return ret; } -static int arm_smmu_deassign_dev(struct domain *d, struct device *dev) +static int arm_smmu_deassign_dev(struct domain *d, uint8_t devfn, struct device *dev) { struct iommu_domain *io_domain = arm_smmu_get_domain(d, dev); struct arm_smmu_xen_domain *xen_domain = dom_iommu(d)->arch.priv; @@ -2667,6 +2745,21 @@ static int arm_smmu_deassign_dev(struct domain *d, struct device *dev) return -ESRCH; } +#ifdef CONFIG_HAS_PCI + if ( dev_is_pci(dev) ) + { + struct pci_dev *pdev = dev_to_pci(dev); + + /* Ignore calls for phantom functions */ + if ( devfn != pdev->devfn ) + return 0; + + /* dom_io is used as a sentinel for quarantined devices */ + if ( d == dom_io ) + return 0; + } +#endif + spin_lock(&xen_domain->lock); arm_smmu_detach_dev(master); @@ -2685,14 +2778,16 @@ static int arm_smmu_reassign_dev(struct domain *s, struct domain *t, { int ret = 0; - /* Don't allow remapping on other domain than hwdom */ - if ( t && !is_hardware_domain(t) ) + /* Don't allow remapping on other domain than hwdom + * or dom_io for PCI devices + */ + if ( t && !is_hardware_domain(t) && (t != dom_io || !dev_is_pci(dev)) ) return -EPERM; if (t == s) return 0; - ret = arm_smmu_deassign_dev(s, dev); + ret = arm_smmu_deassign_dev(s, devfn, dev); if (ret) return ret;