From patchwork Tue Aug 22 10:56:56 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Michael Shavit X-Patchwork-Id: 13360479 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 5F0DBEE4993 for ; Tue, 22 Aug 2023 10:58:20 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:Cc:To:From:Subject:Message-ID: Mime-Version:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To: References:List-Owner; bh=UBfttMnhRHt0v+OGCbu3Ah+YJECjk7RpyDKnf0J6qHE=; b=1JN aec69mW2F0DB0e27LlLLbe2Sir3L/M5SrKx/mIFFmt5k4gf+ITqFBbCQM6SFETVNnajz1n0Y4cM1h BbjL7QWoI8+f1FmDIYSoAr8LTJVw3pv+beulgRdUM+f4kAqiHmMppuLDiGWEcymZlXtsVzpkGCNFw 19WzY4Wlfe1QHDOlidzf+HR40qf+UT7+Gm6uMVsDL6VLzDp7SuIOzuVenF4yLc2Qqc540HBouU6uV sitN48D2AsuG47u+8q11pgBw82GoUdHSzyzXU8DzKbQCYgk0o0+ufAzFCftqMCB7ynF1a9kf7rUnU TBwwFBpUZ0yvScpYLgc8eEgg+8gHJmw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1qYP55-00FmFv-21; Tue, 22 Aug 2023 10:57:51 +0000 Received: from mail-yb1-xb4a.google.com ([2607:f8b0:4864:20::b4a]) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1qYP52-00FmEe-35 for linux-arm-kernel@lists.infradead.org; Tue, 22 Aug 2023 10:57:50 +0000 Received: by mail-yb1-xb4a.google.com with SMTP id 3f1490d57ef6-d74829dd58fso3542498276.1 for ; Tue, 22 Aug 2023 03:57:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20221208; t=1692701865; x=1693306665; h=cc:to:from:subject:message-id:mime-version:date:from:to:cc:subject :date:message-id:reply-to; bh=yaIwxFy9mjgti4zQ5aoiFMHcHMhpN0UMC2eNirEVgXw=; b=U+QLIzfY85x7N5zJe55CYeVHa7UA1i+UczMg9dvYKujxPDNarCECMejcMxSLbPpNtF kfNPsaorMLHV6QSsWX4k1hHPDIK+6lZwcXKoxgiQmhQ5pkiOyE+rZ96LyYZImVi0KHlR 07Kzd3d+99w+4X64z0/wt61ExkCswDlRf6KK2aosHRwbKHoueV1Fd/BhD9cKK/FK8enX rwWUDfiRRKxVWQzOaTReSWOqZaaAjSSKnQUTrFwJ3Eb1wG3aSMIlcJYB0icM5qgYsnEr e/Bnna+Rba0XEju0E6lsUmNppvsfWkoB2CbgwxjV6ZbXDbri1uTuFMQOdXdBChlCmxBV Q04Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692701865; x=1693306665; h=cc:to:from:subject:message-id:mime-version:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=yaIwxFy9mjgti4zQ5aoiFMHcHMhpN0UMC2eNirEVgXw=; b=RkmjgGALOQW316O4pWLShyGX3yaccCy0lThYZ1UP7qC5l16aLuIg9ozMx5qPYVXiAk QbM0ubA2mwJYNDYGGIgVWB8Ihyhw/na0D7SfNQOoyeIYhOCVUgLTpYMTMS9iextDzlfn Si/bYyBMs8C5b77ygPeaO/TT7/NFpSmPAIQmDFX9cwTN7rmH+cCGbw7tAdSnvHYkP81O 3ceGbOfe6cyWeYBiN6XG/HPbjipx+62o6qxst1RXj6EFh0uXhI+xhHP3jLJ8PP1sxKMF tz5IWRLh5BAgKstUJrOXdhJK4Yu9dGsu20ennX9IYdpCshvOYxuY8N54EMdgNw8M4TI3 RpFQ== X-Gm-Message-State: AOJu0Ywcwkb+ylTJsfmKKk3py+uMB4UaUs3aHRLwKWZsZ2nzo3lPCEAC bbzp64ZQaQBUDZoFEOBxmmHMaj0AVmV9 X-Google-Smtp-Source: AGHT+IE2hoZFp+1ccggEqlGvc9+61aaUJAGlZBTA9JoRO68qaIvofVbP/HhsQ2nzuG0YqKQPJfEEdWb0DB20 X-Received: from mshavit.ntc.corp.google.com ([2401:fa00:95:20c:44ad:3968:8aaa:c4fe]) (user=mshavit job=sendgmr) by 2002:a05:6902:1141:b0:d58:6cea:84de with SMTP id p1-20020a056902114100b00d586cea84demr113941ybu.11.1692701865015; Tue, 22 Aug 2023 03:57:45 -0700 (PDT) Date: Tue, 22 Aug 2023 18:56:56 +0800 Mime-Version: 1.0 X-Mailer: git-send-email 2.42.0.rc1.204.g551eb34607-goog Message-ID: <20230822105738.1607365-1-mshavit@google.com> Subject: [RFC PATCH v2 0/9] Install domain onto multiple smmus From: Michael Shavit To: iommu@lists.linux.dev, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org Cc: nicolinc@nvidia.com, tina.zhang@intel.com, jean-philippe@linaro.org, will@kernel.org, robin.murphy@arm.com, jgg@nvidia.com, Michael Shavit , Dawei Li , Jason Gunthorpe , Joerg Roedel , "Kirill A. Shutemov" , Lu Baolu , Mark Brown X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20230822_035748_998362_A6395AA8 X-CRM114-Status: GOOD ( 11.36 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi all, This series refactors the arm-smmu-v3 driver to support attaching domains onto masters belonging to different smmu devices. The main objective of this series is allow further refactorings of arm-smmu-v3-sva. Specifically, we'd like to reach the state where: 1. A single SVA domain is allocated per MM/ASID 2. arm-smmu-v3-sva's set_dev_pasid implementation directly attaches that SVA domain to different masters, regardless of whether those masters belong to different smmus. If armm-smmu-v3-sva is handed iommu_domains that have a 1:1 relationship with an MM struct, then it won't have to share a CD with multiple domains (or arm_smmu_mmu_notifiers). But to get there, the arm-smmu-v3 driver must first support domains installed on multiple SMMU devices. This series depends on the CD table ownership refactor: https://lore.kernel.org/all/20230816131925.2521220-1-mshavit@google.com/ as well as the VMID IDA patch: https://lore.kernel.org/all/169087904450.1290857.11726985177314533259.b4-ty@kernel.org/#r Thanks, Michael Shavit Changes in v2: - Moved the ARM_SMMU_FEAT_BTM changes into a new prepatory commit - Access the pgtbl_cfg from the pgtable_ops instead of storing a copy in the arm_smmu_domain. - Remove arm_smmu_installed_smmu structure, instead grouping masters attached to the same SMMU together in the smmu_domain->devices list. - Add a parameter to arm_smmu_tlb_inv_range_asid to make skipping of BTM capable devices explicit. - Moved VMID allocator to a global allocator instead of per-SMMU - Link to v1: https://lore.kernel.org/all/20230817182055.1770180-1-mshavit@google.com/ Michael Shavit (9): iommu/arm-smmu-v3: group attached devices by smmu iommu/arm-smmu-v3-sva: Move SVA optimization into arm_smmu_tlb_inv_range_asid iommu/arm-smmu-v3: Issue invalidations commands to multiple SMMUs iommu/arm-smmu-v3-sva: Allocate new ASID from installed_smmus iommu/arm-smmu-v3: Alloc vmid from global pool iommu/arm-smmu-v3: check smmu compatibility on attach iommu/arm-smmu-v3: Add arm_smmu_device as a parameter to domain_finalise iommu/arm-smmu-v3: check for domain initialization using pgtbl_ops iommu/arm-smmu-v3: allow multi-SMMU domain installs. .../iommu/arm/arm-smmu-v3/arm-smmu-v3-sva.c | 34 ++- drivers/iommu/arm/arm-smmu-v3/arm-smmu-v3.c | 277 +++++++++++++----- drivers/iommu/arm/arm-smmu-v3/arm-smmu-v3.h | 7 +- 3 files changed, 237 insertions(+), 81 deletions(-) base-commit: 6eaae198076080886b9e7d57f4ae06fa782f90ef prerequisite-patch-id: f701e5ac2cce085366342edff287a35d1cb82b9c prerequisite-patch-id: c8d21ff19c2c1dd18799a6b83f483add654d187e prerequisite-patch-id: 6ebba95cb12a723645843b4bd1bc45c94779d853 prerequisite-patch-id: 3f767e1c37d2996323c4f6d2a2d1912ab75281f7 prerequisite-patch-id: 5a4109fa3e22e2399ad064951c2ca1aeba4a68f7 prerequisite-patch-id: c4b3bd34b8be7afebd3e44bc4ec218d74753ce77 prerequisite-patch-id: 6d89e53518d25ac983ac99786950ee1a558c271f prerequisite-patch-id: 447219e565cadc34b03db05dad58d8e5c4b5a382 prerequisite-patch-id: 63adb2c3f97d4948d96a0d5960184f5ac814d7f7 prerequisite-patch-id: e71195fcf1aa56d8ef9d7403b9e4492c17b8fb84 prerequisite-patch-id: ba82add44850bf8fb271292020edb746aef93a65