From patchwork Tue Jan 16 13:25:39 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Jeffy Chen X-Patchwork-Id: 10167021 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id CD8BA60325 for ; Tue, 16 Jan 2018 13:45:03 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id BD0DA26255 for ; Tue, 16 Jan 2018 13:45:03 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id AE4B328485; Tue, 16 Jan 2018 13:45:03 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,RCVD_IN_DNSWL_MED autolearn=unavailable version=3.3.1 Received: from bombadil.infradead.org (bombadil.infradead.org [65.50.211.133]) (using TLSv1.2 with cipher AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id DDDB326255 for ; Tue, 16 Jan 2018 13:45:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:MIME-Version:Cc:List-Subscribe: List-Help:List-Post:List-Archive:List-Unsubscribe:List-Id:References: In-Reply-To:Message-Id:Date:Subject:To:From:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Owner; bh=sEAmxQaXGWMwCOIzwvpL7FW2MLEhNtqSqozKamHOXw0=; b=vC9eAkXu6fI3Ng3txFSlWhbMPK s9+aodBfc9yzzUqin8q3rWnqrgzm+fPxsvxOfonwr8V2H+mXyCkKStuQbwU4lWUDvmZp9ZZ6G/9Wo oKCeIhdlC2ZD7FRrxyiVPSrjd66g44NAa7WbatuP0HRg2lkCFx5gg+uqG0CHLVzmRwSEo1UerxSz8 GNxmupFo+Ycy9rwPQq01bTRk9Q/6UgP1BHu+m9u7hvRB/oSVv2WDmOWDs1Jm7EyExmPIw+Tai4KBQ R53hWO758EoKMfca1eZ4rOxCMwHZWa58OmAbPAoNrm+q25CgsxrU9o5nX1+g6Tqdxu46dj5zBK5O0 HRfqAdBQ==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.89 #1 (Red Hat Linux)) id 1ebRXv-0001V4-UC; Tue, 16 Jan 2018 13:44:59 +0000 Received: from merlin.infradead.org ([2001:8b0:10b:1231::1]) by bombadil.infradead.org with esmtps (Exim 4.89 #1 (Red Hat Linux)) id 1ebRXW-0000oC-Nh; Tue, 16 Jan 2018 13:44:34 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=merlin.20170209; h=References:In-Reply-To:Message-Id:Date: Subject:Cc:To:From:Sender:Reply-To:MIME-Version:Content-Type: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=R85USlE0TlctQfRTjlPqvqIA1Jntq34htmb3JE8SwPU=; b=3aK+LTSk5s25NMUNYbft7KYP1 p3+yS6QuyhV4kIivbxEYimXhyDCA36SNcVREvZiX9t5vysHTAUnc5c9+nfAGacv5SsQq9CZfpE5EH C9qmjeDCv6MGOLwBra5NEgisd4w0aUHbuou8Sh+rrehiWlUj1lJkq5gRVzBHdgvJUm1NILc90UtT8 19HUCRS8KJkD318NFl8YqapQYnCy61WBUuaSa9GroxBRiEZ2apiZtSuZmSsyukbG1Jjd6elX4liht ZhVUOHP+VIH2Mvs+/KRiK+A5C0OrKDnixe1QBob/8woI4ETKiG7DHYglnpljxYcyZxFvsx0PCZYUz vhGsygs+w==; Received: from regular1.263xmail.com ([211.150.99.138]) by merlin.infradead.org with esmtps (Exim 4.89 #1 (Red Hat Linux)) id 1ebRHF-0000fI-Ms; Tue, 16 Jan 2018 13:27:47 +0000 Received: from jeffy.chen?rock-chips.com (unknown [192.168.167.190]) by regular1.263xmail.com (Postfix) with ESMTP id 6DB037921; Tue, 16 Jan 2018 21:27:28 +0800 (CST) X-263anti-spam: KSV:0; X-MAIL-GRAY: 0 X-MAIL-DELIVERY: 1 X-KSVirus-check: 0 X-ABS-CHECKED: 4 Received: from localhost (localhost [127.0.0.1]) by smtp.263.net (Postfix) with ESMTPA id 0605D3C0; Tue, 16 Jan 2018 21:27:24 +0800 (CST) X-RL-SENDER: jeffy.chen@rock-chips.com X-FST-TO: linux-kernel@vger.kernel.org X-SENDER-IP: 103.29.142.67 X-LOGIN-NAME: jeffy.chen@rock-chips.com X-UNIQUE-TAG: <0dca3cf4280e68d625cd01cd52787668> X-ATTACHMENT-NUM: 0 X-SENDER: cjf@rock-chips.com X-DNS-TYPE: 0 Received: from localhost (unknown [103.29.142.67]) by smtp.263.net (Postfix) whith ESMTP id 19797RAVEYI; Tue, 16 Jan 2018 21:27:30 +0800 (CST) From: Jeffy Chen To: linux-kernel@vger.kernel.org Subject: [PATCH v2 12/13] iommu/rockchip: Add runtime PM support Date: Tue, 16 Jan 2018 21:25:39 +0800 Message-Id: <20180116132540.18939-13-jeffy.chen@rock-chips.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20180116132540.18939-1-jeffy.chen@rock-chips.com> References: <20180116132540.18939-1-jeffy.chen@rock-chips.com> X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: xxm@rock-chips.com, Joerg Roedel , Jeffy Chen , tfiga@chromium.org, jcliang@chromium.org, linux-rockchip@lists.infradead.org, iommu@lists.linux-foundation.org, robin.murphy@arm.com, linux-arm-kernel@lists.infradead.org, Heiko Stuebner MIME-Version: 1.0 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+patchwork-linux-arm=patchwork.kernel.org@lists.infradead.org X-Virus-Scanned: ClamAV using ClamSMTP When the power domain is powered off, the IOMMU cannot be accessed and register programming must be deferred until the power domain becomes enabled. Add runtime PM support, and use runtime PM device link from IOMMU to master to startup and shutdown IOMMU. Signed-off-by: Jeffy Chen --- Changes in v2: None drivers/iommu/rockchip-iommu.c | 191 ++++++++++++++++++++++++++++++----------- 1 file changed, 143 insertions(+), 48 deletions(-) diff --git a/drivers/iommu/rockchip-iommu.c b/drivers/iommu/rockchip-iommu.c index c2d3ac82184e..c8de1456a016 100644 --- a/drivers/iommu/rockchip-iommu.c +++ b/drivers/iommu/rockchip-iommu.c @@ -18,11 +18,13 @@ #include #include #include +#include #include #include #include #include #include +#include #include #include @@ -98,6 +100,12 @@ struct rk_iommu { struct iommu_device iommu; struct list_head node; /* entry in rk_iommu_domain.iommus */ struct iommu_domain *domain; /* domain to which iommu is attached */ + struct mutex pm_mutex; /* serializes power transitions */ +}; + +struct rk_iommudata { + struct device_link *link; /* runtime PM link from IOMMU to master */ + struct rk_iommu *iommu; }; static struct device *dma_dev; @@ -675,9 +683,15 @@ static void rk_iommu_zap_iova(struct rk_iommu_domain *rk_domain, list_for_each(pos, &rk_domain->iommus) { struct rk_iommu *iommu; iommu = list_entry(pos, struct rk_iommu, node); - rk_iommu_enable_clocks(iommu); - rk_iommu_zap_lines(iommu, iova, size); - rk_iommu_disable_clocks(iommu); + + /* Only zap TLBs of IOMMUs that are powered on. */ + if (pm_runtime_get_if_in_use(iommu->dev) > 0) { + rk_iommu_enable_clocks(iommu); + rk_iommu_zap_lines(iommu, iova, size); + rk_iommu_disable_clocks(iommu); + + pm_runtime_put(iommu->dev); + } } spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); } @@ -875,28 +889,19 @@ static size_t rk_iommu_unmap(struct iommu_domain *domain, unsigned long _iova, static struct rk_iommu *rk_iommu_from_dev(struct device *dev) { - return dev->archdata.iommu; + struct rk_iommudata *data = dev->archdata.iommu; + + return data ? data->iommu : NULL; } -static void rk_iommu_detach_device(struct iommu_domain *domain, - struct device *dev) +static void rk_iommu_shutdown(struct rk_iommu *iommu) { - struct rk_iommu *iommu; - struct rk_iommu_domain *rk_domain = to_rk_domain(domain); - unsigned long flags; int i; - /* Allow 'virtual devices' (eg drm) to detach from domain */ - iommu = rk_iommu_from_dev(dev); - if (!iommu) - return; - - spin_lock_irqsave(&rk_domain->iommus_lock, flags); - list_del_init(&iommu->node); - spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); - /* Ignore error while disabling, just keep going */ WARN_ON(rk_iommu_enable_clocks(iommu)); + + mutex_lock(&iommu->pm_mutex); rk_iommu_enable_stall(iommu); rk_iommu_disable_paging(iommu); for (i = 0; i < iommu->num_mmu; i++) { @@ -904,46 +909,30 @@ static void rk_iommu_detach_device(struct iommu_domain *domain, rk_iommu_write(iommu->bases[i], RK_MMU_DTE_ADDR, 0); } rk_iommu_disable_stall(iommu); - rk_iommu_disable_clocks(iommu); + mutex_unlock(&iommu->pm_mutex); - iommu->domain = NULL; - - dev_dbg(dev, "Detached from iommu domain\n"); + rk_iommu_disable_clocks(iommu); } -static int rk_iommu_attach_device(struct iommu_domain *domain, - struct device *dev) +static int rk_iommu_startup(struct rk_iommu *iommu) { - struct rk_iommu *iommu; + struct iommu_domain *domain = iommu->domain; struct rk_iommu_domain *rk_domain = to_rk_domain(domain); - unsigned long flags; int ret, i; - /* - * Allow 'virtual devices' (e.g., drm) to attach to domain. - * Such a device does not belong to an iommu group. - */ - iommu = rk_iommu_from_dev(dev); - if (!iommu) - return 0; - - if (iommu->domain) - rk_iommu_detach_device(iommu->domain, dev); - ret = rk_iommu_enable_clocks(iommu); if (ret) return ret; + mutex_lock(&iommu->pm_mutex); ret = rk_iommu_enable_stall(iommu); if (ret) - goto err_disable_clocks; + goto err_unlock_mutex; ret = rk_iommu_force_reset(iommu); if (ret) goto err_disable_stall; - iommu->domain = domain; - for (i = 0; i < iommu->num_mmu; i++) { rk_iommu_write(iommu->bases[i], RK_MMU_DTE_ADDR, rk_domain->dt_dma); @@ -955,21 +944,90 @@ static int rk_iommu_attach_device(struct iommu_domain *domain, if (ret) goto err_disable_stall; - spin_lock_irqsave(&rk_domain->iommus_lock, flags); - list_add_tail(&iommu->node, &rk_domain->iommus); - spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); - - dev_dbg(dev, "Attached to iommu domain\n"); - rk_iommu_disable_stall(iommu); + mutex_unlock(&iommu->pm_mutex); + rk_iommu_disable_clocks(iommu); return 0; err_disable_stall: rk_iommu_disable_stall(iommu); -err_disable_clocks: +err_unlock_mutex: + mutex_unlock(&iommu->pm_mutex); rk_iommu_disable_clocks(iommu); + return ret; +} + +static void rk_iommu_detach_device(struct iommu_domain *domain, + struct device *dev) +{ + struct rk_iommu *iommu; + struct rk_iommu_domain *rk_domain = to_rk_domain(domain); + unsigned long flags; + + /* Allow 'virtual devices' (eg drm) to detach from domain */ + iommu = rk_iommu_from_dev(dev); + if (!iommu) + return; + + dev_dbg(dev, "Detaching from iommu domain\n"); + + /* iommu already detached */ + if (iommu->domain != domain) + return; + + iommu->domain = NULL; + + spin_lock_irqsave(&rk_domain->iommus_lock, flags); + list_del_init(&iommu->node); + spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); + + if (pm_runtime_get_if_in_use(iommu->dev) > 0) { + rk_iommu_shutdown(iommu); + pm_runtime_put(iommu->dev); + } +} + +static int rk_iommu_attach_device(struct iommu_domain *domain, + struct device *dev) +{ + struct rk_iommu *iommu; + struct rk_iommu_domain *rk_domain = to_rk_domain(domain); + unsigned long flags; + int ret; + + /* + * Allow 'virtual devices' (e.g., drm) to attach to domain. + * Such a device does not belong to an iommu group. + */ + iommu = rk_iommu_from_dev(dev); + if (!iommu) + return 0; + + dev_dbg(dev, "Attaching to iommu domain\n"); + + /* iommu already attached */ + if (iommu->domain == domain) + return 0; + + if (iommu->domain) + rk_iommu_detach_device(iommu->domain, dev); + + iommu->domain = domain; + + spin_lock_irqsave(&rk_domain->iommus_lock, flags); + list_add_tail(&iommu->node, &rk_domain->iommus); + spin_unlock_irqrestore(&rk_domain->iommus_lock, flags); + + if (pm_runtime_get_if_in_use(iommu->dev) <= 0) + return 0; + + ret = rk_iommu_startup(iommu); + if (ret) + rk_iommu_detach_device(data->domain, dev); + + pm_runtime_put(iommu->dev); return ret; } @@ -1059,6 +1117,7 @@ static int rk_iommu_add_device(struct device *dev) { struct iommu_group *group; struct rk_iommu *iommu; + struct rk_iommudata *data = dev->archdata.iommu; iommu = rk_iommu_from_dev(dev); if (!iommu) @@ -1070,6 +1129,7 @@ static int rk_iommu_add_device(struct device *dev) iommu_group_put(group); iommu_device_link(&iommu->iommu, dev); + data->link = device_link_add(dev, iommu->dev, DL_FLAG_PM_RUNTIME); return 0; } @@ -1077,11 +1137,13 @@ static int rk_iommu_add_device(struct device *dev) static void rk_iommu_remove_device(struct device *dev) { struct rk_iommu *iommu; + struct rk_iommudata *data = dev->archdata.iommu; iommu = rk_iommu_from_dev(dev); if (!iommu) return; + device_link_del(data->link); iommu_device_unlink(&iommu->iommu, dev); iommu_group_remove_device(dev); } @@ -1101,6 +1163,11 @@ static int rk_iommu_of_xlate(struct device *dev, struct of_phandle_args *args) { struct platform_device *iommu_dev; + struct rk_iommudata *data; + + data = devm_kzalloc(dma_dev, sizeof(*data), GFP_KERNEL); + if (!data) + return -ENOMEM; iommu_dev = of_find_device_by_node(args->np); if (!iommu_dev) { @@ -1108,7 +1175,9 @@ static int rk_iommu_of_xlate(struct device *dev, return -ENODEV; } - dev->archdata.iommu = platform_get_drvdata(iommu_dev); + data->iommu = platform_get_drvdata(iommu_dev); + dev->archdata.iommu = data; + of_dev_put(iommu_dev); return 0; @@ -1204,6 +1273,8 @@ static int rk_iommu_probe(struct platform_device *pdev) bus_set_iommu(&platform_bus_type, &rk_iommu_ops); + pm_runtime_enable(dev); + return 0; err_remove_sysfs: iommu_device_sysfs_remove(&iommu->iommu); @@ -1216,6 +1287,8 @@ static int rk_iommu_remove(struct platform_device *pdev) { struct rk_iommu *iommu = platform_get_drvdata(pdev); + pm_runtime_disable(&pdev->dev); + iommu_device_unregister(&iommu->iommu); iommu_device_sysfs_remove(&iommu->iommu); rk_iommu_put_clocks(iommu); @@ -1223,6 +1296,27 @@ static int rk_iommu_remove(struct platform_device *pdev) return 0; } +static int __maybe_unused rk_iommu_suspend(struct device *dev) +{ + struct rk_iommu *iommu = dev_get_drvdata(dev); + + rk_iommu_shutdown(iommu); + return 0; +} + +static int __maybe_unused rk_iommu_resume(struct device *dev) +{ + struct rk_iommu *iommu = dev_get_drvdata(dev); + + return rk_iommu_startup(iommu); +} + +static const struct dev_pm_ops rk_iommu_pm_ops = { + SET_RUNTIME_PM_OPS(rk_iommu_suspend, rk_iommu_resume, NULL) + SET_SYSTEM_SLEEP_PM_OPS(pm_runtime_force_suspend, + pm_runtime_force_resume) +}; + static const struct of_device_id rk_iommu_dt_ids[] = { { .compatible = "rockchip,iommu" }, { /* sentinel */ } @@ -1235,6 +1329,7 @@ static struct platform_driver rk_iommu_driver = { .driver = { .name = "rk_iommu", .of_match_table = rk_iommu_dt_ids, + .pm = &rk_iommu_pm_ops, .suppress_bind_attrs = true, }, };