From patchwork Tue May 11 16:04:44 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Brown X-Patchwork-Id: 12251457 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C0D57C433B4 for ; Tue, 11 May 2021 16:09:28 +0000 (UTC) Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 1D3E861154 for ; Tue, 11 May 2021 16:09:28 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1D3E861154 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=desiato.20200630; h=Sender:Content-Transfer-Encoding :Content-Type:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To:Message-Id:Date: Subject:Cc:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=kHinEVKfOVQu04HWBxnD/vZTC5VNnpo0GN3+e/3nKwY=; b=N6w/ObLHnWnDw1cCVpEnMn+0F t0QBMot7V8SbP8CFwi7QYSbneOVDKhT0JvsaewLilUxRMKYMX9c/K6WfYm+Kn9c997j6hIDgs10F6 aOi46/jKMCUIVFzA2eNP1FTj6h8yeikaAtysXXWU3eMPuLTpSmGRIhi7bw9pTQYUslbeX4DKeYJJO kNIBMTuMNSMQZhK0MuYf0eAScODARPdf7ujSUi9KCJ/RPZYfRiJD3f5rdagefiHk68LwYYfYnxHcM 0JWdccCEDGuVYZD78XAGWH2XwNwr1z7yRqEi3PeAqT4DDjOqFSE1ZdYsur4dtTlNk4gQNTNJ39K8z QymnQ0Iiw==; Received: from localhost ([::1] helo=desiato.infradead.org) by desiato.infradead.org with esmtp (Exim 4.94 #2 (Red Hat Linux)) id 1lgUvU-000fkr-8h; Tue, 11 May 2021 16:08:05 +0000 Received: from bombadil.infradead.org ([2607:7c80:54:e::133]) by desiato.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUuw-000ffr-Se for linux-arm-kernel@desiato.infradead.org; Tue, 11 May 2021 16:07:30 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-Type:Content-ID:Content-Description; bh=Bz3p+F1UYkjuI/849+6dySJZqtVkAMQs1g0T8WXgTeY=; b=jE+R6mMCVGhC7JjX2c0+k+cETC eCkv8uEMHQk5xL65+TvUNgSnJMUa+YEveZD0TkhfH8Z/bo4IkSJcYpvuHHpKtUfDIbcVn7/YAKz3g OA0X6MHhHOkFPZqtNvo9T90pE8nnmf/3pYsOICBqOL6mHDENE9pbI9PvZtaewSCqjeFf8lr9FcGGc F7i5xudkusFbg5+sDWXklEBq1Jkh75lzV+rQpjzA3EKRNj7uzrvckxdXLA4ih5iiwIZnEMewrKRu4 Oi6AWfi4bgfpxsujKMvHRd0k8MNQZUbsUTUvcCFghZzT0i81We0JZDLkaQt2xR1oVC7nOWULF55ai 0zmXnoJw==; Received: from mail.kernel.org ([198.145.29.99]) by bombadil.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUut-009jyt-Ds for linux-arm-kernel@lists.infradead.org; Tue, 11 May 2021 16:07:29 +0000 Received: by mail.kernel.org (Postfix) with ESMTPSA id 7FF0260C41; Tue, 11 May 2021 16:07:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1620749247; bh=Nns/hq0hsxvOL0FMEyCyxSbSuPH4o9rv7UDn5xNFrww=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=efe9/F8BGF0BSFo89T/0blW9gHRfyuFRBWCGy1F9RXuw+bXaQKJL2woZb3fQ9d2Y4 YwO9U15Rm8lqFgljk/nYwo/GrCKC7ayqDZFOVNlU4l6lpY3QopiXIyCP4Yz3qeSabb GF14RRvUntRcWbY7fsuquSsnq2HQ+t6zu0aQB9JKO56aNJoTsIuOA4pfqCkEKHahlw ZMj9D2ckHDAupPnVdQSaXqMh8jCXlHXrYNhszanIAq4gOzvtTwNbePtd3PmfaQizJQ 19N7P0rQMIu5vNEybS+aceRBOGJU3CmewOHU+jCTI0O0vzQeMGNr+rT2a9mQghoQmx 3W7L3cbqo8oQg== From: Mark Brown To: Catalin Marinas , Will Deacon Cc: Dave Martin , linux-arm-kernel@lists.infradead.org, Mark Brown Subject: [PATCH v2 1/3] arm64/sve: Split _sve_flush macro into separate Z and predicate flushes Date: Tue, 11 May 2021 17:04:44 +0100 Message-Id: <20210511160446.42871-2-broonie@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20210511160446.42871-1-broonie@kernel.org> References: <20210511160446.42871-1-broonie@kernel.org> MIME-Version: 1.0 X-Patch-Hashes: v=1; h=sha256; i=8ky7SjYQXtye80W87sp+SnDJWtPHF2MWhz04QULCKe8=; m=Fga369VpZOz6Da1cSuNeXLU3fP3S3KBCINJ10dHvmYo=; p=ntmmOQPglzGyhmnrOrr1rDn4FvmLcTmKWQlgEVP+9m4=; g=1ec810d8f7e7689ef5060a6fe8e00a639990b88e X-Patch-Sig: m=pgp; i=broonie@kernel.org; s=0xC3F436CA30F5D8EB; b=iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAmCaqxsACgkQJNaLcl1Uh9Bbbgf6A1N efTLUcJNRFYie/LTkG20uwMhlSUrz3ZZLVQekKvC02EZdawWy/71WtSKO6RIbubb58OMMvn+LWv21 t00zqnNw/mV3ZG/9b1cXGU/K94yxYXGJY1tthI+cXk/w9N8TXB8c3iImpa1iFHQYXL/6vrOecDIv0 R6ZF4q4MOCCuDdB4JUHVZH0mzW3fe+xCrKWJIS9r4DzmbV9oomQZ/sB/Cq4Yxsw46xP9RdH4UpSKE S6evW1V1XdED/lD5fgigacrt+Vyw7y6rbTJBchNx27wLYpIB5yNg3QwnMKV6XM+MQP3nTApejfI7T ObGwQDM2IPWZndJlK+p5t6N5GEfgY2g== X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210511_090727_529548_6B62D28D X-CRM114-Status: UNSURE ( 9.65 ) X-CRM114-Notice: Please train this message. X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Trivial refactoring to support further work, no change to generated code. Signed-off-by: Mark Brown Reviewed-by: Dave Martin --- arch/arm64/include/asm/fpsimdmacros.h | 4 +++- arch/arm64/kernel/entry-fpsimd.S | 3 ++- 2 files changed, 5 insertions(+), 2 deletions(-) diff --git a/arch/arm64/include/asm/fpsimdmacros.h b/arch/arm64/include/asm/fpsimdmacros.h index a2563992d2dc..059204477ce6 100644 --- a/arch/arm64/include/asm/fpsimdmacros.h +++ b/arch/arm64/include/asm/fpsimdmacros.h @@ -213,8 +213,10 @@ mov v\nz\().16b, v\nz\().16b .endm -.macro sve_flush +.macro sve_flush_z _for n, 0, 31, _sve_flush_z \n +.endm +.macro sve_flush_p_ffr _for n, 0, 15, _sve_pfalse \n _sve_wrffr 0 .endm diff --git a/arch/arm64/kernel/entry-fpsimd.S b/arch/arm64/kernel/entry-fpsimd.S index 3ecec60d3295..7921d58427c2 100644 --- a/arch/arm64/kernel/entry-fpsimd.S +++ b/arch/arm64/kernel/entry-fpsimd.S @@ -72,7 +72,8 @@ SYM_FUNC_END(sve_load_from_fpsimd_state) /* Zero all SVE registers but the first 128-bits of each vector */ SYM_FUNC_START(sve_flush_live) - sve_flush + sve_flush_z + sve_flush_p_ffr ret SYM_FUNC_END(sve_flush_live) From patchwork Tue May 11 16:04:45 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Brown X-Patchwork-Id: 12251461 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4D78CC433ED for ; Tue, 11 May 2021 16:10:15 +0000 (UTC) Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id EB5F9616EA for ; Tue, 11 May 2021 16:10:14 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EB5F9616EA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=desiato.20200630; h=Sender:Content-Transfer-Encoding :Content-Type:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To:Message-Id:Date: Subject:Cc:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=X0qYiI2EOrR44gS7jP0XqB8PqhVc9UUVxigbyrApR1Y=; b=fBkMJx2Yvxxuu2UyeWNJim5As QB1cxZ2ECxhaTaRTprto9JWFn7cZgHl2XQpGEURUUl5totLkZexExOOj52PjHbA9f2wjizWr+jBMn SbvhVnrvC/x5RvWqntYt0yXSScW/oQ5L3uxzGNC9kEt3P8pN0iQn866g+HkTIN1yLRhVTDYDJgAU2 yXwQ2GmUlavEvRjXEwoCQq+ZMnVgbs+EpGdNTPvPZXYjmH7z2dokgYPQDG0joUy/oMBOW6qxS2243 kQ41cKgV3yj40RntoiTlHahwDrMcgcMbqDWvpTD6D8FiE6OMuXxW3aSh6+fFKPqjhTNlZ3sxBpS8w 3tGXYjOKg==; Received: from localhost ([::1] helo=desiato.infradead.org) by desiato.infradead.org with esmtp (Exim 4.94 #2 (Red Hat Linux)) id 1lgUwE-000fto-Io; Tue, 11 May 2021 16:08:50 +0000 Received: from bombadil.infradead.org ([2607:7c80:54:e::133]) by desiato.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUuz-000fgQ-MU for linux-arm-kernel@desiato.infradead.org; Tue, 11 May 2021 16:07:34 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-Type:Content-ID:Content-Description; bh=pnt0VGNxOQI/aFklMp8n0hc7pU6LGVx5UUl1p4wHF5M=; b=pGnXWcFJ3CbQVd6NsJcIqeuAbE k7IISYxZyd9DlPct/fPN+GP29ADnHRBSf54uJ16VNDlfKfhVNxTCkdoknhuOQh7nbRwuPhvupQkqK OtD1c8uWGQPYP8tFWQZ7t4NtfxOGbQ+Fr/H1xcIR3L4w0w580oEmqDM2BMnl2Hshble6tNMewFd3C 4nMz4Luq/p2q7xvdDSHPbCnS8HtyhfLWXzTUFpDAneyB/QwqgFMbavbZ0Fe+haIRWDP5j4PZZVefI J0jgbcJyvOUyNiKSaWIV33lugeP9Nhy12O8Oe/c6eoM8IakXpkBf2Ui0mNJ4zCTo8mFj4P7JhtCZW gCXudsmQ==; Received: from mail.kernel.org ([198.145.29.99]) by bombadil.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUuw-009jzd-HQ for linux-arm-kernel@lists.infradead.org; Tue, 11 May 2021 16:07:32 +0000 Received: by mail.kernel.org (Postfix) with ESMTPSA id 789286134F; Tue, 11 May 2021 16:07:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1620749250; bh=WjAQ2qDSZodTntRcisV4diRiSEPp0bOda8orQBsabrc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=pu3TsApLuiKozEugWcf95uwzDpn6p7XkpMHpSeFydu/SV5FIQ1DIR0oCIWjAR5nBs XCcshL3zPuft7CAv5Wgcw98OwA9HpPrYoccCvbEmXBe0dxPdu5zaotMCoVJAdWT6cx +uKEWJpMz5MgDefF1FR15PcFxWXO6tfzpY/JqZihPTat7f/Dp6qogko06tB3oOSbJb rVV8F2os6/+sBocZ8W/CLQB/s1bvMQanM75dfk0gvz6yiQRp4oogwqjNe9D3/7TH0M LaGykRWt4e1RNHm8fAtqTteNHBBeTp+YTbIU3zDvFDtebhn+ogC/H7aet3zP2En7fx hVr0GA5LGHWNg== From: Mark Brown To: Catalin Marinas , Will Deacon Cc: Dave Martin , linux-arm-kernel@lists.infradead.org, Mark Brown Subject: [PATCH v2 2/3] arm64/sve: Use the sve_flush macros in sve_load_from_fpsimd_state() Date: Tue, 11 May 2021 17:04:45 +0100 Message-Id: <20210511160446.42871-3-broonie@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20210511160446.42871-1-broonie@kernel.org> References: <20210511160446.42871-1-broonie@kernel.org> MIME-Version: 1.0 X-Patch-Hashes: v=1; h=sha256; i=R+U7aTt9BkodgPnOMm/bcvhBLBAhebwQySrC69Eh+R4=; m=912UIm/qZKS5QeEHzZd1Qmn2APn5di5kf7pYCwFBTe0=; p=WNjeju/OSNuf6gAPpeLfOt3XjdrkWKzbHY86xi/M1Jk=; g=717e842105bca410bdd77889886997b9f790ea67 X-Patch-Sig: m=pgp; i=broonie@kernel.org; s=0xC3F436CA30F5D8EB; b=iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAmCaqxwACgkQJNaLcl1Uh9AMJwf/Y9p wNdE+St9y+6viH9sY6YSlTOZdTu/TmWWicjGf40NfrdcpnmPh9PCaCIqT5/lRkPP5EjJHT+E9lSKp hVyWrMht3yeQTWNCvU0uYodkOSqecGirmhYJ5WSttXFWmHSAh/nK3dAR4LK73KMyZDHaH3mAf2bdY cYs/QjsykhxIF3kz889g+UTeTFEI+Rjjm6H2JAqGKe97KPFX6KEM7AhRUSrTjr/tAUYA147Kl2lIl iwOAab47GrsUFm9g0mpnP5KdmH9mfbLZKis0oEjg7VZRvbfKPtdCud3yllQXTOHrR1LkJPFEsEm7M U9IGcyxSNrWYAxnhV/qzhCUT1puoiwg== X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210511_090730_644036_FE2568C5 X-CRM114-Status: UNSURE ( 9.67 ) X-CRM114-Notice: Please train this message. X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org This makes the code a bit clearer and as a result we can also make the indentation more normal, there is no change to the generated code. Signed-off-by: Mark Brown Reviewed-by: Dave Martin --- arch/arm64/kernel/entry-fpsimd.S | 9 ++++----- 1 file changed, 4 insertions(+), 5 deletions(-) diff --git a/arch/arm64/kernel/entry-fpsimd.S b/arch/arm64/kernel/entry-fpsimd.S index 7921d58427c2..dd8382e5ce82 100644 --- a/arch/arm64/kernel/entry-fpsimd.S +++ b/arch/arm64/kernel/entry-fpsimd.S @@ -63,11 +63,10 @@ SYM_FUNC_END(sve_set_vq) * and the rest zeroed. All the other SVE registers will be zeroed. */ SYM_FUNC_START(sve_load_from_fpsimd_state) - sve_load_vq x1, x2, x3 - fpsimd_restore x0, 8 - _for n, 0, 15, _sve_pfalse \n - _sve_wrffr 0 - ret + sve_load_vq x1, x2, x3 + fpsimd_restore x0, 8 + sve_flush_p_ffr + ret SYM_FUNC_END(sve_load_from_fpsimd_state) /* Zero all SVE registers but the first 128-bits of each vector */ From patchwork Tue May 11 16:04:46 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Mark Brown X-Patchwork-Id: 12251463 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7B832C433ED for ; Tue, 11 May 2021 16:10:54 +0000 (UTC) Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id DAD0D60C41 for ; Tue, 11 May 2021 16:10:53 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DAD0D60C41 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=desiato.20200630; h=Sender:Content-Transfer-Encoding :Content-Type:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To:Message-Id:Date: Subject:Cc:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=owEf/u8D/KSji2pEOCBfz8Rr9DrZ8kETbc5XwpHndSY=; b=D5swoTujc15JTF3iJVwEIa+Yb IVRIwrwgd9w6hlbme+7HS9zkRI79VeYgRHB0Ws605NnsgMTdv7/4qe1UayuC689kIChXhtOsZtTIK jCo/T0nad2t+CRwVdyw7aMrUFgC3aj/CyVoGrU2AhVMQzEKKion9jo6QdHh19nIX5xYt+IHaADoVn D0gS3ZVsetWst//WHD52O4bjxQon8FcSnS669E9nJydJKH3KHsQ7oWHwavvbTvP3RXKMn5C1fvw3W NamkwnbCLU/7kp9DB4IJTh1uOpUtNbkRVwmY4fPzL0etRyXeOrrnNjgftVYmbrxZXPlf3r+l3gb5E eboLmGuQQ==; Received: from localhost ([::1] helo=desiato.infradead.org) by desiato.infradead.org with esmtp (Exim 4.94 #2 (Red Hat Linux)) id 1lgUwr-000g12-AB; Tue, 11 May 2021 16:09:30 +0000 Received: from bombadil.infradead.org ([2607:7c80:54:e::133]) by desiato.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUv1-000fh0-Vz for linux-arm-kernel@desiato.infradead.org; Tue, 11 May 2021 16:07:36 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-Type:Content-ID:Content-Description; bh=kmyjBOenrmx0ddQ/UeYrDhg1qgTXM8lsg5CS8Rc/jJY=; b=QnqbzonmRm9sUUcZIbbsEk/3p8 eZU8t5/GQaZDwmEHaQ8c7Tk+bjYUZIr3ap4MYom6Hwza+rL3lnYnfozvap8gJ/8H7pWmM/bWrPqCf BV/ZqvylGDVKwiB5NTTscYtnaCOj+VFGJwWl311faWVJaBhBUigxETcXHlKY2bpzzR38zJUJZ9q51 OumpZbbnn4HJaMmUoVF81DOpGI6IHW9SBhjKqW78dbAO1CPMsXrvwE1JQVUP1yCcNzQc02pN5MLCK c2UxVMnrJ9VlEV60ywqjW3foJIRvV96e9MbuqEaYNkct1+Ar0iL77zI5rTDjGTigusqOuz+FkNLNg vxb1rAtg==; Received: from mail.kernel.org ([198.145.29.99]) by bombadil.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUuz-009k17-Az for linux-arm-kernel@lists.infradead.org; Tue, 11 May 2021 16:07:34 +0000 Received: by mail.kernel.org (Postfix) with ESMTPSA id 5893461154; Tue, 11 May 2021 16:07:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1620749252; bh=cTjB/GI5+LUHdChIjVdq/b9SRw6d3uhgfnk5yyDbcQg=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=NcWdG6PaFRUDicVEwvSW3i47WtCFOg3uPyPX4P4acidnqk9I0Vqacm6KnXMypFXlR wdIte6c9U7Wa1B+wb54dg30/glLVsHUX3zPV512L26/vuTqfQO19g7+6lwEQsBuE8B jwLxPTEwugI1CfErQKnQUuc1tyOh9M+ByBQ+xx+EQFb4DoD7Fb8yC+HFHWD2nfm1tx 5toBrFuPU28QbpdsmwYTmlmdtHCuU45SkmqyDM1fpi5LDcyDuUuFgc6y6msc14r4C3 T2Ih/T1KUmFmLesnF1gSmQMWl7vnXPeNDLnPn4lnUY/c4j9n7khABN5wWCGFoyN4po aqfKhnAoP4+Nw== From: Mark Brown To: Catalin Marinas , Will Deacon Cc: Dave Martin , linux-arm-kernel@lists.infradead.org, Mark Brown Subject: [PATCH v2 3/3] arm64/sve: Skip flushing Z registers with 128 bit vectors Date: Tue, 11 May 2021 17:04:46 +0100 Message-Id: <20210511160446.42871-4-broonie@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20210511160446.42871-1-broonie@kernel.org> References: <20210511160446.42871-1-broonie@kernel.org> MIME-Version: 1.0 X-Patch-Hashes: v=1; h=sha256; i=dFqv+IEGzD35KuPbEbZHcDzanCpxU72L9ocHqttmAwA=; m=P/GMwtZTr1KsXYreaMS7GLhn0bTQRSLx8cU5Yd7/bqA=; p=nhTo2ZCC7f98VU/ptxYehsk86GXBVGS0fp65KXmqi9g=; g=4640f49f8879d0154f69ac40b5464c9a379b872f X-Patch-Sig: m=pgp; i=broonie@kernel.org; s=0xC3F436CA30F5D8EB; b=iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAmCaqxwACgkQJNaLcl1Uh9AiAwf8CvI LZMwEzH5MoFPmz10/vgYETgKHz+znYJcZjP9HeN4WsyA6wAESNVD7jazY+n2nA2OG3vmVfABcviUT k+2vm5zTFsto4xiCaKBC0sOFuglgouPIAbGOQ6ZJ0aeX11SgkZXCcR9BG/J20q6H8UU9Qo+pZrWdM 2jMqROX8FrdaAVQnIxuKCk+aU3PRry3B/bJ/7WYz7uHxo+WNoJGdVjIc50SV/90Pg+NKoh5WVmj3G q/gNJPuRYLCnYLJoYhZIUbcJKeZIUWgTXJyidxOXvRXbfqTrAfAZNe6oTCy3cncSw2WnFW+knpsxj AGvMSY2DSEWRCmcyrc0rGytEJT0oyHw== X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210511_090733_468063_310E2A30 X-CRM114-Status: GOOD ( 12.13 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org When the SVE vector length is 128 bits then there are no bits in the Z registers which are not shared with the V registers so we can skip them when zeroing state not shared with FPSIMD, this results in a minor performance improvement. Signed-off-by: Mark Brown Reviewed-by: Dave Martin --- arch/arm64/include/asm/fpsimd.h | 2 +- arch/arm64/kernel/entry-fpsimd.S | 9 +++++++-- arch/arm64/kernel/fpsimd.c | 6 ++++-- 3 files changed, 12 insertions(+), 5 deletions(-) diff --git a/arch/arm64/include/asm/fpsimd.h b/arch/arm64/include/asm/fpsimd.h index 2599504674b5..c072161d5c65 100644 --- a/arch/arm64/include/asm/fpsimd.h +++ b/arch/arm64/include/asm/fpsimd.h @@ -69,7 +69,7 @@ static inline void *sve_pffr(struct thread_struct *thread) extern void sve_save_state(void *state, u32 *pfpsr); extern void sve_load_state(void const *state, u32 const *pfpsr, unsigned long vq_minus_1); -extern void sve_flush_live(void); +extern void sve_flush_live(unsigned long vq_minus_1); extern void sve_load_from_fpsimd_state(struct user_fpsimd_state const *state, unsigned long vq_minus_1); extern unsigned int sve_get_vl(void); diff --git a/arch/arm64/kernel/entry-fpsimd.S b/arch/arm64/kernel/entry-fpsimd.S index dd8382e5ce82..87ef25836963 100644 --- a/arch/arm64/kernel/entry-fpsimd.S +++ b/arch/arm64/kernel/entry-fpsimd.S @@ -69,10 +69,15 @@ SYM_FUNC_START(sve_load_from_fpsimd_state) ret SYM_FUNC_END(sve_load_from_fpsimd_state) -/* Zero all SVE registers but the first 128-bits of each vector */ +/* + * Zero all SVE registers but the first 128-bits of each vector + * + * x0 = VQ - 1 + */ SYM_FUNC_START(sve_flush_live) + cbz x0, 1f // A VQ-1 of 0 is 128 bits so no extra Z state sve_flush_z - sve_flush_p_ffr +1: sve_flush_p_ffr ret SYM_FUNC_END(sve_flush_live) diff --git a/arch/arm64/kernel/fpsimd.c b/arch/arm64/kernel/fpsimd.c index ad3dd34a83cf..e57b23f95284 100644 --- a/arch/arm64/kernel/fpsimd.c +++ b/arch/arm64/kernel/fpsimd.c @@ -957,8 +957,10 @@ void do_sve_acc(unsigned int esr, struct pt_regs *regs) * disabling the trap, otherwise update our in-memory copy. */ if (!test_thread_flag(TIF_FOREIGN_FPSTATE)) { - sve_set_vq(sve_vq_from_vl(current->thread.sve_vl) - 1); - sve_flush_live(); + unsigned long vq_minus_one = + sve_vq_from_vl(current->thread.sve_vl) - 1; + sve_set_vq(vq_minus_one); + sve_flush_live(vq_minus_one); fpsimd_bind_task_to_cpu(); } else { fpsimd_to_sve(current);