From patchwork Fri Mar 18 06:27:07 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: =?utf-8?b?S3lyaWUgV3UgKOWQtOaZlyk=?= X-Patchwork-Id: 12784891 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 886DCC433F5 for ; Fri, 18 Mar 2022 06:28:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:Message-ID:Date:Subject:CC :To:From:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References: List-Owner; bh=BEGOGMzomKRxFjy6FioS8ATjqdpwDxelW+pks7+ij28=; b=gB3Uwr6FZTOhru mmOdJ1HHa4j9VW7P3uY+WTdrZAxTNOo+gjYAI0xnMj7tPxNagu63AUbgzHiJnH3ClH/MxoY2IptCO uOj/1Uh67qUwsVkJPHtYr8615pgs3RcibqVPxUefVqwk1F5b07RmA79at4GA5vTnpemGbm66haHTY kGlPQVo7Ql+eTLMlV/dL/rBE00eWn7dfcVCwstWg72GT1W9vJtO1cSm0xgZETNy9idT2LWeQyz0/m mltfG4HvtLefxaNAck/YrizE2At1z5a0NPD1VoHge8dEDXCATl+R5T6V2e9ar28clOPhWcT0VH74p 1+YWKrNN3Ge1zMCQ7vIw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nV65F-000T1G-PJ; Fri, 18 Mar 2022 06:27:33 +0000 Received: from mailgw02.mediatek.com ([216.200.240.185]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nV65C-000T0J-3O; Fri, 18 Mar 2022 06:27:31 +0000 X-UUID: a1e9d26f04e14809ac0885878117ae55-20220317 X-UUID: a1e9d26f04e14809ac0885878117ae55-20220317 Received: from mtkcas67.mediatek.inc [(172.29.193.45)] by mailgw02.mediatek.com (envelope-from ) (musrelay.mediatek.com ESMTP with TLSv1.2 ECDHE-RSA-AES256-SHA384 256/256) with ESMTP id 1833184170; Thu, 17 Mar 2022 23:27:19 -0700 Received: from mtkmbs10n2.mediatek.inc (172.21.101.183) by MTKMBS62DR.mediatek.inc (172.29.94.18) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 17 Mar 2022 23:27:18 -0700 Received: from mtkcas11.mediatek.inc (172.21.101.40) by mtkmbs10n2.mediatek.inc (172.21.101.183) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.792.3; Fri, 18 Mar 2022 14:27:16 +0800 Received: from localhost.localdomain (10.17.3.154) by mtkcas11.mediatek.inc (172.21.101.73) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Fri, 18 Mar 2022 14:27:15 +0800 From: kyrie.wu To: Hans Verkuil , Mauro Carvalho Chehab , Rob Herring , Matthias Brugger , Tzung-Bi Shih CC: , , , , , , Tomasz Figa , , , kyrie wu , Subject: [V8,0/6] Enable two hardware jpeg encoder for MT8195 Date: Fri, 18 Mar 2022 14:27:07 +0800 Message-ID: <1647584833-32750-1-git-send-email-kyrie.wu@mediatek.com> X-Mailer: git-send-email 2.6.4 MIME-Version: 1.0 X-MTK: N X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220317_232730_174592_AF936AA5 X-CRM114-Status: GOOD ( 13.29 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org From: kyrie wu This series adds support for multi hardware jpeg encoding, by first adding use of_platform_populate to manage each hardware information: interrupt, clock, register bases and power. Secondly add encoding work queue to deal with the encoding requestsof multi-hardware at the same time. Lastly, add output picture reorder function interface to eliminate the out of order images. This series has been tested with both MT8195. Encoding worked for this chip. Patches 1 Adds jpeg encoder dt-bindings for mt8195 Patches 2 jpeg encoder builds two module for using Multi-HW, export some functions to make them visible by other modules. Patches 3 use devm_of_platform_populate to manage multi-hardware. Patch 4 add jpeg encoding timeout function to judge hardware timeout. Patch 5 add encoding work queue to deal with multi-hardware encoding at the same time. Patch 6 add output picture reorder function to order images. --- This series patches dependent on: media_stage tree: [1] https://git.linuxtv.org/media_stage.git/commit/?id=b3627647f9ea7473d10fb08a95fd7c4133a17ca4 patch1 new jpegenc dt-bindings included files [2] MM IOMMU binding: https://patchwork.kernel.org/project/linux-mediatek/patch/20220217113453.13658-2-yong.wu@mediatek.com/ [3] MT8195 power domain: https://patchwork.kernel.org/project/linux-mediatek/list/?series=580579 Changes compared with v7: - some modifications for patch v6's review comments. Changes compared with v6: - new yaml file for mt8195 jpeg encoder. - some modifications for patch v5's review comments. Changes compared with v5: - use of_platform_populate to replace component framework to manage multi-hardware in patch 2. Changes compared with v4: --No change compaered with v4 Changes compared with v3: --Structure patches for consistency, non-backward compatible and do not break any existing functionality Changes compared with v2: --Split the last two patches into several patches to enhance readability --Correct some syntax errors --Explain why the component framework is used Changes compared with v1: --Add jpeg encoder dt-bindings for MT8195 --Use component framework to manage jpegenc HW --Add jpegenc output pic reorder function interface kyrie wu (6): dt-bindings: mediatek: Add mediatek, mt8195-jpgenc compatible media: mtk-jpegenc: export jpeg encoder functions media: mtk-jpegenc: manage jpegenc multi-hardware media: mtk-jpegenc: add jpegenc timeout func interface media: mtk-jpegenc: add jpeg encode worker interface media: mtk-jpegenc: add output pic reorder interface .../media/mediatek,mt8195-jpegenc.yaml | 144 +++++++++ drivers/media/platform/mtk-jpeg/Makefile | 11 +- .../media/platform/mtk-jpeg/mtk_jpeg_core.c | 292 +++++++++++++++--- .../media/platform/mtk-jpeg/mtk_jpeg_core.h | 82 ++++- .../media/platform/mtk-jpeg/mtk_jpeg_dec_hw.c | 1 + .../media/platform/mtk-jpeg/mtk_jpeg_dec_hw.h | 3 +- .../media/platform/mtk-jpeg/mtk_jpeg_enc_hw.c | 250 +++++++++++++++ 7 files changed, 729 insertions(+), 54 deletions(-) create mode 100644 Documentation/devicetree/bindings/media/mediatek,mt8195-jpegenc.yaml