From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 78E84C433FE for ; Fri, 20 May 2022 10:02:55 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1348016AbiETKCx (ORCPT ); Fri, 20 May 2022 06:02:53 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:40726 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229809AbiETKCt (ORCPT ); Fri, 20 May 2022 06:02:49 -0400 Received: from dfw.source.kernel.org (dfw.source.kernel.org [IPv6:2604:1380:4641:c500::1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D6D1BA30BC; Fri, 20 May 2022 03:02:47 -0700 (PDT) Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 6792F61CCC; Fri, 20 May 2022 10:02:47 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id CB789C385A9; Fri, 20 May 2022 10:02:44 +0000 (UTC) Message-ID: Date: Fri, 20 May 2022 12:02:42 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: [PATCH 0/4] Add Toshiba Visconti DNN image processing accelerator driver Content-Language: en-US To: yuji2.ishikawa@toshiba.co.jp, robh+dt@kernel.org, nobuhiro1.iwamatsu@toshiba.co.jp, sumit.semwal@linaro.org, christian.koenig@amd.com Cc: linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-media@vger.kernel.org, dri-devel@lists.freedesktop.org, linaro-mm-sig@lists.linaro.org References: <20220428131128.5053-1-yuji2.ishikawa@toshiba.co.jp> From: Hans Verkuil In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Yuji, On 5/20/22 11:48, yuji2.ishikawa@toshiba.co.jp wrote: > Hi Hans, > > Thank you for your comment. > I agree that this submission lacks documents sharing basic idea of the accelerators; what do they accept and what do they yield. > Where can I put a new document? Can I put it as a comment in a source? Can I add a file under Documentation/misc-devices directory? Start with explaining it by replying to this mail. Without knowing anything about the hardware, it is difficult to say what the best place is. Usually it is either the public API header, or somewhere in Documentation. The first step is to have a better understanding of the Visconti image hardware and to see what the best subsystem would be to support that hardware. Regards, Hans > > Thanks, > Yuji Ishikawa > >> -----Original Message----- >> From: Hans Verkuil >> Sent: Thursday, May 12, 2022 8:15 PM >> To: ishikawa yuji(石川 悠司 ○ＲＤＣ□ＡＩＴＣ○ＥＡ開) >> ; Rob Herring ; >> iwamatsu nobuhiro(岩松 信洋 □ＳＷＣ◯ＡＣＴ) >> ; Sumit Semwal >> ; Christian König >> Cc: linux-arm-kernel@lists.infradead.org; linux-kernel@vger.kernel.org; >> linux-media@vger.kernel.org; dri-devel@lists.freedesktop.org; >> linaro-mm-sig@lists.linaro.org >> Subject: Re: [PATCH 0/4] Add Toshiba Visconti DNN image processing >> accelerator driver >> >> Hi Yuji, >> >> On 4/28/22 15:11, Yuji Ishikawa wrote: >>> This series is the DNN image processing accelerator driver for Toshiba's ARM >> SoC, Visconti[0]. >>> This provides DT binding documentation, device driver, MAINTAINER files. >>> >>> The second patch "soc: visconti: Add Toshiba Visconti image processing >> accelerator common source" >>> and the fourth patch "MAINTAINERS: ..." are the same as the ones in the >> preceding post for affine driver. >> >> There appears to be no documentation whatsoever, unless I am missing >> something. >> >> How is the uAPI supposed to be used? What does it do? What formats does it >> accept or produce? >> >> If this processes images, then (as Laurent mentioned) this is more suitable as a >> V4L2 mem2mem driver. >> >> See >> https://linuxtv.org/downloads/v4l-dvb-apis-new/userspace-api/v4l/dev-me >> m2mem.html >> and the many drivers in drivers/media that use it (git grep v4l2-mem2mem.h). >> >> But without any explanation whatsoever I have no idea what does or does not >> make sense. >> >> Regards, >> >> Hans >> >>> >>> Best regards, >>> Yuji >>> >>> [0]: >>> >> https://toshiba.semicon-storage.com/ap-en/semiconductor/product/image- >>> recognition-processors-visconti.html >>> >>> Yuji Ishikawa (4): >>> dt-bindings: soc: visconti: Add Toshiba Visconti DNN image processing >>> accelerator bindings >>> soc: visconti: Add Toshiba Visconti image processing accelerator >>> common source >>> soc: visconti: Add Toshiba Visconti DNN image processing accelerator >>> MAINTAINERS: Add entries for Toshiba Visconti DNN image processing >>> accelerator >>> >>> .../soc/visconti/toshiba,visconti-dnn.yaml | 54 ++ >>> MAINTAINERS | 2 + >>> drivers/soc/Kconfig | 1 + >>> drivers/soc/Makefile | 1 + >>> drivers/soc/visconti/Kconfig | 7 + >>> drivers/soc/visconti/Makefile | 8 + >>> drivers/soc/visconti/dnn/Makefile | 6 + >>> drivers/soc/visconti/dnn/dnn.c | 533 >> ++++++++++++++++++ >>> drivers/soc/visconti/dnn/hwd_dnn.c | 183 ++++++ >>> drivers/soc/visconti/dnn/hwd_dnn.h | 68 +++ >>> drivers/soc/visconti/dnn/hwd_dnn_reg.h | 228 ++++++++ >>> drivers/soc/visconti/ipa_common.c | 55 ++ >>> drivers/soc/visconti/ipa_common.h | 18 + >>> drivers/soc/visconti/uapi/dnn.h | 77 +++ >>> drivers/soc/visconti/uapi/ipa.h | 88 +++ >>> 15 files changed, 1329 insertions(+) >>> create mode 100644 >>> Documentation/devicetree/bindings/soc/visconti/toshiba,visconti-dnn.ya >>> ml create mode 100644 drivers/soc/visconti/Kconfig create mode >>> 100644 drivers/soc/visconti/Makefile create mode 100644 >>> drivers/soc/visconti/dnn/Makefile create mode 100644 >>> drivers/soc/visconti/dnn/dnn.c create mode 100644 >>> drivers/soc/visconti/dnn/hwd_dnn.c >>> create mode 100644 drivers/soc/visconti/dnn/hwd_dnn.h >>> create mode 100644 drivers/soc/visconti/dnn/hwd_dnn_reg.h >>> create mode 100644 drivers/soc/visconti/ipa_common.c create mode >>> 100644 drivers/soc/visconti/ipa_common.h create mode 100644 >>> drivers/soc/visconti/uapi/dnn.h create mode 100644 >>> drivers/soc/visconti/uapi/ipa.h >>>