From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7EDF0C7EE29 for ; Wed, 7 Jun 2023 22:15:44 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231294AbjFGWPm (ORCPT ); Wed, 7 Jun 2023 18:15:42 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:33412 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230324AbjFGWPk (ORCPT ); Wed, 7 Jun 2023 18:15:40 -0400 Received: from todd.t-8ch.de (todd.t-8ch.de [159.69.126.157]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id A5FD52119; Wed, 7 Jun 2023 15:15:39 -0700 (PDT) Date: Thu, 8 Jun 2023 00:15:27 +0200 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=t-8ch.de; s=mail; t=1686176138; bh=pQ9vvxki5YLy1NsCzvkhpdugXedCaJ81g7oe9b6lLqQ=; h=Date:From:To:Cc:Subject:From; b=krsgNIC+PDmePAlT5yaqB8FqM26sR1ktyu5vo8ZKFISmrxo23SKTna31AkAJYDJoZ GJsPcJL34RRM3itkxsQLSL/dQnEmHWqbCbWSiy0AMJf+XNiMtPbefL4JQ91PMWPWEg aUZCJsrFYlDKyOZ2wL/1Ad9frz66XtoSM5gWRWWk= From: Thomas =?utf-8?Q?Wei=C3=9Fschuh?= To: Willy Tarreau , Zhangjin Wu Cc: linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org Subject: nolibc: KTAP output and test reports Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Willy, Zhangjin, after your recent discussions about the test output and report I wondered if it would make sense to switch nolibc-test to KTAP output format [0]. With this it would be possible to have a wrapper script run each architecture test as its own test subcomponent. A (K)TAP parser/runner could then directly recognize and report failing testcases, making it easier to validate. Also maybe we can hook it up into the regular kselftests setup and have the bots run it as part of that. The kernel even includes a header-only library to implement the format [1]. It also should be fairly easy to emit the format without a library. Thomas [0] Documentation/dev-tools/ktap.rst [1] Documentation/dev-tools/kselftest.rst (Test harness)