From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from CH4PR04CU002.outbound.protection.outlook.com (mail-northcentralusazon11013017.outbound.protection.outlook.com [40.107.201.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id BFD1A2253EB for ; Thu, 30 Apr 2026 03:21:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.201.17 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1777519273; cv=fail; b=DdoAaczi5z94a6yPIG2jjLXSRw9YOaK5ttqeXycsOw8bienuMv680SB/OpEO9Fz7VH09hm2VGV/0HFZZqkrOAvk+6bbsaRb7zfaXdyKrZ/GHDfuKmTsD7sO68haKDx5SdCQ360eW7jZ6YMy1y1k0aWbHVuqRRVaGkJxSb88ekBc= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1777519273; c=relaxed/simple; bh=EyboI4mHF8jf9+Lg/U7YPKXSkplBc83NnR/PMGwSKlo=; h=Message-ID:Date:MIME-Version:Subject:To:CC:References:From: In-Reply-To:Content-Type; b=rY3aRK4wYuXd22yN28gS9+b4pkZhrkqfUnh7sikJa5sL1HGbAslVqbYRkgovpRonuvIc3FZmXktKgE3N7/sgPFGDaFoaPxn09mpSpqFLxHYbgWBZ9RVC70rnNdnMEN6XFtstnxW6i9NtiRRv3R8Sj78YbFqhG0wSEdbdlrDfjh8= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=hpVnlKCG; arc=fail smtp.client-ip=40.107.201.17 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="hpVnlKCG" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=M9vX7/ekcxk2DQYhgVlktCZgGww4cSkmwGzOWJZYM13bU3YbKhK0481fM7nDQzjym6M2/27e0NBvAOPyRrUvLgBPq9BaOzjRPCY8zDsTXTr26Gf2OTMBRShHKDiCFpW+HEjdzRtt+OFHIv2tBUe8Qwb828eefUaRP3snTcWtxCFeqeyRyiWzAknx+Y0O90GN0NPxkhHlxrbB4dbpQIEamVRA5gIx52xam6xb9DUSVXEkvyajwK+8acEMQGluEWWiOIC2uIoZy2cJPHP/BwIdDVXxDeJTiDFdyO2dNKPIxkr9iTXQi3meXZ1Zar3zUR92SZwB0lZIDu3NCrD2k2mgYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=abYUenOS03gdtyrVydZSAQmWQruT/C2BY517IDoaolM=; b=fTIqFTJaF1UtyxZz/uoeE+/oVvpqltS6ze9H2doS9s36h8mB2dbFbjV/Ht2jCA2usNRYFyVhXqwijusAOVREcyL9n2quqlxuoKLQlhsEQcXE8fB/ohim+HlVJ5JS/ous18yFu31FLFrqTyRrm1LiO1mZHp2W0j7ZsXP4lr5dNfCEtTUW4Zvreiac+2wrgDrVHUAEl9kKy/ga7+nUkYZ3HDHeUlU0nnGg7i9On04j5DaAPvH+SVBTTCGwsSvhMl47OtYwx+4uBlBWAnWN7AVHD0W25b+u1HZxUaHI7Sa/QVbmj74LweEZMRwFaMLruPXeS5wIldUoVXMODrSyJGVWNw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=windriver.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=abYUenOS03gdtyrVydZSAQmWQruT/C2BY517IDoaolM=; b=hpVnlKCGbo+UcE1h/zKcXsA3daSNbdJWdMwo1+Uldc/t96GpinAQy3RXDXBdfvcsnrAKwIYtoAHH5TahFlh9Hhgb3gBJJ2gX7nq9PjcYg940huEjKFUK+jWF1n4XithLBNXV223ePRRyCc9HssaKi5DvgKsvPeEo/byZbHxuWVk= Received: from SJ0PR03CA0336.namprd03.prod.outlook.com (2603:10b6:a03:39c::11) by SN7PR12MB6910.namprd12.prod.outlook.com (2603:10b6:806:262::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9870.19; Thu, 30 Apr 2026 03:21:04 +0000 Received: from SJ5PEPF000001D5.namprd05.prod.outlook.com (2603:10b6:a03:39c:cafe::69) by SJ0PR03CA0336.outlook.office365.com (2603:10b6:a03:39c::11) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9846.30 via Frontend Transport; Thu, 30 Apr 2026 03:21:04 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=satlexmb08.amd.com; pr=C Received: from satlexmb08.amd.com (165.204.84.17) by SJ5PEPF000001D5.mail.protection.outlook.com (10.167.242.57) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9846.18 via Frontend Transport; Thu, 30 Apr 2026 03:21:03 +0000 Received: from SATLEXMB04.amd.com (10.181.40.145) by satlexmb08.amd.com (10.181.42.217) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.2.2562.17; Wed, 29 Apr 2026 22:21:03 -0500 Received: from satlexmb07.amd.com (10.181.42.216) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 29 Apr 2026 22:21:02 -0500 Received: from [172.31.184.125] (10.180.168.240) by satlexmb07.amd.com (10.181.42.216) with Microsoft SMTP Server id 15.2.2562.17 via Frontend Transport; Wed, 29 Apr 2026 22:20:59 -0500 Message-ID: Date: Thu, 30 Apr 2026 08:50:58 +0530 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [Question] Possible scheduler regression: occasional ~3ms wake-up to sched-switch delay in cyclictest on kernel 6.6 and 6.12 To: Jiping Ma , , CC: , , , , , , , , References: <20260430025638.512420-1-jiping.ma2@windriver.com> Content-Language: en-US From: K Prateek Nayak In-Reply-To: <20260430025638.512420-1-jiping.ma2@windriver.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Received-SPF: None (SATLEXMB04.amd.com: kprateek.nayak@amd.com does not designate permitted sender hosts) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001D5:EE_|SN7PR12MB6910:EE_ X-MS-Office365-Filtering-Correlation-Id: c1e6fadf-9272-46a8-b4e7-08dea66782de X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|82310400026|36860700016|376014|7416014|13003099007|22082099003|56012099003|18002099003; X-Microsoft-Antispam-Message-Info: 9cU8bbzEhpnerIq/JnJJp4c/GHxinh3AEjuvKQaqCkqyETDPFQAnWPbaynRPjVW/sfgM7k+AG2RIMZD4zy0uDc52vY5E7FCeGMiU4ubcBpkLX8AiGrn8MM/Hwd5QSsDzUFSvSBIJKeuMiYiF43pLPxElgZEeiD3tQgPkHMr8IAjsLt2nI2r1lxeTZ2p80yJYzEbTsVnrr7skgx6FWcLKkUWb14E9Qbtu1tkSj6rZA1QqQzyFiejpgvGyJPzSmuO5FK6sbKDIYL/DafQvN7zpCovgHG2pk39XGrhz8BMqmr0SlSHGeFQl1sbm9jDKX8QzF/7Bq8qj1x2pKBRBB579Pa6FgQALtCchBH4ysDRWI8tv394DknW4Kl2+r7wprHENaxLHkT9tZHX9edCF9WtIySg8PdxsFueoBKlDwECI5OrM/e5xguCwY/hHo0879A5oyTq2x0NQkglKZqgbLGntgMctPW3xQ8BP1N+ZGJIusMar2S1neYDUlyMwtIScIdYp2tdxj0lGeyL5pOcH1ANvEgY+6P8xsGLhOSiQQMvZXncjmfGlRNqHK/3FEo0BHLdDTPokFo7kAM62ScifJ6F5iqxa9IqfgvXs3jixITL6I7iQom4+02uRT1dxx8cvoBBTsHGncR+xbFAM/ZxwtZN5DydsKt9W0BfT+cBbQuqdfp1r1+7Et91TEqb+J58Pj8TirUtxai7O9D+o0lQU2vLQgDpxTyRmFlSH0+4Ch9MO6XWGbrNfVEN74pAmP5w293XoNBWOJCvloNNAAD/bKiArA7mY4FvxOVNlrfuwD4vYeY4= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:satlexmb08.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(1800799024)(82310400026)(36860700016)(376014)(7416014)(13003099007)(22082099003)(56012099003)(18002099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: 36MR5xzcKT9KVYPk1KAKUG+RpZFwpSQlZOZ96q0ke2Qps6EQkoT+6tRLVTom3IPf0tW8MLpx8M7NStDHj+b5Z3fRdGmik0BkEkHeV6NkPCPlMrjffWskGbN09BGSfQIobTVE6qAnhsR1mCpApwUYGbgA+khrhnW9pydxerYYSgbMXl6TAnTNQrb4vLCrxcm08aNYvnY0Dyp4r49orPXk5Ofun/B6iex+qUX5oKVHobwd21ERHMGzxrfnnc/Zv/qeBqqxMLo0RBu9ACeTqpza8MLBHWFjwSVd7JZ9Dfnr4bLVZASKBv/IxGEJ5yxUcIFUcBmdtDaGcmEuunkfGXta7AoanEImeLGG6MNJGxZEXFrD5cTOGqWqmX5VmHbx+dNToimNabbsCfkPhk4lAYdH2dZ2RkYJwEGpL8p+S4VmLMOI+ifaEn6rYmll26M7r3NE X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Apr 2026 03:21:03.9319 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: c1e6fadf-9272-46a8-b4e7-08dea66782de X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[satlexmb08.amd.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001D5.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR12MB6910 Hello Jiping, On 4/30/2026 8:26 AM, Jiping Ma wrote: > [You don't often get email from jiping.ma2@windriver.com. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ] > > Hi, > > We are running cyclictest on x86 boards with standard (non-RT) kernels and observed an occasional but significant latency spike on kernel version 6.6 and 6.12. > > Issue: > During cyclictest under CPU contention, we occasionally see a ~3ms delay from wake-up to sched-switch ion kernel 6.6 and kernel 6.12. Most of the time the latency is comparable to kernel 5.15, but these sporadic spikes significantly impact the max latency. This behavior is not observed on kernel 5.15 under the same conditions. That seems equivalent of a base_slice so the cyclictest is perhaps waking up with positive lag (time owed to the scheduler) and that is the reason for that large tail latency. > > Test setup: > > Platform: x86 > Kernel type: std (non-RT) > Cyclictest command: ./cyclictest -m -N --policy=SCHED_OTHER -t 1 -D 30m -a 3 > CPU load: 6 instances of a pure CPU calculation shell script (cal.sh) bound to CPU 3, running in background to create contention > cal.sh (CPU stress script): > > #!/bin/sh > x=1 > while :; do > i=0 > while [ $i -lt 100000 ]; do > x=$(( (x * 1103515245 + 12345) & 0x7fffffff )) > i=$((i + 1)) > done > done > > Results (max latency, ns): > Kernel cyclictest max (ns) > 5.15 53,461 > 6.6 251,926 Can you try running with: echo NO_RUN_TO_PARITY > /sys/kernel/debug/sched/features That should make preemption faster on v6.6. > 6.12 110,861 At v6.12, the DELAY_DEQUEUE feature seems to have improved the tail by decaying lag while keeping the task on the runqueue. You can still try NO_RUN_TO_PARITY but the delay might still be close to the granularity of the 1ms tick. In v6.12, there is also PREEMPT_SHORT which would selectively disable RUN_TO_PARITY if a task of shorter slice wakes up - you can also try playing with that where you align the slice of cyclictest close to its actual runtime. Vincent was working on this exact same problem and there should be a bunch of fixes lined up in v7.1-rc1 + few more being discussed in the mailing list. In no particular order: https://lore.kernel.org/lkml/177583163838.801717.18173795801708799547.tip-bot2@tip-bot2/ https://lore.kernel.org/lkml/177521940443.1647592.2249539659928731910.tip-bot2@tip-bot2/ https://lore.kernel.org/lkml/177736116339.3521451.16868557879769343251.tip-bot2@tip-bot2/ https://lore.kernel.org/lkml/20260429164102.1388139-1-vincent.guittot@linaro.org/ https://lore.kernel.org/lkml/20260417171642.3539914-1-vincent.guittot@linaro.org/ The commit log from first few patches should have the slice values that Vincent was testing with. > > Key observation: > The majority of cyclictest samples show latency similar to kernel 5.15. However, there are occasional spikes where the wake-up to sched-switch gap reaches ~3ms. This suggests the scheduler is intermittently failing to preempt the running tasks promptly when the cyclictest thread wakes up. Since all tasks (cyclictest + 6x cal.sh) are SCHED_OTHER on the same CPU, this may be related to changes in the EEVDF scheduler introduced in kernel 6.6. > > Questions: > 1. Is this occasional preemption delay a known side effect of the EEVDF scheduler replacing CFS in kernel 6.6+? > 2. Is this by design, or should it be considered a scheduler bug? This is by design but there are workarounds to get around this by setting a slice value and disabling RUN_TO_PARITY. > > 3ms delay kernel trace log: > cal.sh-917 [003] d.h2. 1667.138647: sched_waking: comm=cyclictest pid=943 prio=120 target_cpu=003 > cal.sh-917 [003] d.h3. 1667.138648: sched_stat_runtime: comm=cal.sh pid=917 runtime=101740 [ns] > cal.sh-917 [003] d.h3. 1667.138649: sched_wakeup: comm=cyclictest pid=943 prio=120 target_cpu=003 > cal.sh-917 [003] d.h.. 1667.138649: hrtimer_expire_exit: hrtimer=00000000c56c84b4 > cal.sh-917 [003] d.h.. 1667.138649: write_msr: 6e0, value 42dd8d2cf32 > cal.sh-917 [003] d.h.. 1667.138649: local_timer_exit: vector=236 > cal.sh-917 [003] d.h.. 1667.139540: local_timer_entry: vector=236 > cal.sh-917 [003] d.h.. 1667.139540: hrtimer_expire_entry: hrtimer=000000007fd337f4 function=tick_sched_timer now=1665335000684 > cal.sh-917 [003] d.h1. 1667.139541: notifier_run: pvclock_gtod_notify [kvm] > cal.sh-917 [003] d.h.. 1667.139541: rcu_utilization: Start scheduler-tick > cal.sh-917 [003] d.h.. 1667.139541: rcu_utilization: End scheduler-tick > cal.sh-917 [003] d.h.. 1667.139542: read_msr: e8, value 4892b7c3d38 > cal.sh-917 [003] d.h.. 1667.139542: read_msr: e7, value 38088ff481e > cal.sh-917 [003] d.h1. 1667.139542: sched_stat_runtime: comm=cal.sh pid=917 runtime=894430 [ns] > cal.sh-917 [003] d.h.. 1667.139543: hrtimer_expire_exit: hrtimer=000000007fd337f4 > cal.sh-917 [003] d.h1. 1667.139543: hrtimer_start: hrtimer=000000007fd337f4 function=tick_sched_timer expires=1665336000000 softexpires=1665336000000 mode=ABS > cal.sh-917 [003] d.h.. 1667.139543: write_msr: 6e0, value 42dd8fc30e4 > cal.sh-917 [003] d.h.. 1667.139543: local_timer_exit: vector=236 > cal.sh-917 [003] d.h.. 1667.140540: local_timer_entry: vector=236 > cal.sh-917 [003] d.h.. 1667.140540: hrtimer_expire_entry: hrtimer=000000007fd337f4 function=tick_sched_timer now=1665336000925 > cal.sh-917 [003] d.h1. 1667.140541: notifier_run: pvclock_gtod_notify [kvm] > cal.sh-917 [003] d.h.. 1667.140541: rcu_utilization: Start scheduler-tick > cal.sh-917 [003] d.h.. 1667.140541: rcu_utilization: End scheduler-tick > cal.sh-917 [003] d.h.. 1667.140542: read_msr: e8, value 4892bb18743 > cal.sh-917 [003] d.h.. 1667.140542: read_msr: e7, value 380892863df > cal.sh-917 [003] d.h1. 1667.140542: sched_stat_runtime: comm=cal.sh pid=917 runtime=1000134 [ns] > cal.sh-917 [003] d.h.. 1667.140543: hrtimer_expire_exit: hrtimer=000000007fd337f4 > cal.sh-917 [003] d.h1. 1667.140543: hrtimer_start: hrtimer=000000007fd337f4 function=tick_sched_timer expires=1665337000000 softexpires=1665337000000 mode=ABS > cal.sh-917 [003] d.h.. 1667.140543: write_msr: 6e0, value 42dd92592a6 > cal.sh-917 [003] d.h.. 1667.140544: local_timer_exit: vector=236 > cal.sh-917 [003] d.h.. 1667.141540: local_timer_entry: vector=236 > cal.sh-917 [003] d.h.. 1667.141540: hrtimer_expire_entry: hrtimer=000000007fd337f4 function=tick_sched_timer now=1665337000748 > cal.sh-917 [003] d.h1. 1667.141541: notifier_run: pvclock_gtod_notify [kvm] > cal.sh-917 [003] d.h.. 1667.141541: rcu_utilization: Start scheduler-tick > cal.sh-917 [003] d.h.. 1667.141541: softirq_raise: vec=9 [action=RCU] > cal.sh-917 [003] d.h.. 1667.141541: rcu_utilization: End scheduler-tick > cal.sh-917 [003] d.h.. 1667.141542: read_msr: e8, value 4892be6cf1e > cal.sh-917 [003] d.h.. 1667.141542: read_msr: e7, value 38089517df9 > cal.sh-917 [003] dNh1. 1667.141542: sched_stat_runtime: comm=cal.sh pid=917 runtime=999991 [ns] ^ Since NEED_RESCHED is only set here, it is safe to assume cal.sh was likely kept running by RUN_TO_PARITY for 3ms after it was selected which corresponds to the default base_slice. > cal.sh-917 [003] dNh.. 1667.141543: hrtimer_expire_exit: hrtimer=000000007fd337f4 > cal.sh-917 [003] dNh1. 1667.141543: hrtimer_start: hrtimer=000000007fd337f4 function=tick_sched_timer expires=1665338000000 softexpires=1665338000000 mode=ABS > cal.sh-917 [003] dNh.. 1667.141543: write_msr: 6e0, value 42dd94ef44f > cal.sh-917 [003] dNh.. 1667.141543: local_timer_exit: vector=236 > cal.sh-917 [003] .Ns.. 1667.141544: softirq_entry: vec=9 [action=RCU] > cal.sh-917 [003] .Ns.. 1667.141544: rcu_utilization: Start RCU core > cal.sh-917 [003] dNs1. 1667.141544: rcu_grace_period: rcu_preempt 589121 cpuend > cal.sh-917 [003] dNs.. 1667.141544: rcu_batch_start: rcu_preempt CBs=1 bl=10 > cal.sh-917 [003] dNs.. 1667.141545: rcu_segcb_stats: SegCbDequeued seglen: (DONE=0, WAIT=0, NEXT_READY=0, NEXT=0) gp_seq: (DONE=0, WAIT=589124, NEXT_READY=589124, NEXT=0) > cal.sh-917 [003] .Ns.. 1667.141545: rcu_invoke_callback: rcu_preempt rhp=00000000be314949 func=file_free_rcu > cal.sh-917 [003] .Ns.. 1667.141545: kmem_cache_free: call_site=file_free_rcu+0x35/0x60 ptr=00000000be314949 name=kmalloc-cg-256 > cal.sh-917 [003] dNs.. 1667.141545: rcu_batch_end: rcu_preempt CBs-invoked=1 idle=.S.. > cal.sh-917 [003] .Ns.. 1667.141545: rcu_utilization: End RCU core > cal.sh-917 [003] .Ns.. 1667.141546: softirq_exit: vec=9 [action=RCU] > cal.sh-917 [003] dN.1. 1667.141546: rcu_utilization: Start context switch > cal.sh-917 [003] dN.1. 1667.141546: rcu_utilization: End context switch > cal.sh-917 [003] dN.2. 1667.141546: sched_stat_runtime: comm=cal.sh pid=917 runtime=4083 [ns] > cal.sh-917 [003] d..2. 1667.141547: sched_switch: prev_comm=cal.sh prev_pid=917 prev_prio=120 prev_state=R ==> next_comm=cyclictest next_pid=943 next_prio=120 -- Thanks and Regards, Prateek