FYI, we noticed the below changes on https://git.kernel.org/pub/scm/linux/kernel/git/mel/linux-balancenuma mm-vmscan-node-lru-v2r25 commit d81d90cdf683f40d14b064cdcecb840a386e00c3 ("mm, vmscan: Only wakeup kswapd once per node for the requested classzone") ========================================================================================= compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase: gcc-4.9/performance/1BRD_48G/4M/xfs/1x/x86_64-rhel/64t/debian-x86_64-2015-02-07.cgz/NoSync/ivb44/40G/fsmark commit: da9d35c7cc19983b355c3d79f9c2d3314718934f d81d90cdf683f40d14b064cdcecb840a386e00c3 da9d35c7cc19983b d81d90cdf683f40d14b064cdce ---------------- -------------------------- %stddev %change %stddev \ | \ 10242 ± 25% +449.1% 56234 ± 42% fsmark.time.file_system_inputs 206.88 ± 3% +25.0% 258.50 ± 2% fsmark.time.percent_of_cpu_this_job_got 41.96 ± 1% +24.9% 52.40 ± 1% fsmark.time.system_time 40698 ± 11% +23.2% 50158 ± 10% softirqs.RCU 3.88 ± 86% +3061.3% 122.50 ± 55% sched_debug.cfs_rq:/.util_avg.24 234.62 ± 60% -64.8% 82.50 ± 58% sched_debug.cpu.ttwu_local.16 2831861 ± 29% -46.9% 1504545 ± 10% numa-vmstat.node0.nr_file_pages 2817819 ± 29% -47.1% 1490984 ± 11% numa-vmstat.node0.nr_inactive_file 90864 ± 13% -32.4% 61413 ± 9% numa-vmstat.node0.nr_slab_reclaimable 10242 ± 25% +449.1% 56234 ± 42% time.file_system_inputs 206.88 ± 3% +25.0% 258.50 ± 2% time.percent_of_cpu_this_job_got 41.96 ± 1% +24.9% 52.40 ± 1% time.system_time 11329789 ± 29% -46.9% 6018095 ± 11% numa-meminfo.node0.FilePages 11277226 ± 29% -47.1% 5968386 ± 11% numa-meminfo.node0.Inactive 11273648 ± 29% -47.1% 5963859 ± 11% numa-meminfo.node0.Inactive(file) 363543 ± 13% -32.4% 245672 ± 9% numa-meminfo.node0.SReclaimable 413977 ± 11% -28.7% 295254 ± 7% numa-meminfo.node0.Slab 5418592 ± 2% -20.6% 4301600 ± 14% slabinfo.buffer_head.active_objs 138939 ± 2% -20.6% 110304 ± 14% slabinfo.buffer_head.active_slabs 5418650 ± 2% -20.6% 4301893 ± 14% slabinfo.buffer_head.num_objs 138939 ± 2% -20.6% 110304 ± 14% slabinfo.buffer_head.num_slabs 6333 ± 1% -13.4% 5485 ± 8% slabinfo.xfs_inode.active_objs 6436 ± 1% -13.7% 5556 ± 7% slabinfo.xfs_inode.num_objs 427.12 ± 40% +525.3% 2670 ± 65% vmstat.io.bi 1578153 ± 2% +2.5% 1617055 ± 1% vmstat.io.bo 23143986 ± 2% -20.4% 18431559 ± 14% vmstat.memory.cache 24826852 ± 2% +19.1% 29569065 ± 9% vmstat.memory.free 8802 ± 7% +1954.0% 180812 ± 9% vmstat.system.cs 4468 ± 3% +61.0% 7192 ± 7% vmstat.system.in 3760 ± 26% +9446.2% 358948 ± 10% cpuidle.C1-IVT.usage 15921601 ± 18% +47.6% 23505095 ± 5% cpuidle.C1E-IVT.time 9827 ± 17% +73.3% 17034 ± 5% cpuidle.C1E-IVT.usage 11201827 ± 9% +22.8% 13753015 ± 5% cpuidle.C3-IVT.time 4247 ± 15% +36.6% 5801 ± 5% cpuidle.C3-IVT.usage 9.214e+08 ± 2% -11.0% 8.201e+08 ± 3% cpuidle.C6-IVT.time 417275 ± 78% +13463.9% 56598978 ± 22% cpuidle.POLL.time 3552 ± 67% +20425.7% 729251 ± 11% cpuidle.POLL.usage 6.94 ± 1% +110.6% 14.61 ± 10% turbostat.%Busy 219.25 ± 1% +104.8% 449.00 ± 10% turbostat.Avg_MHz 11.93 ± 8% +85.4% 22.11 ± 4% turbostat.CPU%c1 1.91 ± 9% +23.7% 2.36 ± 6% turbostat.CPU%c3 79.23 ± 1% -23.1% 60.93 ± 4% turbostat.CPU%c6 69.46 ± 1% +24.8% 86.66 ± 1% turbostat.CorWatt 16.74 ± 19% -73.6% 4.42 ± 31% turbostat.Pkg%pc2 101.45 ± 1% +16.9% 118.57 ± 1% turbostat.PkgWatt 702680 ± 2% -18.0% 576354 ± 12% meminfo.Active 698293 ± 2% -18.1% 572094 ± 12% meminfo.Active(file) 22145325 ± 2% -20.2% 17670757 ± 13% meminfo.Cached 26033970 ± 2% +17.5% 30581446 ± 8% meminfo.Inactive 26033970 ± 2% +17.5% 30581446 ± 8% meminfo.Inactive(anon) 27171589 ± 2% +15.8% 31466704 ± 7% meminfo.MemAvailable 26033979 ± 2% +17.5% 30581451 ± 8% meminfo.MemFree 698293 ± 2% -18.1% 572094 ± 12% meminfo.SReclaimable 796237 ± 1% -16.0% 668770 ± 10% meminfo.Slab 3745917 ± 4% +46.8% 5499519 ± 31% proc-vmstat.kswapd_inodesteal 3389 ±129% +57644.8% 1957115 ± 9% proc-vmstat.kswapd_low_wmark_hit_quickly 5535200 ± 2% -20.2% 4417021 ± 13% proc-vmstat.nr_file_pages 6511739 ± 2% +17.5% 7648296 ± 8% proc-vmstat.nr_free_pages 5507008 ± 2% -20.3% 4389409 ± 13% proc-vmstat.nr_inactive_file 174533 ± 2% -18.1% 142996 ± 12% proc-vmstat.nr_slab_reclaimable 132190 ± 36% +1467.4% 2071908 ± 8% proc-vmstat.pageoutrun 3894864 ± 4% +45.6% 5669363 ± 31% proc-vmstat.pgfree 9573 ± 41% +528.1% 60129 ± 64% proc-vmstat.pgpgin ivb44: Ivytown Ivy Bridge-EP Memory: 64G vm-lkp-wsx03-yocto-x86_64: qemu-system-x86_64 -enable-kvm -cpu SandyBridge Memory: 320M vmstat.system.in 11000 ++------------------------------------------------------------------+ O | 10000 ++ O O | | O O | 9000 ++ | | O O OO O O | 8000 ++ O O O O | | O O O O O OO O | 7000 ++ O O O O O O O O O O O | | O O O | 6000 ++ | | | 5000 ++ .*. | |.* .*.*.**.*.* .*.**.*.*.**. .* .*.* .*. .**.*.**.*.** *.**.*.**.* 4000 *+-*-----------*-------------*--*----*---*--------------------------+ vmstat.system.cs 300000 ++-----------------------------------------------------------------+ | | 250000 ++ O O | O O O | | O O O O O O O | 200000 ++ O O O O O O O OO OO O | | O O O O O OO O O OO O | 150000 ++ O | | | 100000 ++ | | | | | 50000 ++ | |.* .*. .*. .* | 0 *+-*-*-**-*-**-*-**-*-**---**---*-**-*--*-*-**-*-**-*-**-*-**-*-**-* proc-vmstat.kswapd_low_wmark_hit_quickly 3e+06 ++----------------------------------------------------------------+ | O O | 2.5e+06 ++ O O | O O O O O | | O O O O O O O O O | 2e+06 ++ O O O OO OO O O O O O OO O O O | | O O | 1.5e+06 ++ | | | 1e+06 ++ | | | | | 500000 ++ | | | 0 *+**-*-**-*-**-*-**-**-*-**-*-**-*-**-*-**-*-**-*-**-**-*-**-*-**-* proc-vmstat.pageoutrun 3e+06 ++----------------------------------------------------------------+ | O O O O | 2.5e+06 O+ O O | | O O O | | O O O O O OO O O O O O OO OO O O | 2e+06 ++ O OO O O O OO | | O | 1.5e+06 ++ | | | 1e+06 ++ | | | | | 500000 ++ | | .* .*.**.**.*.* .*. .* 0 *+**-*-**-*-**-*-**-**-*-**-*-**-*-**-*-**-*--*------------*---**-+ cpuidle.POLL.time 9e+07 ++------------------------------------------------------------------+ | O | 8e+07 ++ O O O | 7e+07 ++ O O O O | O OO O O | 6e+07 ++ O O O O O O O | 5e+07 ++ O O O O O O OO | | O O O O O O O | 4e+07 ++ O O | 3e+07 ++ | | | 2e+07 ++ | 1e+07 ++ | | | 0 *+**-*-*-**-*-**-*-**-*-*-**-*-**-*-**-*-*-**-*-**-*-**-*-*-**-*-**-* cpuidle.POLL.usage 1.2e+06 ++----------------------------------------------------------------+ | O | 1e+06 ++ O O O | O O O | | O O | 800000 ++ O O O O O O O O O O O | | O O OO O O O O O OO O O | 600000 ++ O O O O | | | 400000 ++ | | | | | 200000 ++ | | | 0 *+**-*-**-*-**-*-**-**-*-**-*-**-*-**-*-**-*-**-*-**-**-*-**-*-**-* turbostat.Avg_MHz 550 ++----------------------------O-------------O-------------------------+ | O O O | 500 ++ O O OO O OO | | O O O | 450 O+ O O O O O O | | O O O O O O O O O O | 400 ++O O O O O | | | 350 ++ | | | 300 ++ | | | 250 ++ | *.*.**.*.*.**.*.*.**.*.*.**.*.*.**.*.*.**.*.*.**.*.*.**.*.*.**.*.*.**.* 200 ++--------------------------------------------------------------------+ turbostat._Busy 18 ++----------------------------O-------------O--------------------------+ | O O O | 16 ++ O O O O O O O | | O O O | O O O O O O O O O | 14 ++ O O O O O O O O | | O O O O O | 12 ++ | | | 10 ++ | | | | | 8 ++ | *.*.**.*.*.**.*.*.*.**.*.*.**.*.*.*.**.*.*.**.*.*.**.*.*.*.**.*.*.**.*.* 6 ++---------------------------------------------------------------------+ turbostat.CPU_c1 26 ++---------------------------------------------------------------------+ | | 24 ++ O O O O O O O O O | 22 O+ O O O O O O O | | O O O O OO O O O O O O OO O O | 20 ++ O O O O | | | 18 ++ | | | 16 ++ | 14 ++ | | .* | 12 *+*. *.*.*.* *.*. .*.*. .**.*.*. *.*.*. *.*.*.* *.*.*. | | * *. .*.*.* *.** * * * **.*.* 10 ++------------*--------------------------------------------------------+ turbostat.CPU_c6 85 ++---------------------------------------------------------------------+ | | 80 ++ .**.*.*. .* *. .* .* .*.* *.*.**.*.* * *.*.*.* *.*.*.**.*.*.**.*.* *.*.*.*. *.*.* * | | * | 75 ++ | | | 70 ++ | | | 65 ++ O O | | O O O O O O O O O | | O O O O O O O O O | 60 O+ O O O O O O O O O | | O O O O O O O | 55 ++---------------------------------------------------------------------+ turbostat.PkgWatt 130 ++--------------------------------------------------------------------+ | O O | 125 ++ O O | O O O O O O | 120 ++O O O O O O O O O O O | | O O O O O O O O O O O O O | 115 ++ O | | O O | 110 ++ | | | 105 ++ * | |.*.**. +: * .*. .**.*. *.*.*. .* .*.**. .* .* 100 *+ *.* :.* + : ** * *.* **.* + *.* *.* * | | * + .** : + * | 95 ++--------------*------*----------------------------------------------+ turbostat.CorWatt 95 ++----------------------------O-------------O--------------------------+ | | 90 ++ OO O O O O O O | O O O O O O O O O O O O O O O O | 85 ++ O O O O O O O O O | | O O | 80 ++ | | | 75 ++ | | *. .* *. *. | 70 ++ **.*.* : * *. *. + *.**. + **.*. .**. .*. .**.*. *.*.* * *.*. .*.* + + * * * * * * *.* | 65 ++ * * | | | 60 ++---------------------------------------------------------------------+ fsmark.time.system_time 56 ++---------------------------------------------------------------------+ | O O O O O O O OO | 54 ++ O O O O O O | 52 ++ O O O OO O O O O O OO O | | O O O O | 50 ++ O O | 48 O+O O | | | 46 ++ | 44 ++ | *. .* *. .*.*. .**.*. .*. .*. .* *. *. .* | 42 ++* *.*.*.* * **.*.* * ** * *.*.* : *.*.*.* * + *. .* 40 ++ +: * * | | * | 38 ++---------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample To reproduce: git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Ying Huang