FYI, we noticed that fsmark.time.involuntary_context_switches -35.1% change on ========================================================================================= compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase: gcc-4.9/performance/1HDD/9B/xfs/1x/x86_64-rhel/16d/256fpd/32t/debian-x86_64-2015-02-07.cgz/fsyncBeforeClose/lkp-sb02/400M/fsmark commit: 5569d5f86db30a2d202ed57222a177d32a2234b3 f7486eef5ea239905ed71f2316a40eae757ffed2 5569d5f86db30a2d f7486eef5ea239905ed71f2316 ---------------- -------------------------- fail:runs %reproduction fail:runs %stddev %change %stddev \ | \ 106141 ± 0% -35.1% 68920 ± 0% fsmark.time.involuntary_context_switches 342173 ± 0% +35.8% 464725 ± 0% fsmark.time.voluntary_context_switches 284.90 ± 4% -41.7% 166.22 ± 18% slabinfo.blkdev_requests.num_objs 106141 ± 0% -35.1% 68920 ± 0% time.involuntary_context_switches 342173 ± 0% +35.8% 464725 ± 0% time.voluntary_context_switches 27.89 ± 28% -20.6% 22.16 ± 2% turbostat.CPU%c6 9.13 ± 11% +13.2% 10.34 ± 0% turbostat.CorWatt 6.91 ± 65% -38.0% 4.28 ± 5% turbostat.Pkg%pc6 12.63 ± 8% +9.7% 13.85 ± 0% turbostat.PkgWatt 48250249 ± 1% +101.0% 96965425 ± 1% cpuidle.C1-SNB.time 95999 ± 2% +69.6% 162769 ± 0% cpuidle.C1-SNB.usage 2.015e+08 ± 4% +15.3% 2.325e+08 ± 1% cpuidle.C1E-SNB.time 185631 ± 4% +23.7% 229659 ± 1% cpuidle.C1E-SNB.usage 15292 ± 2% +32.4% 20248 ± 2% cpuidle.C3-SNB.usage 563.70 ± 23% -23.9% 429.22 ± 7% cpuidle.POLL.usage 38.96 ± 18% +183.2% 110.33 ± 35% sched_debug.cfs_rq:/.exec_clock.stddev -4107 ± -4% -64.2% -1470 ±-30% sched_debug.cpu.nr_uninterruptible.min 2469 ± 3% -53.6% 1145 ± 31% sched_debug.cpu.nr_uninterruptible.stddev 28646 ± 1% +45.2% 41602 ± 34% sched_debug.cpu.sched_goidle.avg 19183 ± 3% +74.9% 33552 ± 33% sched_debug.cpu.sched_goidle.min 16895 ± 4% +55.3% 26246 ± 35% sched_debug.cpu.ttwu_count.min 0.00 ± -1% +Inf% 19531 ± 7% latency_stats.avg.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio._xfs_buf_ioapply.xfs_buf_submit.xlog_bdstrat.xlog_sync.xlog_state_release_iclog._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range 0.00 ± -1% +Inf% 19304 ± 2% latency_stats.avg.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio.xfs_submit_ioend_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.filemap_write_and_wait_range.xfs_file_fsync.vfs_fsync_range 41.10 ± 20% +25703.2% 10605 ± 1% latency_stats.avg.flush_work.xlog_cil_force_lsn._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range.do_fsync.SyS_fsync.entry_SYSCALL_64_fastpath 0.00 ± -1% +Inf% 49655 ± 0% latency_stats.hits.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio.xfs_submit_ioend_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.filemap_write_and_wait_range.xfs_file_fsync.vfs_fsync_range 401.30 ± 13% +17370.5% 70109 ± 1% latency_stats.hits.flush_work.xlog_cil_force_lsn._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range.do_fsync.SyS_fsync.entry_SYSCALL_64_fastpath 1.20 ± 62% +8.9e+05% 10737 ± 5% latency_stats.hits.xlog_cil_force_lsn._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range.do_fsync.SyS_fsync.entry_SYSCALL_64_fastpath 0.00 ± -1% +Inf% 107042 ± 34% latency_stats.max.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio._xfs_buf_ioapply.xfs_buf_submit.xlog_bdstrat.xlog_sync.xlog_state_release_iclog._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range 0.00 ± -1% +Inf% 215477 ± 7% latency_stats.max.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio.xfs_submit_ioend_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.filemap_write_and_wait_range.xfs_file_fsync.vfs_fsync_range 752.00 ±164% +17984.7% 135997 ± 11% latency_stats.max.flush_work.xlog_cil_force_lsn._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range.do_fsync.SyS_fsync.entry_SYSCALL_64_fastpath 0.00 ± -1% +Inf% 1548061 ± 14% latency_stats.sum.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio._xfs_buf_ioapply.xfs_buf_submit.xlog_bdstrat.xlog_sync.xlog_state_release_iclog._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range 0.00 ± -1% +Inf% 9.584e+08 ± 1% latency_stats.sum.blk_wb_wait.blk_queue_bio.generic_make_request.submit_bio.xfs_submit_ioend_bio.xfs_submit_ioend.xfs_vm_writepages.do_writepages.__filemap_fdatawrite_range.filemap_write_and_wait_range.xfs_file_fsync.vfs_fsync_range 16575 ± 19% +4.5e+06% 7.436e+08 ± 2% latency_stats.sum.flush_work.xlog_cil_force_lsn._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range.do_fsync.SyS_fsync.entry_SYSCALL_64_fastpath 6.10 ±187% +8.6e+06% 524627 ± 26% latency_stats.sum.xlog_cil_force_lsn._xfs_log_force_lsn.xfs_file_fsync.vfs_fsync_range.do_fsync.SyS_fsync.entry_SYSCALL_64_fastpath lkp-sb02: Sandy Bridge-EP Memory: 4G fsmark.time.voluntary_context_switches 500000 ++-----------------------------------------------------------------+ 450000 OO O O O O O OO O OO O OO O OOO OO OOOOOOOOO OOOOO | | | 400000 ++ | 350000 *+ *** * ** * ** * * * ** * ** *** ******* **** ***.* ********* |** : : :: : :: : :* : :: : : *.* ** * * * | 300000 ++ : : :: : :: : :: : :: : : | 250000 ++ : : : : : :: : :: : :: : : | 200000 ++ : : : : : :: : :: : :: : : | | :::: : ::: ::::: ::: :::: | 150000 ++ : : :: : : : : : : : | 100000 ++ : : :: : : : : : : : | | : : : : : : : : : : | 50000 ++ : : : : : : : : : : | 0 ++O-OO*O*O--O-O--O-O--O-O--O-O------O---------O--------------------+ fsmark.time.involuntary_context_switches 120000 ++-----------------------------------------------------------------+ | | 100000 ****** * ** * ** * ** * ** * ***.**********************.*********** | : : :: : :: : :: : :: : : | | : : :: : :: : :: : :: : : | 80000 ++ : : : : : :: : :: : :: : : | OO O :O:O:O: O OO O OO O OO O OOO OO OOOOOOOOO OOOOO | 60000 ++ : : : : : :: : :: : :: : : | | :::: : ::: :::: :::: :::: | 40000 ++ : : :: : : : : : : : | | : : :: : : : : : : : | | : : : : : : : : : : | 20000 ++ : : : : : : : : : : | | : : : : : : : : : : | 0 ++O-OO*O*O--O-O--O-O--O-O--O-O------O---------O--------------------+ [*] bisect-good sample [O] bisect-bad sample To reproduce: git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Xiaolong Ye