mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Mike Galbraith <efault@gmx.de>
To: Christoph Lameter <cl@linux-foundation.org>
Cc: "Rafael J. Wysocki" <rjw@sisk.pl>,
	Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
	Kernel Testers List <kernel-testers@vger.kernel.org>
Subject: Re: [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28
Date: Mon, 15 Sep 2008 12:44:00 +0200	[thread overview]
Message-ID: <1221475440.4784.39.camel@marge.simson.net> (raw)
In-Reply-To: <1221421907.4597.24.camel@marge.simson.net>

On Sun, 2008-09-14 at 21:51 +0200, Mike Galbraith wrote:
> On Sun, 2008-09-14 at 09:18 -0500, Christoph Lameter wrote:
> > Mike Galbraith wrote:
> > > Numbers from my Q6600 Aldi supermarket box (hm, your box is from different shelf)
> > >   
> > My box is an 8p with recent quad core processors. 8G, 32bit Linux.
> 
> Don't hold your breath, but after putting my network config of a very
> severe diet, I'm starting to see something resembling sensible results.

Turns off all netfilter options except tables, etc.

Since 2.6.22.19-cfs-v24.1 and 2.6.23.17-cfs-v24.1 schedulers are
identical, and these are essentially identical with 2.6.24.7, what I
read from numbers below is that cfs in 2.6.23 was somewhat less than
wonderful for either netperf or tbench,  Something happened somewhere
other than the scheduler at 23->24 which cost us some performance, and
another something happened at 26->27.  I'll likely go looking again..
and likely regret it again ;-)

Math ain't free is part of it, though apparently not much.  For me,
tbench regression 22->27 is ~10%, and netperf regression is ~16%.

Data:

2.6.22.19

Throughput 1250.73 MB/sec 4 procs                  1.00

16384  87380  1        1       60.01    111272.55  1.00
16384  87380  1        1       60.00    104689.58
16384  87380  1        1       60.00    110733.05
16384  87380  1        1       60.00    110748.88

2.6.22.19-cfs-v24.1

Throughput 1204.14 MB/sec 4 procs                  .962

16384  87380  1        1       60.01    101799.85  .929
16384  87380  1        1       60.01    101659.41
16384  87380  1        1       60.01    101628.78
16384  87380  1        1       60.01    101700.53

wakeup granularity = 0 (make scheduler as preempt happy as 2.6.22 is)

Throughput 1213.21 MB/sec 4 procs                  .970

16384  87380  1        1       60.01    108569.27  .992
16384  87380  1        1       60.01    108541.04
16384  87380  1        1       60.00    108579.63
16384  87380  1        1       60.01    108519.09

2.6.23.17

Throughput 1192.49 MB/sec 4 procs                  .953

16384  87380  1        1       60.00    91124.67   .866
16384  87380  1        1       60.00    93124.38
16384  87380  1        1       60.01    92249.69
16384  87380  1        1       60.01    91103.12

wakeup granularity = 0

Throughput 1200.46 MB/sec 4 procs                  .959

16384  87380  1        1       60.01    95987.66   .866
16384  87380  1        1       60.01    92819.98
16384  87380  1        1       60.01    95454.00
16384  87380  1        1       60.01    94834.84

2.6.23.17-cfs-v24.1

Throughput 1242.47 MB/sec 4 procs                  .993

16384  87380  1        1       60.00    101728.34  .931
16384  87380  1        1       60.00    101930.23
16384  87380  1        1       60.00    101803.15
16384  87380  1        1       60.00    101908.29

wakeup granularity = 0

Throughput 1238.68 MB/sec 4 procs                  .990

16384  87380  1        1       60.01    105871.52  .969
16384  87380  1        1       60.01    105813.11
16384  87380  1        1       60.01    106106.31
16384  87380  1        1       60.01    106310.20

2.6.24.7

Throughput 1202.49 MB/sec 4 procs                  .961

16384  87380  1        1       60.00    94643.23   .868
16384  87380  1        1       60.00    94754.37
16384  87380  1        1       60.00    94909.77
16384  87380  1        1       60.00    95457.41

wakeup granularity = 0

Throughput 1204 MB/sec 4 procs                     .962

16384  87380  1        1       60.00    99599.27   .910
16384  87380  1        1       60.00    99439.95
16384  87380  1        1       60.00    99556.38
16384  87380  1        1       60.00    99500.45

2.6.25.17

Throughput 1220.47 MB/sec 4 procs                  .975

16384  87380  1        1       60.00    94641.06   .867
16384  87380  1        1       60.00    94864.87
16384  87380  1        1       60.01    95033.81
16384  87380  1        1       60.00    94863.49

wakeup granularity = 0

Throughput 1223.16 MB/sec 4 procs                  .977
16384  87380  1        1       60.00    101768.95  .930
16384  87380  1        1       60.00    101888.46
16384  87380  1        1       60.01    101608.21
16384  87380  1        1       60.01    101833.05

2.6.26.5

Throughput 1182.24 MB/sec 4 procs                  .945

16384  87380  1        1       60.00    93814.75   .854
16384  87380  1        1       60.00    94173.41
16384  87380  1        1       60.00    92925.24
16384  87380  1        1       60.00    93002.51

wakeup granularity = 0

Throughput 1183.47 MB/sec 4 procs                  .945

16384  87380  1        1       60.00    100837.12  .922
16384  87380  1        1       60.00    101230.12
16384  87380  1        1       60.00    100868.45
16384  87380  1        1       60.00    100491.41

2.6.27

Throughput 1088.17 MB/sec 4 procs                  .870

16384  87380  1        1       60.00    84225.59   .766
16384  87380  1        1       60.00    83362.65
16384  87380  1        1       60.00    84060.73
16384  87380  1        1       60.00    83462.72

wakeup granularity = 0

Throughput 1116.22 MB/sec 4 procs                  .892

16384  87380  1        1       60.00    92502.44   .841
16384  87380  1        1       60.01    92213.72
16384  87380  1        1       60.00    91445.86
16384  87380  1        1       60.00    91832.84

revert sched weight/asym changes, gran = 0

Throughput 1149.16 MB/sec 4 proc                   .918

16384  87380  1        1       60.00    94824.92   .868
16384  87380  1        1       60.01    94579.45
16384  87380  1        1       60.01    95284.94
16384  87380  1        1       60.01    95228.22

Weight/asym changes cost ~3%.  Mysql+oltp agrees.  Preempt happy loads
lose a bit, preempt haters gain a bit.  Performance shift.




  reply	other threads:[~2008-09-15 10:44 UTC|newest]

Thread overview: 191+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-09-12 18:59 2.6.27-rc6-git2: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-09-12 18:59 ` [Bug #11207] VolanoMark regression with 2.6.27-rc1 Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11220] Screen stays black after resume Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11215] INFO: possible recursive locking detected ps2_command Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11210] libata badness Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11237] corrupt PMD after resume Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11230] Kconfig no longer outputs a .config with freshly updated defconfigs Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11224] Only three cores found on quad-core machine Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11264] Invalid op opcode in kernel/workqueue Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11271] BUG: fealnx in 2.6.27-rc1 Rafael J. Wysocki
2008-09-13  8:47   ` Jaswinder Singh
2008-09-12 19:06 ` [Bug #11272] BUG: parport_serial in 2.6.27-rc1 for NetMos Technology PCI 9835 Rafael J. Wysocki
2008-09-16 15:25   ` Jaswinder Singh
2008-09-12 19:06 ` [Bug #11276] build error: CONFIG_OPTIMIZE_INLINING=y causes gcc 4.2 to do stupid things Rafael J. Wysocki
2008-09-12 20:46   ` Randy Dunlap
2008-09-12 21:19     ` Rafael J. Wysocki
2008-09-17 14:26       ` Bjorn Helgaas
2008-09-12 19:06 ` [Bug #11340] LTP overnight run resulted in unusable box Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11336] 2.6.27-rc2:stall while mounting root fs Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11335] 2.6.27-rc2-git5 BUG: unable to handle kernel paging request Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-09-12 22:05   ` Christoph Lameter
2008-09-13 11:44     ` Mike Galbraith
2008-09-13 11:57       ` Mike Galbraith
2008-09-14  6:24       ` Mike Galbraith
2008-09-14  7:02         ` Mike Galbraith
2008-09-14 14:18       ` Christoph Lameter
2008-09-14 19:51         ` Mike Galbraith
2008-09-15 10:44           ` Mike Galbraith [this message]
2008-09-16 12:28             ` Mike Galbraith
2008-09-16 14:07               ` Ilpo Järvinen
2008-09-17  4:39                 ` Mike Galbraith
2008-09-17  5:01                   ` Mike Galbraith
2008-09-17 10:40                     ` Ingo Molnar
2008-09-17 11:41                       ` Mike Galbraith
2008-09-17 12:49                         ` Ingo Molnar
2008-09-17 13:11                           ` Mike Galbraith
2008-09-17 13:36                             ` Ilpo Järvinen
2008-09-17 13:57                               ` Mike Galbraith
2008-09-17 17:04                                 ` Ilpo Järvinen
2008-09-18  7:12                                 ` Mike Galbraith
2008-09-18  7:25                                   ` Mike Galbraith
2008-09-18  7:58                                     ` Ilpo Järvinen
2008-09-17 14:47                             ` Eric Dumazet
2008-09-17 14:50                               ` Eric Dumazet
2008-09-17 18:16                               ` Mike Galbraith
2008-09-12 19:06 ` [Bug #11357] Can not boot up with zd1211rw USB-Wlan Stick Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11358] net: forcedeth call restore mac addr in nv_shutdown path Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11380] lockdep warning: cpu_add_remove_lock at:cpu_maps_update_begin+0x14/0x16 Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11343] SATA Cold Boot Problems with 2.6.27-rc[23] on nVidia 680i Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11398] hda_intel: IRQ timing workaround is activated for card #0. Suggest a bigger bdl_pos_adj Rafael J. Wysocki
2008-09-13  7:37   ` Frans Pop
2008-09-13 17:23     ` Takashi Iwai
2008-09-15  0:13       ` Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11404] BUG: in 2.6.23-rc3-git7 in do_cciss_intr Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11382] e1000e: 2.6.27-rc1 corrupts EEPROM/NVM Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11407] suspend: unable to handle kernel paging request Rafael J. Wysocki
2008-09-12 20:50   ` Vegard Nossum
2008-09-12 19:06 ` [Bug #11465] Linux-2.6.27-rc5, drm errors in log Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11463] sshd hangs on close Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11459] kernel crash after wifi connection established Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11442] btusb hibernation/suspend breakage in current -git Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11439] [2.6.27-rc4-git4] compilation warnings Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11471] GPE storm detected, kernel freezes Rafael J. Wysocki
2008-09-16  5:50   ` Zhang Rui
2008-09-12 19:06 ` [Bug #11485] 2.6.27-rc xen pvops regression? Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11500] /proc/net bug related to selinux Rafael J. Wysocki
2008-09-12 22:14   ` James Morris
2008-09-12 22:24     ` Andrew Morton
2008-09-13  0:15       ` James Morris
2008-09-13 19:37         ` Andrew Morton
2008-09-15  0:16           ` Rafael J. Wysocki
2008-09-15 13:05           ` Stephen Smalley
2008-09-15 13:42             ` Stephen Smalley
2008-09-17 19:50             ` Andrew Morton
2008-09-17 21:24               ` Paul Moore
2008-09-17 21:39                 ` Eric W. Biederman
2008-09-17 22:11                   ` Andrew Morton
2008-09-17 21:48                 ` Andrew Morton
2008-09-17 22:12                   ` Paul Moore
2008-09-17 22:24                     ` Andrew Morton
2008-09-17 22:53                       ` Eric W. Biederman
2008-09-17 22:32                   ` Eric W. Biederman
2008-09-18 12:38                     ` Stephen Smalley
2008-09-18 13:03                       ` Stephen Smalley
2008-09-18 18:09                         ` Eric W. Biederman
2008-09-18 18:34                           ` Stephen Smalley
2008-09-19 16:58                             ` david
2008-09-19 17:07                               ` Stephen Smalley
2008-09-29 16:49                             ` Stephen Smalley
2008-09-17 22:23                 ` David Miller
2008-09-17 21:56               ` Eric W. Biederman
2008-09-12 19:06 ` [Bug #11501] Failed to open destination file: Permission deniedihex2fw Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11476] failure to associate after resume from suspend to ram Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11505] oltp ~10% regression with 2.6.27-rc5 on stoakley machine Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11506] oops during unmount - ext3? (2.6.27-rc5) Rafael J. Wysocki
2008-09-19 16:17   ` Marcin Slusarz
2008-09-12 19:06 ` [Bug #11507] usb: sometimes dead keyboard after boot Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11512] sort-of regression due to "kconfig: speed up all*config + randconfig" Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11549] 2.6.27-rc5 acpi: EC Storm error message on bootup Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11516] severe performance degradation on x86_64 going from 2.6.26-rc9 -&gt; 2.6.27-rc5 Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11548] kernel BUG at drivers/pci/intel-iommu.c:1373! Rafael J. Wysocki
2008-09-12 20:56   ` Chris Mason
2008-09-12 21:21     ` Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11547] build issue #565 for v2.6.27-rc5 : undefined reference to `ei_interrupt' in hp-plus.c Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11550] pnp: Huge number of "io resource overlap" messages Rafael J. Wysocki
2008-09-12 22:52   ` Rene Herman
2008-09-12 19:06 ` [Bug #11552] Disabling IRQ #23 Rafael J. Wysocki
2008-09-13  3:24   ` Justin Mattock
2008-09-12 19:06 ` [Bug #11554] Partition check considered as error is breaking mounting in 2.6.27 Rafael J. Wysocki
2008-09-13 23:37   ` Herton Ronaldo Krzesinski
2008-09-15  0:25     ` Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11553] Strange looking line from "ps aux" Rafael J. Wysocki
2008-09-13  8:51   ` Alan Jenkins
2008-09-12 19:06 ` [Bug #11551] Semi-repeatable hard lockup on 2.6.27-rc6 Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11559] 2.6.27-rc6: nohz + s2ram = need to press keys to get progress Rafael J. Wysocki
2008-09-12 19:06 ` [Bug #11557] Controlling backlight on thinkpad x60 Rafael J. Wysocki
2008-09-13 15:13   ` Matthew Garrett
2008-09-14 10:18     ` Pavel Machek
2008-09-12 19:06 ` [Bug #11556] e100: PCI wake-up handling rework causes "Error clearing wake event" Rafael J. Wysocki
  -- strict thread matches above, loose matches on Subject: below --
2008-11-16 17:38 2.6.28-rc5: Reported regressions 2.6.26 -> 2.6.27 Rafael J. Wysocki
2008-11-16 17:40 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-11-17  9:06   ` Ingo Molnar
2008-11-17  9:14     ` David Miller
2008-11-17 11:01       ` Ingo Molnar
2008-11-17 11:20         ` Eric Dumazet
2008-11-17 16:11           ` Ingo Molnar
2008-11-17 16:35             ` Eric Dumazet
2008-11-17 17:08               ` Ingo Molnar
2008-11-17 17:25                 ` Ingo Molnar
2008-11-17 17:33                   ` Eric Dumazet
2008-11-17 17:38                     ` Linus Torvalds
2008-11-17 17:42                       ` Eric Dumazet
2008-11-17 18:23                       ` Ingo Molnar
2008-11-17 18:33                         ` Linus Torvalds
2008-11-17 18:49                         ` Ingo Molnar
2008-11-17 19:30                           ` Eric Dumazet
2008-11-17 19:39                           ` David Miller
2008-11-17 19:43                             ` Eric Dumazet
2008-11-17 19:55                             ` Linus Torvalds
2008-11-17 20:16                               ` David Miller
2008-11-17 20:30                                 ` Linus Torvalds
2008-11-17 20:58                                   ` David Miller
2008-11-18  9:44                                     ` Nick Piggin
2008-11-18 15:58                                       ` Linus Torvalds
2008-11-19  4:31                                         ` Nick Piggin
2008-11-20  9:14                                         ` David Miller
2008-11-20  9:06                                       ` David Miller
2008-11-18 12:29                             ` Mike Galbraith
2008-11-17 19:57                           ` Ingo Molnar
2008-11-17 20:47                           ` Ingo Molnar
2008-11-17 20:56                             ` Eric Dumazet
2008-11-17 22:08                           ` Ingo Molnar
2008-11-17 22:15                             ` Eric Dumazet
2008-11-17 22:26                               ` Ingo Molnar
2008-11-17 22:39                                 ` Eric Dumazet
2008-11-18  5:23                               ` David Miller
2008-11-18  8:45                                 ` Ingo Molnar
2008-11-17 22:19                           ` Ingo Molnar
2008-11-17 19:36                 ` David Miller
2008-11-17 19:31             ` David Miller
2008-11-17 19:47               ` Linus Torvalds
2008-11-17 19:51                 ` David Miller
2008-11-17 19:53                 ` Ingo Molnar
2008-11-17 22:47               ` Ingo Molnar
2008-11-17 19:21         ` David Miller
2008-11-17 19:48           ` Linus Torvalds
2008-11-17 19:52             ` David Miller
2008-11-17 19:57               ` Linus Torvalds
2008-11-17 20:18                 ` David Miller
2008-11-19 19:43     ` Christoph Lameter
2008-11-19 20:14       ` Ingo Molnar
2008-11-20 23:52       ` Christoph Lameter
2008-11-21  8:30         ` Ingo Molnar
2008-11-21  8:51           ` Eric Dumazet
2008-11-21  9:05             ` David Miller
2008-11-21 12:51               ` Eric Dumazet
2008-11-21  9:18             ` Ingo Molnar
2008-11-21  9:03           ` David Miller
2008-11-21 16:11           ` Christoph Lameter
2008-11-21 18:06             ` Christoph Lameter
2008-11-21 18:16               ` Eric Dumazet
2008-11-21 18:19                 ` Eric Dumazet
2008-11-09 19:40 2.6.28-rc3-git6: Reported regressions 2.6.26 -> 2.6.27 Rafael J. Wysocki
2008-11-09 19:43 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-11-02 16:47 2.6.28-rc2-git7: Reported regressions 2.6.26 -> 2.6.27 Rafael J. Wysocki
2008-11-02 16:49 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-10-25 21:04 2.6.28-rc1-git1: Reported regressions 2.6.26 -> 2.6.27 Rafael J. Wysocki
2008-10-25 21:07 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-10-04 17:28 2.6.27-rc8-git7: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-10-04 17:32 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-09-21 18:52 2.6.27-rc6-git6: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-09-21 18:54 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-09-06 21:24 2.6.27-rc5-git8: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-09-06 21:30 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-08-30 19:46 2.6.27-rc5-git2: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-08-30 19:50 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-08-23 18:07 2.6.27-rc4-git1: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-08-23 18:10 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki
2008-08-16 19:00 2.6.27-rc3-git3: Reported regressions from 2.6.26 Rafael J. Wysocki
2008-08-16 19:02 ` [Bug #11308] tbench regression on each kernel release from 2.6.22 -&gt; 2.6.28 Rafael J. Wysocki

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1221475440.4784.39.camel@marge.simson.net \
    --to=efault@gmx.de \
    --cc=cl@linux-foundation.org \
    --cc=kernel-testers@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=rjw@sisk.pl \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®