mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: ebiederm@xmission.com (Eric W. Biederman)
To: david@lang.hm
Cc: Nick Piggin <nickpiggin@yahoo.com.au>,
	Rob Landley <rob@landley.net>, Theodore Tso <tytso@mit.edu>,
	James Bottomley <James.Bottomley@steeleye.com>,
	Matthew Wilcox <matthew@wil.cx>,
	linux-kernel@vger.kernel.org, linux-scsi@vger.kernel.org,
	Jens Axboe <axboe@suse.de>,
	Suparna Bhattacharya <suparna@in.ibm.com>,
	Nick Piggin <piggin@cyberone.com.au>
Subject: Re: OOM killer gripe (was Re: What still uses the block layer?)
Date: Mon, 15 Oct 2007 22:45:01 -0600	[thread overview]
Message-ID: <m1ejfvis6q.fsf@ebiederm.dsl.xmission.com> (raw)
In-Reply-To: <Pine.LNX.4.64.0710152105460.1538@asgard.lang.hm> (david@lang.hm's message of "Mon, 15 Oct 2007 21:10:10 -0700 (PDT)")

david@lang.hm writes:

>
> on some kernel versions you are correct about needing swap > ram, but on current
> versions you are not. the swap space gets allocated as needed, and re-used as
> needed (I don't know the mechanism of this, but I remember the last time this
> changed from vm=max(ram,swap) to vm=ram+swap)

I don't think I can recall a linux kernel that required swap > ram.
However for serious swapping under linux having swap > ram was very
useful and pretty much a requirement for a workload that involved
swapping heavily (not thrashing).

>> I have not heard of many people swapping and not thrashing lately.
>> I think part of the problem is that we do random access to the swap
>> partition which makes us seek limited.  And since the number of
>> seeks per unit time has been increasing at a linear or slower rate
>> that if we are doing random disk I/O then the amount we can use
>> the disk for is very limited.   I wonder if we could figure out
>> how to push and pull 1M or bigger chunks into and out of swap?
>
> it has been noted by many people that linux is very slow to pull things back
> into ram from swap, significantly slower then simple seed limiting would seem to
> account for.

Yes.  It may be the large amount of random access (my current guess)
or it may be something else.

I'm wonder if I should build an application with a configurable
data set and working set that can be used for swap testing.  I don't
think it would be very hard and it might help sort through some of
the swap performance problems.

Eric




  reply	other threads:[~2007-10-16  4:46 UTC|newest]

Thread overview: 93+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-10-12  1:11 What still uses the block layer? Rob Landley
2007-10-13 22:05 ` Matthew Wilcox
2007-10-14  5:54   ` David Newall
2007-10-14 17:46     ` Stefan Richter
2007-10-14 22:35       ` Tilman Schmidt
2007-10-14 23:36       ` Rob Landley
2007-10-15  1:23         ` Neil Brown
2007-10-15  5:44         ` Stefan Richter
2007-10-15  9:26           ` Rob Landley
2007-10-15 16:08             ` Matthew Wilcox
2007-10-15 17:10               ` Stefan Richter
2007-10-16  3:06                 ` david
2007-10-16  5:56                   ` Stefan Richter
2007-10-16 10:19                   ` Alan Cox
2007-10-16 19:54                     ` david
2007-10-16 19:54                       ` Matthew Wilcox
2007-10-16 20:18                         ` Stefan Richter
2007-10-16 20:34                         ` Theodore Tso
2007-10-16 20:56                           ` Stefan Richter
2007-10-16 20:55                         ` david
2007-10-16 21:49                           ` Alan Cox
2007-10-17  9:48                           ` Gabor Gombas
2007-10-17 17:23                             ` Stefan Richter
2007-10-17 21:04                             ` david
2007-10-15 20:29             ` Wilfried Klaebe
2007-10-14 22:24   ` James Bottomley
2007-10-14 23:45     ` Rob Landley
2007-10-15  1:45       ` Theodore Tso
2007-10-15  8:04         ` Rob Landley
2007-10-15  9:06           ` Julian Calaby
2007-10-15 10:08             ` Rob Landley
2007-10-15 17:33               ` Greg KH
2007-10-16  2:54                 ` david
2007-10-16  4:04                   ` Matthew Wilcox
2007-10-16  4:11                     ` Arjan van de Ven
2007-10-16  4:15                     ` david
2007-10-16  4:21                     ` Greg KH
2007-10-16  5:00                       ` david
     [not found]               ` <646765f40710150327i78519a0fvaea7a83d5975b180@mail.gmail.com>
     [not found]                 ` <200710151511.29748.rob@landley.net>
2007-10-15 23:49                   ` Julian Calaby
2007-10-15 10:32           ` Loïc Grenié
2007-10-15 21:09             ` Rob Landley
2007-10-15 11:19           ` Neil Brown
2007-10-15 21:34             ` Rob Landley
2007-10-15 21:46               ` Jeff Garzik
2007-10-15 22:01               ` Alan Cox
2007-10-15 23:41               ` Neil Brown
2007-10-16  2:12                 ` david
2007-10-15 13:21           ` Theodore Tso
2007-10-15 13:29             ` Alan Cox
2007-10-15 13:35               ` Theodore Tso
2007-10-15 17:44               ` Jeff Garzik
2007-10-15 14:46             ` Douglas Gilbert
2007-10-16  2:51             ` david
2007-10-15 13:37           ` OOM killer gripe (was Re: What still uses the block layer?) Nick Piggin
2007-10-15  9:52             ` Rob Landley
2007-10-15 15:08               ` Nick Piggin
2007-10-16  6:22                 ` David Newall
2007-10-20  9:48               ` Pavel Machek
2007-10-15 11:40             ` Theodore Tso
2007-10-20  9:50               ` Pavel Machek
2007-10-16  3:55             ` Eric W. Biederman
2007-10-16  4:10               ` david
2007-10-16  4:45                 ` Eric W. Biederman [this message]
2007-10-16  6:59               ` Nick Piggin
2007-10-16  4:38                 ` Eric W. Biederman
2007-10-16  6:38                   ` Rob Landley
2007-10-16  9:31                     ` Eric W. Biederman
2007-10-16 10:28                     ` Alan Cox
2007-10-16 23:59                       ` Rob Landley
2007-10-16  7:34                   ` Nick Piggin
2007-10-18 13:00                     ` Rogier Wolff
2007-10-19  6:49                       ` Rob Landley
2007-10-19  7:21                         ` Rogier Wolff
2007-10-16 20:37             ` Andrew Morton
2007-10-17  5:34           ` What still uses the block layer? Valdis.Kletnieks
2007-10-17  6:07             ` david
2007-10-15  6:00       ` Greg KH
2007-10-15  8:36         ` Rob Landley
2007-10-15 13:08           ` Alan Cox
2007-10-15 14:00           ` Arjan van de Ven
2007-10-15 18:56             ` Matthew Garrett
2007-10-15 17:25           ` Greg KH
2007-10-15 18:00             ` Matthew Wilcox
2007-10-15 18:46             ` Jeff Garzik
2007-10-16  6:33               ` Stefan Richter
2007-10-17 23:43               ` Bill Davidsen
2007-10-15 22:54             ` Rob Landley
2007-10-15  8:52         ` Christoph Hellwig
2007-10-15 13:10       ` James Bottomley
2007-10-15 21:51         ` Rob Landley
2007-10-15  0:45     ` Luben Tuikov
2007-10-15  6:51       ` Rob Landley
2007-10-15  8:37         ` Luben Tuikov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=m1ejfvis6q.fsf@ebiederm.dsl.xmission.com \
    --to=ebiederm@xmission.com \
    --cc=James.Bottomley@steeleye.com \
    --cc=axboe@suse.de \
    --cc=david@lang.hm \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-scsi@vger.kernel.org \
    --cc=matthew@wil.cx \
    --cc=nickpiggin@yahoo.com.au \
    --cc=piggin@cyberone.com.au \
    --cc=rob@landley.net \
    --cc=suparna@in.ibm.com \
    --cc=tytso@mit.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

Powered by JetHome