mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "J. Bruce Fields" <bfields@fieldses.org>
To: Neil Brown <neilb@suse.de>
Cc: Jesper Krogh <jesper@krogh.cc>,
	Andrew Morton <akpm@linux-foundation.org>,
	linux-kernel@vger.kernel.org, linux-nfs@vger.kernel.org
Subject: Re: Many open/close on same files yeilds "No such file or directory".
Date: Mon, 12 May 2008 02:00:15 -0400	[thread overview]
Message-ID: <20080512060015.GB31262@fieldses.org> (raw)
In-Reply-To: <18471.41781.164396.385159@notabene.brown>

On Mon, May 12, 2008 at 11:53:57AM +1000, Neil Brown wrote:
> On Friday May 9, jesper@krogh.cc wrote:
> > 
> > When I disabled the NFS-server and rand my "real-world" program on a
> > single processor (make -j 1). It ran through fine. It basically
> > gets around 20 million chunks out of differnet file and assemble the
> > chuncks in a few other files. This processes more or less 5 individual
> > sections, so make can run effectively with a concurrency of 5.
> 
> (For linux-nfs readers: the problem is that repeatedly opening a given
>  file sometimes returns a ENOENT - http://lkml.org/lkml/2008/5/9/15).
> 
> The mention of an NFS-server made my ears prick up...
> 
> Do I understand correctly that the problem only occurs when you have
> 48 clients hammering away at the filesystem in question?
> 
> Could the clients be accessing the same file that you are experiencing
> problems with?  Or one of the directories in the path (if so, how
> deep).
> 
> How many different files to these 20 million chunks come from?  And
> how does that number compare with the first number from
>    grep dentry /proc/slabinfo
> ??
> 
> The NFS server does some slighty strange things with the dcache if the
> object being access is not in the cache.
> 
> Also, can get a few instances of 
>    grep '^fh' /proc/nfs/rpc/nfsd

I think you meant /proc/net/rpc/nfsd.

--b.

> 
> while things are going strange.  The numbers are:
>  *	fh <stale> <total-lookups> <anonlookups> <dir-not-in-dcache> <nondir-not-in-dcache>
> 
> That will show us if it is looking for things that aren't in the
> dcache.
> 
> Finally, if the filesystem export with "subtree_check" or
> "nosubtree_check"?
> Does it make a difference if you switch the setting of this flag and
> re-export?
> 
> NeilBrown
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/

  reply	other threads:[~2008-05-12  6:00 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-05-01 15:34 Jesper Krogh
2008-05-02  5:39 ` Andrew Morton
2008-05-02  8:20   ` Jesper Krogh
2008-05-01 12:15     ` Arjan van de Ven
2008-05-02 11:03       ` Many open/close on same files yeilds Jesper Krogh
2008-05-01 14:07         ` Arjan van de Ven
2008-05-02 15:19     ` Many open/close on same files yeilds "No such file or directory" Jesper Krogh
2008-05-02 15:47       ` Ray Lee
2008-05-02 15:55         ` Jesper Krogh
2008-05-02 16:45           ` Ray Lee
2008-05-02 19:53             ` Jesper Krogh
2008-05-02 19:52         ` Jesper Krogh
2008-05-05 17:43           ` Jesper Krogh
2008-05-05 17:51             ` Randy.Dunlap
2008-05-05 17:54               ` Jesper Krogh
     [not found]                 ` <2c0942db0805051121r47cc97d2jb71cc8ab9eaa7981@mail.gmail.com>
2008-05-05 18:29                   ` Jesper Krogh
     [not found]                     ` <2c0942db0805051154q63a18bcfhce8a30d4a663ea3f@mail.gmail.com>
2008-05-07 20:51                       ` Jesper Krogh
2008-05-07 22:27                         ` Jesper Krogh
2008-05-02 15:21     ` Jesper Krogh
2008-05-09  5:22 ` Jesper Krogh
2008-05-09  5:36   ` Andrew Morton
2008-05-09  6:09     ` Jesper Krogh
2008-05-09  6:22       ` Andrew Morton
2008-05-12  1:53       ` Neil Brown
2008-05-12  6:00         ` J. Bruce Fields [this message]
2008-05-12  6:41         ` Jesper Krogh
2008-05-12  6:51           ` Andrew Morton
     [not found] <aoJcW-38V-37@gated-at.bofh.it>
     [not found] ` <aoWjI-1Br-5@gated-at.bofh.it>
     [not found]   ` <aoYOH-6RO-13@gated-at.bofh.it>
     [not found]     ` <ap5nc-3ZT-7@gated-at.bofh.it>
     [not found]       ` <ap5Gx-4vu-43@gated-at.bofh.it>
     [not found]         ` <ap9Ar-4Nn-21@gated-at.bofh.it>
     [not found]           ` <aqcZe-7Fg-23@gated-at.bofh.it>
     [not found]             ` <aqd98-7Vb-25@gated-at.bofh.it>
     [not found]               ` <aqd99-7Vb-27@gated-at.bofh.it>
2008-05-05 19:05                 ` Henry Nestler

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20080512060015.GB31262@fieldses.org \
    --to=bfields@fieldses.org \
    --cc=akpm@linux-foundation.org \
    --cc=jesper@krogh.cc \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-nfs@vger.kernel.org \
    --cc=neilb@suse.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®