Testing of filesystems

Testing of filesystems

[Axel Siebenwirth]

Hi,

I wonder what a good way is to stress test my JFS filesystem. Is there a tool
that does something like that maybe? Dont't want performance testing, just
all kinds of stress testing to see how the filesystem "is" and to check
integrity and functionality.
What are you filesystem developers use to do something like that?

Thanks,
Axel

Re: Testing of filesystems

[Richard B. Johnson]

On Tue, 30 Jul 2002, Axel Siebenwirth wrote:

> Hi,
> 
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.
> What are you filesystem developers use to do something like that?
> 
> Thanks,
> Axel

Compile the kernel in a directory tree on the file-system you
want to test......

while true ; do make clean ; make -j 16 bzImage ; make modules ; done


Let this run for a day or so...


Cheers,
Dick Johnson
Penguin : Linux version 2.4.18 on an i686 machine (797.90 BogoMips).
The US military has given us many words, FUBAR, SNAFU, now ENRON.
Yes, top management were graduates of West Point and Annapolis.

Re: Testing of filesystems

[Alex Riesen]

On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> Hi,
> 
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.
> What are you filesystem developers use to do something like that?

while sleep 1; do

for i in `seq 1 100`; do
    dd if=/dev/zero of=f$i bs=$(( $i * 100 )) count=$(( $i * 10 ))
done
cat * >/dev/null
rm *
make -C dummy-kernel dep bzImage modules -j2

done

Re: Testing of filesystems

[Paul Larson]

On Tue, 2002-07-30 at 07:15, Alex Riesen wrote:
> On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> > Hi,
> > 
> > I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> > that does something like that maybe? Dont't want performance testing, just
> > all kinds of stress testing to see how the filesystem "is" and to check
> > integrity and functionality.
> > What are you filesystem developers use to do something like that?
You may also want to take a look at the tests in the Linux Test
Project.  There are several tests there that target the filesystem.

Paul Larson
Linux Test Project
http://ltp.sourceforge.net

Re: Testing of filesystems

[Bill Rugolsky Jr.]

On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.

See the ext3 cvs tree at 

   http://sourceforge.net/projects/gkernel

[Jeff Garzik's CVS tree hosts the ext3 tree.]

Andrew Morton, being conscientious and methodical, has written lots of
filesystem testing tools during his work on ext3.  Some of these tests
are for specific ext3 regressions, but many are useful as general
integrity tests oriented toward journalled filesystems.  He has also
ported/improved several other tools, including a bunch of changes to
the notorious FSX, the File System eXerciser.

The Namesys folks also have a test suite for Reiserfs, see www.namesys.com.

Regards,

   Bill Rugolsky

Re: Testing of filesystems

[Roy Sigurd Karlsbakk]

What sort of tools _have_ been used to test JFS to date? and - what version(s) 
have been tested?

On Tuesday 30 July 2002 14:22, Bill Rugolsky Jr. wrote:
> On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> > I wonder what a good way is to stress test my JFS filesystem. Is there a
> > tool that does something like that maybe? Dont't want performance
> > testing, just all kinds of stress testing to see how the filesystem "is"
> > and to check integrity and functionality.
>
> See the ext3 cvs tree at
>
>    http://sourceforge.net/projects/gkernel
>
> [Jeff Garzik's CVS tree hosts the ext3 tree.]
>
> Andrew Morton, being conscientious and methodical, has written lots of
> filesystem testing tools during his work on ext3.  Some of these tests
> are for specific ext3 regressions, but many are useful as general
> integrity tests oriented toward journalled filesystems.  He has also
> ported/improved several other tools, including a bunch of changes to
> the notorious FSX, the File System eXerciser.
>
> The Namesys folks also have a test suite for Reiserfs, see www.namesys.com.
>
> Regards,
>
>    Bill Rugolsky
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/

-- 
Roy Sigurd Karlsbakk, Datavaktmester

Computers are like air conditioners.
They stop working when you open Windows.

Re: Testing of filesystems

[Cliff White]

> Hi,
> 
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> that does something like that maybe? Dont't want performance testing, just
> all kinds of stress testing to see how the filesystem "is" and to check
> integrity and functionality.
> What are you filesystem developers use to do something like that?
> 

You can use the Scalable  Test Platform at the OSDL. 
We currently have iozone and tiobench test which support JFS, and
we're looking to add other tests.  For details, see 
http://www.osdl.org/stp/
cliffw

> Thanks,
> Axel
> -
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
> 

Re: Testing of filesystems

[Tom Vier]

On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> I wonder what a good way is to stress test my JFS filesystem. Is there a tool
<snip>

fsx.c came up a while ago on l-k. it's an old (but still very useful) fs
stressor(sp) from neXT. i have a copy davej modded for linux. if you can't
find it, i can send it to you. i haven't been brave enough to run it myself,
on my alpha's reiserfs. 8) it found some hard to find bugs in ext2 that were
lurking for years (iirc).

-- 
Tom Vier <tmv@comcast.net>
DSA Key ID 0xE6CB97DA

Re: Testing of filesystems

[Hans Reiser]

Tom Vier wrote:

>On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
>  
>
>>I wonder what a good way is to stress test my JFS filesystem. Is there a tool
>>    
>>
><snip>
>
>fsx.c came up a while ago on l-k. it's an old (but still very useful) fs
>stressor(sp) from neXT. i have a copy davej modded for linux. if you can't
>find it, i can send it to you. i haven't been brave enough to run it myself,
>on my alpha's reiserfs. 8) it found some hard to find bugs in ext2 that were
>lurking for years (iirc).
>
>  
>
It found bugs in reiserfs and we fixed them.:)

-- 
Hans

Re: Testing of filesystems

[Andrew Morton]

Hans Reiser wrote:
> 
> Tom Vier wrote:
> 
> >On Tue, Jul 30, 2002 at 11:49:02AM +0200, Axel Siebenwirth wrote:
> >
> >
> >>I wonder what a good way is to stress test my JFS filesystem. Is there a tool
> >>
> >>
> ><snip>
> >
> >fsx.c came up a while ago on l-k. it's an old (but still very useful) fs
> >stressor(sp) from neXT. i have a copy davej modded for linux. if you can't
> >find it, i can send it to you. i haven't been brave enough to run it myself,
> >on my alpha's reiserfs. 8) it found some hard to find bugs in ext2 that were
> >lurking for years (iirc).
> >
> >
> >
> It found bugs in reiserfs and we fixed them.:)

fsx-linux is great.  Caused me no end of grief in 2.5.13.  Running
it on small blocksize fs alongside really heavy memory pressure 
touches all sorts of corner cases.

I have a version which is tricked up to understand O_DIRECT
in http://www.zip.com.au/~akpm/linux/ext3-tools.tar.gz