nfs_inode_cache not getting pruned

mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed

* nfs_inode_cache not getting pruned
@ 2004-07-07  4:03 Brad Fitzpatrick
  2004-07-07  4:22 ` Andrew Morton
  0 siblings, 1 reply; 5+ messages in thread
From: Brad Fitzpatrick @ 2004-07-07  4:03 UTC (permalink / raw)
  To: linux-kernel

Hello,

I've got a couple boxes here that keep running out of lowmem after about a
day of uptime, rendering them almost entirely unusable.  (OOM killer
taking out processes left and right, despite 1.5 GB highmem available...)

>From what I can tell, nfs_inode_cache isn't responding to memory pressure
and cleaning itself (enough?).

Where slabinfo says "tunables", does that mean it's my job to limit each
slab class to keep things stable?  I would guess not.

Any recommendations on how to keep this box alive more than a day?

Is the 2GB/2GB split patch still floating about, or was the rmap/anonvma
and/or heavier 4GB/4GB stuff supposed to solve all our lowmem woes?

Thanks!
- Brad


# uname -r
2.6.7

# name            <active_objs> <num_objs> <objsize> <objperslab> <pagesperslab> : tunables <batchcount> <limit> <sharedfactor> : slabdata <active_slabs> <num_slabs> <sharedavail>
nfs_inode_cache   883676 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
dentry_cache      754857 930528    144   27    1 : tunables  120   60    8 : slabdata  34464  34464      0
radix_tree_node   119204 120666    276   14    1 : tunables   54   27    8 : slabdata   8619   8619      0
ip_dst_cache       62730  62730    256   15    1 : tunables  120   60    8 : slabdata   4182   4182      0
size-4096            720    740   4096    1    1 : tunables   24   12    8 : slabdata    720    740     36
size-2048            944   1154   2048    2    1 : tunables   24   12    8 : slabdata    577    577      0
tcp_sock            2448   3507   1152    7    2 : tunables   24   12    8 : slabdata    501    501      0
ext2_inode_cache    3339   3339    512    7    1 : tunables   54   27    8 : slabdata    477    477      0
tcp_tw_bucket      11705  14167    128   31    1 : tunables  120   60    8 : slabdata    457    457    300
sock_inode_cache    2413   3460    384   10    1 : tunables   54   27    8 : slabdata    346    346      0
filp                2679   3750    256   15    1 : tunables  120   60    8 : slabdata    250    250      0
skbuff_head_cache   2064   3225    256   15    1 : tunables  120   60    8 : slabdata    215    215    360
inode_cache         1550   1550    384   10    1 : tunables   54   27    8 : slabdata    155    155      0
size-1024            488    596   1024    4    1 : tunables   54   27    8 : slabdata    149    149    173
size-64              755   8174     64   61    1 : tunables  120   60    8 : slabdata    134    134      0
biovec-(256)         256    256   3072    2    2 : tunables   24   12    8 : slabdata    128    128      0
size-512             555    936    512    8    1 : tunables   54   27    8 : slabdata    117    117    189
eventpoll_epi       2358   3503    128   31    1 : tunables  120   60    8 : slabdata    113    113      0
size-32             2376  13090     32  119    1 : tunables  120   60    8 : slabdata    110    110      0
ext3_inode_cache     461    721    512    7    1 : tunables   54   27    8 : slabdata    103    103      0


# cat /proc/meminfo
MemTotal:      4025568 kB
MemFree:       1547824 kB
Buffers:          1232 kB
Cached:        1519248 kB
SwapCached:          0 kB
Active:         277128 kB
Inactive:      1334944 kB
HighTotal:     3145152 kB
HighFree:      1533312 kB
LowTotal:       880416 kB
LowFree:         14512 kB
SwapTotal:           0 kB
SwapFree:            0 kB
Dirty:            1592 kB
Writeback:           0 kB
Mapped:          96800 kB
Slab:           857372 kB
Committed_AS:   152636 kB
PageTables:        576 kB
VmallocTotal:   114680 kB
VmallocUsed:       304 kB
VmallocChunk:   114376 kB

# dmesg
<snip>
Out of Memory: Killed process 23405 (mogilefsd).
Out of Memory: Killed process 24333 (mogilefsd).
Out of Memory: Killed process 24341 (mogilefsd).
Out of Memory: Killed process 24348 (mogilefsd).
Out of Memory: Killed process 24351 (mogilefsd).
Out of Memory: Killed process 24354 (mogilefsd).
Out of Memory: Killed process 24355 (mogilefsd).
Out of Memory: Killed process 25262 (mogilefsd).
Out of Memory: Killed process 25263 (mogilefsd).
Out of Memory: Killed process 25264 (mogilefsd).
Out of Memory: Killed process 25268 (mogilefsd).
Out of Memory: Killed process 26150 (mogilefsd).
Out of Memory: Killed process 26172 (mogilefsd).
Out of Memory: Killed process 26176 (mogilefsd).
Out of Memory: Killed process 26177 (mogilefsd).
Out of Memory: Killed process 26178 (mogilefsd).
<snip>

sto2:/sys# while true; do grep nfs_inode_cache /proc/slabinfo; sleep 1 ; done
nfs_inode_cache   887611 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887665 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887719 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887746 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887816 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887843 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887870 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887951 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   887978 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888032 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888032 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888086 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888113 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888113 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888194 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888221 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888275 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888275 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888356 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888383 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888437 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888464 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888464 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888545 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888599 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888599 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888626 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888707 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
nfs_inode_cache   888815 965706    640    6    1 : tunables   54   27    8 : slabdata 160951 160951      0
....
 (always growing)


-- 
Brad Fitzpatrick
brad@danga.com
www.danga.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: nfs_inode_cache not getting pruned
  2004-07-07  4:03 nfs_inode_cache not getting pruned Brad Fitzpatrick
@ 2004-07-07  4:22 ` Andrew Morton
  2004-07-07  7:02   ` Brad Fitzpatrick
  0 siblings, 1 reply; 5+ messages in thread
From: Andrew Morton @ 2004-07-07  4:22 UTC (permalink / raw)
  To: Brad Fitzpatrick; +Cc: linux-kernel

Brad Fitzpatrick <brad@danga.com> wrote:
>
> I've got a couple boxes here that keep running out of lowmem after about a
>  day of uptime, rendering them almost entirely unusable.  (OOM killer
>  taking out processes left and right, despite 1.5 GB highmem available...)
> 
>  From what I can tell, nfs_inode_cache isn't responding to memory pressure
>  and cleaning itself (enough?).

It works OK here.  Please provide kernel version and full NFS mount options.

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: nfs_inode_cache not getting pruned
  2004-07-07  4:22 ` Andrew Morton
@ 2004-07-07  7:02   ` Brad Fitzpatrick
  2004-07-07  7:40     ` Andrew Morton
  0 siblings, 1 reply; 5+ messages in thread
From: Brad Fitzpatrick @ 2004-07-07  7:02 UTC (permalink / raw)
  To: Andrew Morton; +Cc: linux-kernel

[-- Attachment #1: Type: TEXT/PLAIN, Size: 3476 bytes --]

On Tue, 6 Jul 2004, Andrew Morton wrote:

> Brad Fitzpatrick <brad@danga.com> wrote:
> >
> > I've got a couple boxes here that keep running out of lowmem after about a
> >  day of uptime, rendering them almost entirely unusable.  (OOM killer
> >  taking out processes left and right, despite 1.5 GB highmem available...)
> >
> >  From what I can tell, nfs_inode_cache isn't responding to memory pressure
> >  and cleaning itself (enough?).
>
> It works OK here.  Please provide kernel version and full NFS mount options.

2.6.7, both client and server.

Both machines are exporting 14 filesystems (each ext3 on 3w-9xxx) and
mounting the other's 14 over NFSv3:


/dev/sda2 on / type ext3 (rw,noatime,errors=remount-ro)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext2 (rw,noatime)
/dev/sda4 on /var/mogdata/dev15 type ext2 (rw,noatime)
/dev/sdb1 on /var/mogdata/dev16 type ext3 (rw,noatime)
/dev/sdc1 on /var/mogdata/dev17 type ext3 (rw,noatime)
/dev/sdd1 on /var/mogdata/dev18 type ext3 (rw,noatime)
/dev/sde1 on /var/mogdata/dev19 type ext3 (rw,noatime)
/dev/sdf1 on /var/mogdata/dev20 type ext3 (rw,noatime)
/dev/sdg1 on /var/mogdata/dev21 type ext3 (rw,noatime)
/dev/sdh1 on /var/mogdata/dev22 type ext3 (rw,noatime)
/dev/sdi1 on /var/mogdata/dev23 type ext3 (rw,noatime)
/dev/sdj1 on /var/mogdata/dev24 type ext3 (rw,noatime)
/dev/sdk1 on /var/mogdata/dev25 type ext3 (rw,noatime)
/dev/sdl1 on /var/mogdata/dev26 type ext3 (rw,noatime)
/dev/sdm1 on /var/mogdata/dev27 type ext3 (rw,noatime)
/dev/sdn1 on /var/mogdata/dev28 type ext3 (rw,noatime)
10.0.0.81:/var/mogdata/dev11 on /mnt/mogilefs/sto1/dev11 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev7 on /mnt/mogilefs/sto1/dev7 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev2 on /mnt/mogilefs/sto1/dev2 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev1 on /mnt/mogilefs/sto1/dev1 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev13 on /mnt/mogilefs/sto1/dev13 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev6 on /mnt/mogilefs/sto1/dev6 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev3 on /mnt/mogilefs/sto1/dev3 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev9 on /mnt/mogilefs/sto1/dev9 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev12 on /mnt/mogilefs/sto1/dev12 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev14 on /mnt/mogilefs/sto1/dev14 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev8 on /mnt/mogilefs/sto1/dev8 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev4 on /mnt/mogilefs/sto1/dev4 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev10 on /mnt/mogilefs/sto1/dev10 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)
10.0.0.81:/var/mogdata/dev5 on /mnt/mogilefs/sto1/dev5 type nfs (rw,noatime,timeo=1,retrans=1,soft,addr=10.0.0.81)


The soft option is required for the application.  (a highly-available
distributed filesystem of sorts)

Kernel config attached.

I'll gladly provide more info upon request.

- Brad

[-- Attachment #2: Type: TEXT/PLAIN, Size: 18534 bytes --]

#
# Automatically generated make config: don't edit
#
CONFIG_X86=y
CONFIG_MMU=y
CONFIG_UID16=y
CONFIG_GENERIC_ISA_DMA=y

#
# Code maturity level options
#
CONFIG_EXPERIMENTAL=y
CONFIG_CLEAN_COMPILE=y
CONFIG_STANDALONE=y

#
# General setup
#
# CONFIG_SWAP is not set
CONFIG_SYSVIPC=y
# CONFIG_POSIX_MQUEUE is not set
# CONFIG_BSD_PROCESS_ACCT is not set
CONFIG_SYSCTL=y
# CONFIG_AUDIT is not set
CONFIG_LOG_BUF_SHIFT=15
# CONFIG_HOTPLUG is not set
CONFIG_IKCONFIG=y
CONFIG_IKCONFIG_PROC=y
# CONFIG_EMBEDDED is not set
CONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_ALL is not set
# CONFIG_KALLSYMS_EXTRA_PASS is not set
CONFIG_FUTEX=y
CONFIG_EPOLL=y
CONFIG_IOSCHED_NOOP=y
CONFIG_IOSCHED_AS=y
CONFIG_IOSCHED_DEADLINE=y
CONFIG_IOSCHED_CFQ=y
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set

#
# Loadable module support
#
CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y
# CONFIG_MODULE_FORCE_UNLOAD is not set
CONFIG_OBSOLETE_MODPARM=y
CONFIG_MODVERSIONS=y
# CONFIG_KMOD is not set
CONFIG_STOP_MACHINE=y

#
# Processor type and features
#
CONFIG_X86_PC=y
# CONFIG_X86_ELAN is not set
# CONFIG_X86_VOYAGER is not set
# CONFIG_X86_NUMAQ is not set
# CONFIG_X86_SUMMIT is not set
# CONFIG_X86_BIGSMP is not set
# CONFIG_X86_VISWS is not set
# CONFIG_X86_GENERICARCH is not set
# CONFIG_X86_ES7000 is not set
# CONFIG_M386 is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not set
CONFIG_MPENTIUM4=y
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MK8 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP2 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
# CONFIG_X86_GENERIC is not set
CONFIG_X86_CMPXCHG=y
CONFIG_X86_XADD=y
CONFIG_X86_L1_CACHE_SHIFT=7
CONFIG_RWSEM_XCHGADD_ALGORITHM=y
CONFIG_X86_WP_WORKS_OK=y
CONFIG_X86_INVLPG=y
CONFIG_X86_BSWAP=y
CONFIG_X86_POPAD_OK=y
CONFIG_X86_GOOD_APIC=y
CONFIG_X86_INTEL_USERCOPY=y
CONFIG_X86_USE_PPRO_CHECKSUM=y
# CONFIG_HPET_TIMER is not set
CONFIG_SMP=y
CONFIG_NR_CPUS=4
# CONFIG_SCHED_SMT is not set
# CONFIG_PREEMPT is not set
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y
CONFIG_X86_TSC=y
CONFIG_X86_MCE=y
CONFIG_X86_MCE_NONFATAL=y
CONFIG_X86_MCE_P4THERMAL=y
# CONFIG_TOSHIBA is not set
# CONFIG_I8K is not set
# CONFIG_MICROCODE is not set
# CONFIG_X86_MSR is not set
# CONFIG_X86_CPUID is not set

#
# Firmware Drivers
#
# CONFIG_EDD is not set
# CONFIG_NOHIGHMEM is not set
CONFIG_HIGHMEM4G=y
# CONFIG_HIGHMEM64G is not set
CONFIG_HIGHMEM=y
CONFIG_HIGHPTE=y
# CONFIG_MATH_EMULATION is not set
# CONFIG_MTRR is not set
CONFIG_IRQBALANCE=y
CONFIG_HAVE_DEC_LOCK=y
# CONFIG_REGPARM is not set

#
# Power management options (ACPI, APM)
#
# CONFIG_PM is not set

#
# ACPI (Advanced Configuration and Power Interface) Support
#
# CONFIG_ACPI is not set
CONFIG_ACPI_BOOT=y

#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set

#
# Bus options (PCI, PCMCIA, EISA, MCA, ISA)
#
CONFIG_PCI=y
# CONFIG_PCI_GOBIOS is not set
# CONFIG_PCI_GOMMCONFIG is not set
# CONFIG_PCI_GODIRECT is not set
CONFIG_PCI_GOANY=y
CONFIG_PCI_BIOS=y
CONFIG_PCI_DIRECT=y
CONFIG_PCI_MMCONFIG=y
# CONFIG_PCI_USE_VECTOR is not set
# CONFIG_PCI_LEGACY_PROC is not set
CONFIG_PCI_NAMES=y
# CONFIG_ISA is not set
# CONFIG_MCA is not set
# CONFIG_SCx200 is not set

#
# Executable file formats
#
CONFIG_BINFMT_ELF=y
# CONFIG_BINFMT_AOUT is not set
CONFIG_BINFMT_MISC=y

#
# Device Drivers
#

#
# Generic Driver Options
#
CONFIG_PREVENT_FIRMWARE_BUILD=y
# CONFIG_DEBUG_DRIVER is not set

#
# Memory Technology Devices (MTD)
#
# CONFIG_MTD is not set

#
# Parallel port support
#
# CONFIG_PARPORT is not set

#
# Plug and Play support
#

#
# Block devices
#
CONFIG_BLK_DEV_FD=y
# CONFIG_BLK_CPQ_DA is not set
# CONFIG_BLK_CPQ_CISS_DA is not set
# CONFIG_BLK_DEV_DAC960 is not set
# CONFIG_BLK_DEV_UMEM is not set
# CONFIG_BLK_DEV_LOOP is not set
# CONFIG_BLK_DEV_NBD is not set
# CONFIG_BLK_DEV_SX8 is not set
CONFIG_BLK_DEV_RAM=y
CONFIG_BLK_DEV_RAM_SIZE=4096
# CONFIG_BLK_DEV_INITRD is not set
CONFIG_LBD=y

#
# ATA/ATAPI/MFM/RLL support
#
CONFIG_IDE=y
CONFIG_BLK_DEV_IDE=y

#
# Please see Documentation/ide.txt for help/info on IDE drives
#
# CONFIG_BLK_DEV_IDE_SATA is not set
# CONFIG_BLK_DEV_HD_IDE is not set
CONFIG_BLK_DEV_IDEDISK=y
CONFIG_IDEDISK_MULTI_MODE=y
CONFIG_BLK_DEV_IDECD=y
# CONFIG_BLK_DEV_IDETAPE is not set
# CONFIG_BLK_DEV_IDEFLOPPY is not set
# CONFIG_BLK_DEV_IDESCSI is not set
# CONFIG_IDE_TASK_IOCTL is not set
# CONFIG_IDE_TASKFILE_IO is not set

#
# IDE chipset support/bugfixes
#
CONFIG_IDE_GENERIC=y
CONFIG_BLK_DEV_CMD640=y
# CONFIG_BLK_DEV_CMD640_ENHANCED is not set
CONFIG_BLK_DEV_IDEPCI=y
CONFIG_IDEPCI_SHARE_IRQ=y
# CONFIG_BLK_DEV_OFFBOARD is not set
# CONFIG_BLK_DEV_GENERIC is not set
# CONFIG_BLK_DEV_OPTI621 is not set
CONFIG_BLK_DEV_RZ1000=y
CONFIG_BLK_DEV_IDEDMA_PCI=y
# CONFIG_BLK_DEV_IDEDMA_FORCED is not set
CONFIG_IDEDMA_PCI_AUTO=y
# CONFIG_IDEDMA_ONLYDISK is not set
CONFIG_BLK_DEV_ADMA=y
# CONFIG_BLK_DEV_AEC62XX is not set
# CONFIG_BLK_DEV_ALI15X3 is not set
# CONFIG_BLK_DEV_AMD74XX is not set
# CONFIG_BLK_DEV_ATIIXP is not set
# CONFIG_BLK_DEV_CMD64X is not set
# CONFIG_BLK_DEV_TRIFLEX is not set
# CONFIG_BLK_DEV_CY82C693 is not set
# CONFIG_BLK_DEV_CS5520 is not set
# CONFIG_BLK_DEV_CS5530 is not set
# CONFIG_BLK_DEV_HPT34X is not set
# CONFIG_BLK_DEV_HPT366 is not set
# CONFIG_BLK_DEV_SC1200 is not set
CONFIG_BLK_DEV_PIIX=y
# CONFIG_BLK_DEV_NS87415 is not set
# CONFIG_BLK_DEV_PDC202XX_OLD is not set
# CONFIG_BLK_DEV_PDC202XX_NEW is not set
CONFIG_BLK_DEV_SVWKS=y
# CONFIG_BLK_DEV_SIIMAGE is not set
CONFIG_BLK_DEV_SIS5513=y
# CONFIG_BLK_DEV_SLC90E66 is not set
# CONFIG_BLK_DEV_TRM290 is not set
# CONFIG_BLK_DEV_VIA82CXXX is not set
# CONFIG_IDE_ARM is not set
CONFIG_BLK_DEV_IDEDMA=y
# CONFIG_IDEDMA_IVB is not set
CONFIG_IDEDMA_AUTO=y
# CONFIG_BLK_DEV_HD is not set

#
# SCSI device support
#
CONFIG_SCSI=y
CONFIG_SCSI_PROC_FS=y

#
# SCSI support type (disk, tape, CD-ROM)
#
CONFIG_BLK_DEV_SD=y
# CONFIG_CHR_DEV_ST is not set
# CONFIG_CHR_DEV_OSST is not set
# CONFIG_BLK_DEV_SR is not set
CONFIG_CHR_DEV_SG=y

#
# Some SCSI devices (e.g. CD jukebox) support multiple LUNs
#
# CONFIG_SCSI_MULTI_LUN is not set
# CONFIG_SCSI_CONSTANTS is not set
# CONFIG_SCSI_LOGGING is not set

#
# SCSI Transport Attributes
#
# CONFIG_SCSI_SPI_ATTRS is not set
# CONFIG_SCSI_FC_ATTRS is not set

#
# SCSI low-level drivers
#
# CONFIG_BLK_DEV_3W_XXXX_RAID is not set
CONFIG_SCSI_3W_9XXX=y
# CONFIG_SCSI_ACARD is not set
# CONFIG_SCSI_AACRAID is not set
# CONFIG_SCSI_AIC7XXX is not set
# CONFIG_SCSI_AIC7XXX_OLD is not set
# CONFIG_SCSI_AIC79XX is not set
# CONFIG_SCSI_DPT_I2O is not set
# CONFIG_SCSI_MEGARAID is not set
# CONFIG_SCSI_SATA is not set
# CONFIG_SCSI_BUSLOGIC is not set
# CONFIG_SCSI_DMX3191D is not set
# CONFIG_SCSI_EATA is not set
# CONFIG_SCSI_EATA_PIO is not set
# CONFIG_SCSI_FUTURE_DOMAIN is not set
# CONFIG_SCSI_GDTH is not set
# CONFIG_SCSI_IPS is not set
# CONFIG_SCSI_INIA100 is not set
# CONFIG_SCSI_SYM53C8XX_2 is not set
# CONFIG_SCSI_IPR is not set
# CONFIG_SCSI_QLOGIC_ISP is not set
# CONFIG_SCSI_QLOGIC_FC is not set
# CONFIG_SCSI_QLOGIC_1280 is not set
CONFIG_SCSI_QLA2XXX=y
# CONFIG_SCSI_QLA21XX is not set
# CONFIG_SCSI_QLA22XX is not set
# CONFIG_SCSI_QLA2300 is not set
# CONFIG_SCSI_QLA2322 is not set
# CONFIG_SCSI_QLA6312 is not set
# CONFIG_SCSI_QLA6322 is not set
# CONFIG_SCSI_DC395x is not set
# CONFIG_SCSI_DC390T is not set
# CONFIG_SCSI_NSP32 is not set
# CONFIG_SCSI_DEBUG is not set

#
# Multi-device support (RAID and LVM)
#
# CONFIG_MD is not set

#
# Fusion MPT device support
#
# CONFIG_FUSION is not set

#
# IEEE 1394 (FireWire) support
#
# CONFIG_IEEE1394 is not set

#
# I2O device support
#
# CONFIG_I2O is not set

#
# Networking support
#
CONFIG_NET=y

#
# Networking options
#
CONFIG_PACKET=y
# CONFIG_PACKET_MMAP is not set
# CONFIG_NETLINK_DEV is not set
CONFIG_UNIX=y
# CONFIG_NET_KEY is not set
CONFIG_INET=y
# CONFIG_IP_MULTICAST is not set
# CONFIG_IP_ADVANCED_ROUTER is not set
CONFIG_IP_PNP=y
CONFIG_IP_PNP_DHCP=y
# CONFIG_IP_PNP_BOOTP is not set
# CONFIG_IP_PNP_RARP is not set
# CONFIG_NET_IPIP is not set
# CONFIG_NET_IPGRE is not set
# CONFIG_ARPD is not set
# CONFIG_SYN_COOKIES is not set
# CONFIG_INET_AH is not set
# CONFIG_INET_ESP is not set
# CONFIG_INET_IPCOMP is not set
# CONFIG_IPV6 is not set
# CONFIG_NETFILTER is not set

#
# SCTP Configuration (EXPERIMENTAL)
#
# CONFIG_IP_SCTP is not set
# CONFIG_ATM is not set
# CONFIG_BRIDGE is not set
# CONFIG_VLAN_8021Q is not set
# CONFIG_DECNET is not set
# CONFIG_LLC2 is not set
# CONFIG_IPX is not set
# CONFIG_ATALK is not set
# CONFIG_X25 is not set
# CONFIG_LAPB is not set
# CONFIG_NET_DIVERT is not set
# CONFIG_ECONET is not set
# CONFIG_WAN_ROUTER is not set
# CONFIG_NET_FASTROUTE is not set
# CONFIG_NET_HW_FLOWCONTROL is not set

#
# QoS and/or fair queueing
#
# CONFIG_NET_SCHED is not set
# CONFIG_NET_CLS_ROUTE is not set

#
# Network testing
#
# CONFIG_NET_PKTGEN is not set
# CONFIG_NETPOLL is not set
# CONFIG_NET_POLL_CONTROLLER is not set
# CONFIG_HAMRADIO is not set
# CONFIG_IRDA is not set
# CONFIG_BT is not set
CONFIG_NETDEVICES=y
CONFIG_DUMMY=y
# CONFIG_BONDING is not set
# CONFIG_EQUALIZER is not set
# CONFIG_TUN is not set

#
# ARCnet devices
#
# CONFIG_ARCNET is not set

#
# Ethernet (10 or 100Mbit)
#
CONFIG_NET_ETHERNET=y
CONFIG_MII=y
# CONFIG_HAPPYMEAL is not set
# CONFIG_SUNGEM is not set
# CONFIG_NET_VENDOR_3COM is not set

#
# Tulip family network device support
#
# CONFIG_NET_TULIP is not set
# CONFIG_HP100 is not set
CONFIG_NET_PCI=y
# CONFIG_PCNET32 is not set
# CONFIG_AMD8111_ETH is not set
# CONFIG_ADAPTEC_STARFIRE is not set
CONFIG_B44=y
# CONFIG_FORCEDETH is not set
# CONFIG_DGRS is not set
# CONFIG_EEPRO100 is not set
# CONFIG_E100 is not set
# CONFIG_FEALNX is not set
# CONFIG_NATSEMI is not set
# CONFIG_NE2K_PCI is not set
# CONFIG_8139CP is not set
# CONFIG_8139TOO is not set
# CONFIG_SIS900 is not set
# CONFIG_EPIC100 is not set
# CONFIG_SUNDANCE is not set
# CONFIG_TLAN is not set
# CONFIG_VIA_RHINE is not set
# CONFIG_VIA_VELOCITY is not set

#
# Ethernet (1000 Mbit)
#
# CONFIG_ACENIC is not set
# CONFIG_DL2K is not set
CONFIG_E1000=y
# CONFIG_E1000_NAPI is not set
# CONFIG_NS83820 is not set
# CONFIG_HAMACHI is not set
# CONFIG_YELLOWFIN is not set
# CONFIG_R8169 is not set
# CONFIG_SK98LIN is not set
CONFIG_TIGON3=y

#
# Ethernet (10000 Mbit)
#
# CONFIG_IXGB is not set
# CONFIG_S2IO is not set

#
# Token Ring devices
#
# CONFIG_TR is not set

#
# Wireless LAN (non-hamradio)
#
# CONFIG_NET_RADIO is not set

#
# Wan interfaces
#
# CONFIG_WAN is not set
# CONFIG_FDDI is not set
# CONFIG_HIPPI is not set
# CONFIG_PPP is not set
# CONFIG_SLIP is not set
# CONFIG_NET_FC is not set
# CONFIG_SHAPER is not set
# CONFIG_NETCONSOLE is not set

#
# ISDN subsystem
#
# CONFIG_ISDN is not set

#
# Telephony Support
#
# CONFIG_PHONE is not set

#
# Input device support
#
CONFIG_INPUT=y

#
# Userland interfaces
#
CONFIG_INPUT_MOUSEDEV=y
CONFIG_INPUT_MOUSEDEV_PSAUX=y
CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024
CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768
# CONFIG_INPUT_JOYDEV is not set
# CONFIG_INPUT_TSDEV is not set
# CONFIG_INPUT_EVDEV is not set
# CONFIG_INPUT_EVBUG is not set

#
# Input I/O drivers
#
# CONFIG_GAMEPORT is not set
CONFIG_SOUND_GAMEPORT=y
CONFIG_SERIO=y
CONFIG_SERIO_I8042=y
CONFIG_SERIO_SERPORT=y
# CONFIG_SERIO_CT82C710 is not set
# CONFIG_SERIO_PCIPS2 is not set

#
# Input Device Drivers
#
CONFIG_INPUT_KEYBOARD=y
CONFIG_KEYBOARD_ATKBD=y
# CONFIG_KEYBOARD_SUNKBD is not set
# CONFIG_KEYBOARD_LKKBD is not set
# CONFIG_KEYBOARD_XTKBD is not set
# CONFIG_KEYBOARD_NEWTON is not set
# CONFIG_INPUT_MOUSE is not set
# CONFIG_INPUT_JOYSTICK is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not set

#
# Character devices
#
CONFIG_VT=y
CONFIG_VT_CONSOLE=y
CONFIG_HW_CONSOLE=y
CONFIG_SERIAL_NONSTANDARD=y
# CONFIG_ROCKETPORT is not set
# CONFIG_CYCLADES is not set
# CONFIG_SYNCLINK is not set
# CONFIG_SYNCLINKMP is not set
# CONFIG_N_HDLC is not set
# CONFIG_STALDRV is not set

#
# Serial drivers
#
CONFIG_SERIAL_8250=y
CONFIG_SERIAL_8250_CONSOLE=y
CONFIG_SERIAL_8250_NR_UARTS=4
# CONFIG_SERIAL_8250_EXTENDED is not set

#
# Non-8250 serial port support
#
CONFIG_SERIAL_CORE=y
CONFIG_SERIAL_CORE_CONSOLE=y
CONFIG_UNIX98_PTYS=y
CONFIG_LEGACY_PTYS=y
CONFIG_LEGACY_PTY_COUNT=256
# CONFIG_QIC02_TAPE is not set

#
# IPMI
#
# CONFIG_IPMI_HANDLER is not set

#
# Watchdog Cards
#
# CONFIG_WATCHDOG is not set
# CONFIG_HW_RANDOM is not set
# CONFIG_NVRAM is not set
CONFIG_RTC=y
# CONFIG_DTLK is not set
# CONFIG_R3964 is not set
# CONFIG_APPLICOM is not set
# CONFIG_SONYPI is not set

#
# Ftape, the floppy tape device driver
#
# CONFIG_AGP is not set
# CONFIG_DRM is not set
# CONFIG_MWAVE is not set
# CONFIG_RAW_DRIVER is not set
# CONFIG_HANGCHECK_TIMER is not set

#
# I2C support
#
# CONFIG_I2C is not set

#
# Misc devices
#
# CONFIG_IBM_ASM is not set

#
# Multimedia devices
#
# CONFIG_VIDEO_DEV is not set

#
# Digital Video Broadcasting Devices
#
# CONFIG_DVB is not set

#
# Graphics support
#
# CONFIG_FB is not set
CONFIG_VIDEO_SELECT=y

#
# Console display driver support
#
CONFIG_VGA_CONSOLE=y
# CONFIG_MDA_CONSOLE is not set
CONFIG_DUMMY_CONSOLE=y

#
# Sound
#
# CONFIG_SOUND is not set

#
# USB support
#
# CONFIG_USB is not set

#
# USB Gadget Support
#
# CONFIG_USB_GADGET is not set

#
# File systems
#
CONFIG_EXT2_FS=y
# CONFIG_EXT2_FS_XATTR is not set
CONFIG_EXT3_FS=y
CONFIG_EXT3_FS_XATTR=y
# CONFIG_EXT3_FS_POSIX_ACL is not set
# CONFIG_EXT3_FS_SECURITY is not set
CONFIG_JBD=y
# CONFIG_JBD_DEBUG is not set
CONFIG_FS_MBCACHE=y
# CONFIG_REISERFS_FS is not set
# CONFIG_JFS_FS is not set
# CONFIG_XFS_FS is not set
# CONFIG_MINIX_FS is not set
# CONFIG_ROMFS_FS is not set
# CONFIG_QUOTA is not set
# CONFIG_AUTOFS_FS is not set
CONFIG_AUTOFS4_FS=y

#
# CD-ROM/DVD Filesystems
#
CONFIG_ISO9660_FS=y
CONFIG_JOLIET=y
# CONFIG_ZISOFS is not set
# CONFIG_UDF_FS is not set

#
# DOS/FAT/NT Filesystems
#
# CONFIG_FAT_FS is not set
# CONFIG_NTFS_FS is not set

#
# Pseudo filesystems
#
CONFIG_PROC_FS=y
CONFIG_PROC_KCORE=y
CONFIG_SYSFS=y
# CONFIG_DEVFS_FS is not set
CONFIG_DEVPTS_FS_XATTR=y
# CONFIG_DEVPTS_FS_SECURITY is not set
CONFIG_TMPFS=y
# CONFIG_HUGETLBFS is not set
# CONFIG_HUGETLB_PAGE is not set
CONFIG_RAMFS=y

#
# Miscellaneous filesystems
#
# CONFIG_ADFS_FS is not set
# CONFIG_AFFS_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set
# CONFIG_BEFS_FS is not set
# CONFIG_BFS_FS is not set
# CONFIG_EFS_FS is not set
# CONFIG_CRAMFS is not set
# CONFIG_VXFS_FS is not set
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set
# CONFIG_SYSV_FS is not set
# CONFIG_UFS_FS is not set

#
# Network File Systems
#
CONFIG_NFS_FS=y
CONFIG_NFS_V3=y
# CONFIG_NFS_V4 is not set
CONFIG_NFS_DIRECTIO=y
CONFIG_NFSD=y
CONFIG_NFSD_V3=y
# CONFIG_NFSD_V4 is not set
CONFIG_NFSD_TCP=y
CONFIG_ROOT_NFS=y
CONFIG_LOCKD=y
CONFIG_LOCKD_V4=y
CONFIG_EXPORTFS=y
CONFIG_SUNRPC=y
# CONFIG_RPCSEC_GSS_KRB5 is not set
# CONFIG_SMB_FS is not set
# CONFIG_CIFS is not set
# CONFIG_NCP_FS is not set
# CONFIG_CODA_FS is not set
# CONFIG_AFS_FS is not set

#
# Partition Types
#
# CONFIG_PARTITION_ADVANCED is not set
CONFIG_MSDOS_PARTITION=y

#
# Native Language Support
#
CONFIG_NLS=y
CONFIG_NLS_DEFAULT="iso8859-1"
# CONFIG_NLS_CODEPAGE_437 is not set
# CONFIG_NLS_CODEPAGE_737 is not set
# CONFIG_NLS_CODEPAGE_775 is not set
# CONFIG_NLS_CODEPAGE_850 is not set
# CONFIG_NLS_CODEPAGE_852 is not set
# CONFIG_NLS_CODEPAGE_855 is not set
# CONFIG_NLS_CODEPAGE_857 is not set
# CONFIG_NLS_CODEPAGE_860 is not set
# CONFIG_NLS_CODEPAGE_861 is not set
# CONFIG_NLS_CODEPAGE_862 is not set
# CONFIG_NLS_CODEPAGE_863 is not set
# CONFIG_NLS_CODEPAGE_864 is not set
# CONFIG_NLS_CODEPAGE_865 is not set
# CONFIG_NLS_CODEPAGE_866 is not set
# CONFIG_NLS_CODEPAGE_869 is not set
# CONFIG_NLS_CODEPAGE_936 is not set
# CONFIG_NLS_CODEPAGE_950 is not set
# CONFIG_NLS_CODEPAGE_932 is not set
# CONFIG_NLS_CODEPAGE_949 is not set
# CONFIG_NLS_CODEPAGE_874 is not set
# CONFIG_NLS_ISO8859_8 is not set
# CONFIG_NLS_CODEPAGE_1250 is not set
# CONFIG_NLS_CODEPAGE_1251 is not set
# CONFIG_NLS_ASCII is not set
# CONFIG_NLS_ISO8859_1 is not set
# CONFIG_NLS_ISO8859_2 is not set
# CONFIG_NLS_ISO8859_3 is not set
# CONFIG_NLS_ISO8859_4 is not set
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set
# CONFIG_NLS_ISO8859_9 is not set
# CONFIG_NLS_ISO8859_13 is not set
# CONFIG_NLS_ISO8859_14 is not set
# CONFIG_NLS_ISO8859_15 is not set
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set
# CONFIG_NLS_UTF8 is not set

#
# Profiling support
#
CONFIG_PROFILING=y
# CONFIG_OPROFILE is not set

#
# Kernel hacking
#
CONFIG_DEBUG_KERNEL=y
CONFIG_EARLY_PRINTK=y
# CONFIG_DEBUG_STACKOVERFLOW is not set
# CONFIG_DEBUG_STACK_USAGE is not set
# CONFIG_DEBUG_SLAB is not set
CONFIG_MAGIC_SYSRQ=y
# CONFIG_DEBUG_SPINLOCK is not set
# CONFIG_DEBUG_PAGEALLOC is not set
# CONFIG_DEBUG_HIGHMEM is not set
# CONFIG_DEBUG_INFO is not set
# CONFIG_DEBUG_SPINLOCK_SLEEP is not set
# CONFIG_FRAME_POINTER is not set
# CONFIG_4KSTACKS is not set
CONFIG_X86_FIND_SMP_CONFIG=y
CONFIG_X86_MPPARSE=y

#
# Security options
#
# CONFIG_SECURITY is not set

#
# Cryptographic options
#
# CONFIG_CRYPTO is not set

#
# Library routines
#
# CONFIG_CRC16 is not set
# CONFIG_CRC32 is not set
# CONFIG_LIBCRC32C is not set
CONFIG_X86_SMP=y
CONFIG_X86_HT=y
CONFIG_X86_BIOS_REBOOT=y
CONFIG_X86_TRAMPOLINE=y
CONFIG_PC=y

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: nfs_inode_cache not getting pruned
  2004-07-07  7:02   ` Brad Fitzpatrick
@ 2004-07-07  7:40     ` Andrew Morton
  2004-07-07  8:01       ` Tigran Aivazian
  0 siblings, 1 reply; 5+ messages in thread
From: Andrew Morton @ 2004-07-07  7:40 UTC (permalink / raw)
  To: Brad Fitzpatrick; +Cc: linux-kernel

Brad Fitzpatrick <brad@danga.com> wrote:
>
> On Tue, 6 Jul 2004, Andrew Morton wrote:
> 
>  > Brad Fitzpatrick <brad@danga.com> wrote:
>  > >
>  > > I've got a couple boxes here that keep running out of lowmem after about a
>  > >  day of uptime, rendering them almost entirely unusable.  (OOM killer
>  > >  taking out processes left and right, despite 1.5 GB highmem available...)
>  > >
>  > >  From what I can tell, nfs_inode_cache isn't responding to memory pressure
>  > >  and cleaning itself (enough?).
>  >
>  > It works OK here.  Please provide kernel version and full NFS mount options.
> 
>  2.6.7, both client and server.
> 
>  Both machines are exporting 14 filesystems (each ext3 on 3w-9xxx) and
>  mounting the other's 14 over NFSv3:

Sorry, I still cannot reproduce it.  I suspect it's specific to the access
patterns in some way.

Are you able to generate some simple testcase which demonstrates the
problem?  Say, start off from a clean boot, just mount a single filesystem
and then find some access pattern which causes the inode cache to get
stuck?

Also, perhaps the entire VFS cache reclaim mechanism got stuck - check the
logs for any oopses, because that can do it for sure.

And do a huge ls -lR on a local filesystem, check that the local filesystem
VFS caches are being correctly reclaimed.

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: nfs_inode_cache not getting pruned
  2004-07-07  7:40     ` Andrew Morton
@ 2004-07-07  8:01       ` Tigran Aivazian
  0 siblings, 0 replies; 5+ messages in thread
From: Tigran Aivazian @ 2004-07-07  8:01 UTC (permalink / raw)
  To: Andrew Morton; +Cc: Brad Fitzpatrick, linux-kernel

On Wed, 7 Jul 2004, Andrew Morton wrote:
> Sorry, I still cannot reproduce it.  I suspect it's specific to the access
> patterns in some way.

A simple access pattern that drives mad any filesystem over NFS is:

# symlink & readlink & unlink &

symlink.c is while (1) symlink("a", "/test/b");
readlink.c is while(1) readlink("/test/b", buf, 900);
unlink.c is while(1) unlink("/test/b");

On the server nothing interesting happens (except expected messages about
"//b" being already there and d_count being too high):

nfs_safe_remove: //b busy, d_count=2
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??
nfs_safe_remove: //b busy, d_count=2
nfs_proc_symlink: //b already exists??
nfs_proc_symlink: //b already exists??

But on the client the inode_cache and dentry_cache grow indefinitely. The
kernel (both client and server) is 2.4.21-15.ELsmp (haven't tried on 2.6
yet). The fs on the server was ext3 made with default options and mounted 
with defaults and exported with:

/mnt *(rw,no_root_squash,insecure,no_subtree_check,sync)

Btw, this access pattern was suggested by running racer. If you run the
whole racer over NFS you may hit other interesting problems after a
while.

Kind regards
Tigran

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2004-07-07  8:03 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2004-07-07  4:03 nfs_inode_cache not getting pruned Brad Fitzpatrick
2004-07-07  4:22 ` Andrew Morton
2004-07-07  7:02   ` Brad Fitzpatrick
2004-07-07  7:40     ` Andrew Morton
2004-07-07  8:01       ` Tigran Aivazian

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®