From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S965202AbWECOlV (ORCPT ); Wed, 3 May 2006 10:41:21 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S965206AbWECOlV (ORCPT ); Wed, 3 May 2006 10:41:21 -0400 Received: from [212.33.166.254] ([212.33.166.254]:63240 "EHLO raad.intranet") by vger.kernel.org with ESMTP id S965204AbWECOlU (ORCPT ); Wed, 3 May 2006 10:41:20 -0400 From: Al Boldi To: chuck gelm Subject: Re: LinuxQuestions.org - Community Bulletin Date: Wed, 3 May 2006 17:39:25 +0300 User-Agent: KMail/1.5 References: <200605020407.a7286e265899@www.linuxquestions.org> <200605031421.48043.a1426z@gawab.com> <4458677E.6000706@gelm.net> In-Reply-To: <4458677E.6000706@gelm.net> Cc: linux-kernel@vger.kernel.org, linux-admin@vger.kernel.org MIME-Version: 1.0 Content-Disposition: inline Content-Type: Multipart/Mixed; boundary="Boundary-00=_dCMWEepQ7DRabnR" Message-Id: <200605031739.25508.a1426z@gawab.com> Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org --Boundary-00=_dCMWEepQ7DRabnR Content-Type: text/plain; charset="windows-1256" Content-Transfer-Encoding: 7bit Content-Disposition: inline chuck gelm wrote: > Al Boldi wrote: > >chuck gelm wrote: > >>tom arnall wrote: > >>>i am experiencing memory problems Me too on 2.6.16, so maybe lkml can help? > >>>trying to run an application that > >>>processes a file of about .5GB. So far my results are: > >>> > >>>(1) set ulimit as follows: > >>> > >>> core file size (blocks, -c) 0 > >>> data seg size (kbytes, -d) unlimited > >>> file size (blocks, -f) unlimited > >>> max locked memory (kbytes, -l) 256000 > >>> max memory size (kbytes, -m) 256000 > >>> open files (-n) 1024 > >>> pipe size (512 bytes, -p) 8 > >>> stack size (kbytes, -s) 8192 > >>> cpu time (seconds, -t) unlimited > >>> max user processes (-u) unlimited > >>> virtual memory (kbytes, -v) 768000 > >>> > >>>This gives me 'out of memory' errors. > >>> > >>>(2) set 'virtual memory' very high and the application hogs memory and > >>>brings the rest of the system to almost a halt. > >>> > >>>Thanks in advance for any help you can give me, > >>> > >>>Tom Arnall > >>>north spit, ca > >> > >>Hi, Tom: > >> > >> I don't know anything about 'ulimit', but how much real memory do you > >>have? I'd try adding another 2 Gigabytes of virtual memory. > >>Also, try > >> > >> nice -n 19 > >> > >>so that it does not 'hog' the system so much. > >> > >>Run 'top' to watch how much memory your application uses. > >> > >>HTH, Chuck Thanks! -- Al --Boundary-00=_dCMWEepQ7DRabnR Content-Type: text/x-log; charset="windows-1256"; name="oom.log" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="oom.log" oom-killer: gfp_mask=0x201d2, order=0 [] pci_claim_resource+0x20/0xd0 [] out_of_memory+0xa5/0xc0 [] __alloc_pages+0x279/0x310 [] __do_page_cache_readahead+0xe9/0x120 [] max_sane_readahead+0x2f/0x50 [] pci_claim_resource+0x8c/0xd0 [] filemap_nopage+0x2eb/0x370 [] do_no_page+0x65/0x220 [] pdev_sort_resources+0x28/0x100 [] __handle_mm_fault+0xec/0x200 [] do_page_fault+0x188/0x5c5 [] pdev_sort_resources+0xcc/0x100 [] pdev_sort_resources+0xcc/0x100 [] pdev_sort_resources+0xcc/0x100 [] do_page_fault+0x0/0x5c5 [] error_code+0x4f/0x54 Mem-info: DMA per-cpu: cpu 0 hot: high 0, batch 1 used:0 cpu 0 cold: high 0, batch 1 used:0 DMA32 per-cpu: empty Normal per-cpu: empty HighMem per-cpu: empty Free pages: 476kB (0kB HighMem) Active:96 inactive:126 dirty:0 writeback:0 unstable:0 free:119 slab:445 mapped:186 pagetables:31 DMA free:476kB min:360kB low:448kB high:540kB active:384kB inactive:504kB present:8192kB pages_scanned:257 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 23*4kB 4*8kB 0*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 476kB DMA32: empty Normal: empty HighMem: empty Swap cache: add 11494, delete 11444, find 2453/5972, race 0+0 Free swap = 1016696kB Total swap = 1020088kB Free swap: 1016696kB 2048 pages of RAM 0 pages of HIGHMEM 1031 reserved pages 209 pages shared 50 pages swap cached 0 pages dirty 0 pages writeback 186 pages mapped 445 pages slab 31 pages pagetables Out of Memory: Kill process 65 (bash) score 88 and children. Out of memory: Killed process 104 (mc). oom-killer: gfp_mask=0x201d2, order=0 [] gzip_mark+0x0/0x10 [] out_of_memory+0xa5/0xc0 [] __alloc_pages+0x279/0x310 [] __do_page_cache_readahead+0xe9/0x120 [] max_sane_readahead+0x2f/0x50 [] flush_window+0x4c/0x70 [] filemap_nopage+0x2eb/0x370 [] do_no_page+0x65/0x220 [] unpack_to_rootfs+0x48/0x200 [] __handle_mm_fault+0xec/0x200 [] do_page_fault+0x188/0x5c5 [] unpack_to_rootfs+0xec/0x200 [] unpack_to_rootfs+0xec/0x200 [] do_name+0x150/0x1b0 [] do_name+0x150/0x1b0 [] do_page_fault+0x0/0x5c5 [] error_code+0x4f/0x54 Mem-info: DMA per-cpu: cpu 0 hot: high 0, batch 1 used:0 cpu 0 cold: high 0, batch 1 used:0 DMA32 per-cpu: empty Normal per-cpu: empty HighMem per-cpu: empty Free pages: 528kB (0kB HighMem) Active:177 inactive:73 dirty:0 writeback:0 unstable:0 free:132 slab:440 mapped:213 pagetables:27 DMA free:528kB min:360kB low:448kB high:540kB active:708kB inactive:292kB present:8192kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 40*4kB 2*8kB 0*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 528kB DMA32: empty Normal: empty HighMem: empty Swap cache: add 13712, delete 13643, find 2842/7215, race 0+0 Free swap = 1016948kB Total swap = 1020088kB Free swap: 1016948kB 2048 pages of RAM 0 pages of HIGHMEM 1031 reserved pages 213 pages shared 69 pages swap cached 0 pages dirty 0 pages writeback 213 pages mapped 440 pages slab 27 pages pagetables Out of Memory: Kill process 22 (bash) score 64 and children. Out of memory: Killed process 103 (top). oom-killer: gfp_mask=0x201d2, order=0 [] out_of_memory+0xa5/0xc0 [] __alloc_pages+0x279/0x310 [] __do_page_cache_readahead+0xe9/0x120 [] max_sane_readahead+0x2f/0x50 [] filemap_nopage+0x2eb/0x370 [] do_no_page+0x65/0x220 [] __handle_mm_fault+0xec/0x200 [] do_page_fault+0x188/0x5c5 [] do_page_fault+0x0/0x5c5 [] error_code+0x4f/0x54 Mem-info: DMA per-cpu: cpu 0 hot: high 0, batch 1 used:0 cpu 0 cold: high 0, batch 1 used:0 DMA32 per-cpu: empty Normal per-cpu: empty HighMem per-cpu: empty Free pages: 368kB (0kB HighMem) Active:18 inactive:261 dirty:0 writeback:0 unstable:0 free:92 slab:443 mapped:246 pagetables:27 DMA free:368kB min:360kB low:448kB high:540kB active:72kB inactive:1044kB present:8192kB pages_scanned:466 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 DMA: 0*4kB 2*8kB 0*16kB 1*32kB 1*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 368kB DMA32: empty Normal: empty HighMem: empty Swap cache: add 16443, delete 16334, find 3542/8819, race 0+0 Free swap = 1016548kB Total swap = 1020088kB Free swap: 1016548kB 2048 pages of RAM 0 pages of HIGHMEM 1031 reserved pages 253 pages shared 109 pages swap cached 0 pages dirty 0 pages writeback 246 pages mapped 443 pages slab 27 pages pagetables Out of Memory: Kill process 108 (bash) score 74 and children. Out of memory: Killed process 144 (bash). --Boundary-00=_dCMWEepQ7DRabnR--