mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Trevor Cordes <trevor@tecnopolis.ca>
To: Mel Gorman <mgorman@techsingularity.net>
Cc: linux-kernel@vger.kernel.org,
	Joonsoo Kim <iamjoonsoo.kim@lge.com>,
	Michal Hocko <mhocko@kernel.org>,
	Minchan Kim <minchan@kernel.org>, Rik van Riel <riel@surriel.com>,
	Srikar Dronamraju <srikar@linux.vnet.ibm.com>
Subject: Re: mm, vmscan: commit makes PAE kernel crash nightly (bisected)
Date: Wed, 11 Jan 2017 16:52:32 -0600	[thread overview]
Message-ID: <20170111165232.0b7abe18@pog.tecnopolis.ca> (raw)
In-Reply-To: <20170111121428.4sswbkzyqz7vf6so@techsingularity.net>

[-- Attachment #1: Type: text/plain, Size: 1359 bytes --]

On 2017-01-11 Mel Gorman wrote:
> On Wed, Jan 11, 2017 at 12:11:46PM +0000, Mel Gorman wrote:
> > On Wed, Jan 11, 2017 at 04:32:43AM -0600, Trevor Cordes wrote:  
> > > Hi!  I have biected a nightly oom-killer flood and crash/hang on
> > > one of the boxes I admin.  It doesn't crash on Fedora 23/24
> > > 4.7.10 kernel but does on any 4.8 Fedora kernel.  I did a vanilla
> > > bisect and the bug is here:
> > > 
> > > commit b2e18757f2c9d1cdd746a882e9878852fdec9501
> > > Author: Mel Gorman <mgorman@techsingularity.net>
> > > Date:   Thu Jul 28 15:45:37 2016 -0700
> > > 
> > >     mm, vmscan: begin reclaiming pages on a per-node basis
> > >   
> > 
> > Michal Hocko recently worked on a bug similar to this. Can you test
> > the following patch that is currently queued in Andrew Morton's
> > tree? It applies cleanly to 4.9
> >   
> 
> I should have pointed out that this patch primarily affects memcg but
> the bug report did not include an OOM report and did not describe
> whether memcgs could be involved or not. If memcgs are not involved
> then please post the first full OOM kill.

I will apply your patch tonight and it will take 48 hours to confirm
that it is "good" (<24 hours if it's bad), and I will reply back.

I'm not sure how I can tell if my bug is because of memcgs so here is
a full first oom example (attached).

Thanks for the help!

[-- Attachment #2: oom-example --]
[-- Type: application/octet-stream, Size: 20850 bytes --]

Jan  9 03:20:46 firewallfsi kernel: [25593.036636] reboot-when-oom invoked oom-killer: gfp_mask=0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK), order=1, oom_score_adj=0
Jan  9 03:20:46 firewallfsi kernel: [25593.039254] reboot-when-oom cpuset=/ mems_allowed=0
Jan  9 03:20:46 firewallfsi kernel: [25593.040573] CPU: 3 PID: 29355 Comm: reboot-when-oom Not tainted 4.7.0+ #14
Jan  9 03:20:46 firewallfsi kernel: [25593.041839] Hardware name: Intel Corporation S1200BTL/S1200BTL, BIOS S1200BT.86B.02.00.0035.030220120927 03/02/2012
Jan  9 03:20:46 firewallfsi kernel: [25593.043074]  db22c967 56e6d67f 00000286 ec8ddd30 dab59977 ec8dde74 f03a3540 ec8ddd78
Jan  9 03:20:46 firewallfsi kernel: [25593.044308]  da9dc66c db147878 dbbfb9b4 027000c0 ec8dde80 00000001 00000000 ec8ddd58
Jan  9 03:20:46 firewallfsi kernel: [25593.045528]  daf4e7fd ec8ddd78 dab5f71f 00000000 f61ed280 f07dd200 f03a3540 0000000a
Jan  9 03:20:46 firewallfsi kernel: [25593.046762] Call Trace:
Jan  9 03:20:46 firewallfsi kernel: [25593.047928]  [<dab59977>] dump_stack+0x58/0x81
Jan  9 03:20:46 firewallfsi kernel: [25593.049063]  [<da9dc66c>] dump_header+0x4a/0x18f
Jan  9 03:20:46 firewallfsi kernel: [25593.050179]  [<daf4e7fd>] ? _raw_spin_unlock_irqrestore+0xd/0x10
Jan  9 03:20:46 firewallfsi kernel: [25593.051321]  [<dab5f71f>] ? ___ratelimit+0x9f/0xf0
Jan  9 03:20:46 firewallfsi kernel: [25593.052405]  [<da9763ea>] oom_kill_process+0x1ea/0x3b0
Jan  9 03:20:46 firewallfsi kernel: [25593.053473]  [<da87613a>] ? has_capability_noaudit+0x1a/0x30
Jan  9 03:20:46 firewallfsi kernel: [25593.054525]  [<da975b8b>] ? oom_badness.part.12+0xcb/0x140
Jan  9 03:20:46 firewallfsi kernel: [25593.055560]  [<da976809>] out_of_memory+0x1f9/0x230
Jan  9 03:20:46 firewallfsi kernel: [25593.056614]  [<da97b3bd>] __alloc_pages_nodemask+0xd9d/0xdc0
Jan  9 03:20:46 firewallfsi kernel: [25593.057644]  [<da86a078>] copy_process.part.41+0x108/0x14d0
Jan  9 03:20:46 firewallfsi kernel: [25593.058657]  [<da9ca0e7>] ? kmem_cache_alloc+0xf7/0x1c0
Jan  9 03:20:46 firewallfsi kernel: [25593.059652]  [<da9ca0e7>] ? kmem_cache_alloc+0xf7/0x1c0
Jan  9 03:20:46 firewallfsi kernel: [25593.060643]  [<da90fb4f>] ? __audit_syscall_entry+0xaf/0x110
Jan  9 03:20:46 firewallfsi kernel: [25593.061626]  [<da86b604>] _do_fork+0xd4/0x370
Jan  9 03:20:46 firewallfsi kernel: [25593.062563]  [<da90fd7e>] ? __audit_syscall_exit+0x1ce/0x260
Jan  9 03:20:46 firewallfsi kernel: [25593.063477]  [<da86b98c>] SyS_clone+0x2c/0x30
Jan  9 03:20:46 firewallfsi kernel: [25593.064373]  [<da80386d>] do_fast_syscall_32+0x8d/0x140
Jan  9 03:20:46 firewallfsi kernel: [25593.065253]  [<daf4ecf2>] sysenter_past_esp+0x47/0x75
Jan  9 03:20:46 firewallfsi kernel: [25593.066141] Mem-Info:
Jan  9 03:20:46 firewallfsi kernel: [25593.067019] active_anon:78255 inactive_anon:79332 isolated_anon:0
Jan  9 03:20:46 firewallfsi kernel: [25593.067019]  active_file:87903 inactive_file:52541 isolated_file:32
Jan  9 03:20:46 firewallfsi kernel: [25593.067019]  unevictable:0 dirty:4 writeback:0 unstable:0
Jan  9 03:20:46 firewallfsi kernel: [25593.067019]  slab_reclaimable:182463 slab_unreclaimable:11478
Jan  9 03:20:46 firewallfsi kernel: [25593.067019]  mapped:24016 shmem:1043 pagetables:1466 bounce:17
Jan  9 03:20:46 firewallfsi kernel: [25593.067019]  free:713297 free_pcp:139 free_cma:0
Jan  9 03:20:46 firewallfsi kernel: [25593.071846] Node 0 active_anon:313020kB inactive_anon:317328kB active_file:351612kB inactive_file:210164kB unevictable:0kB isolated(anon):0kB isolated(file):128kB all_unreclaimable? no
Jan  9 03:20:46 firewallfsi kernel: [25593.073395] DMA free:3140kB min:68kB low:84kB high:100kB present:15976kB managed:15900kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:4968kB slab_unreclaimable:1176kB kernel_stack:64kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB node_pages_scanned:540732
Jan  9 03:20:46 firewallfsi kernel: [25593.075719] lowmem_reserve[]: 0 776 4733 4733
Jan  9 03:20:46 firewallfsi kernel: [25593.076490] Normal free:5088kB min:3528kB low:4408kB high:5288kB present:892920kB managed:814908kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:724884kB slab_unreclaimable:44736kB kernel_stack:2672kB pagetables:452kB unstable:0kB bounce:0kB free_pcp:452kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB node_pages_scanned:570144
Jan  9 03:20:46 firewallfsi kernel: [25593.078806] lowmem_reserve[]: 0 0 31652 31652
Jan  9 03:20:46 firewallfsi kernel: [25593.079564] HighMem free:2844960kB min:512kB low:5004kB high:9496kB present:4051548kB managed:4051548kB mlocked:0kB dirty:24kB writeback:0kB mapped:96060kB shmem:4172kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:5412kB unstable:0kB bounce:0kB free_pcp:120kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB node_pages_scanned:599556
Jan  9 03:20:46 firewallfsi kernel: [25593.081880] lowmem_reserve[]: 0 0 0 0
Jan  9 03:20:46 firewallfsi kernel: [25593.082646] DMA: 13*4kB (UME) 10*8kB (UME) 8*16kB (UME) 2*32kB (UE) 4*64kB (UME) 2*128kB (UM) 1*256kB (M) 2*512kB (UM) 1*1024kB (E) 0*2048kB 0*4096kB = 3140kB
Jan  9 03:20:46 firewallfsi kernel: [25593.084186] Normal: 791*4kB (MH) 196*8kB (UMEH) 2*16kB (H) 2*32kB (H) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4828kB
Jan  9 03:20:46 firewallfsi kernel: [25593.085770] HighMem: 259*4kB (UM) 173*8kB (UM) 69*16kB (UM) 137*32kB (UM) 135*64kB (UM) 66*128kB (UM) 37*256kB (UM) 11*512kB (U) 5*1024kB (UM) 9*2048kB (UM) 679*4096kB (UM) = 2844836kB
Jan  9 03:20:46 firewallfsi kernel: [25593.087356] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan  9 03:20:46 firewallfsi kernel: [25593.088172] 142162 total pagecache pages
Jan  9 03:20:46 firewallfsi kernel: [25593.088975] 569 pages in swap cache
Jan  9 03:20:46 firewallfsi kernel: [25593.089777] Swap cache stats: add 24710, delete 24141, find 1073/1632
Jan  9 03:20:46 firewallfsi kernel: [25593.090588] Free swap  = 33691592kB
Jan  9 03:20:46 firewallfsi kernel: [25593.091378] Total swap = 33784572kB
Jan  9 03:20:46 firewallfsi kernel: [25593.092182] 1240111 pages RAM
Jan  9 03:20:46 firewallfsi kernel: [25593.093004] 1012887 pages HighMem/MovableOnly
Jan  9 03:20:46 firewallfsi kernel: [25593.093786] 19522 pages reserved
Jan  9 03:20:46 firewallfsi kernel: [25593.094579] 0 pages hwpoisoned
Jan  9 03:20:46 firewallfsi kernel: [25593.095372] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
Jan  9 03:20:46 firewallfsi kernel: [25593.096185] [  611]     0   611     5229     4071      14       3        1             0 systemd-journal
Jan  9 03:20:46 firewallfsi kernel: [25593.097029] [  648]     0   648     3585     1140       9       3       43         -1000 systemd-udevd
Jan  9 03:20:46 firewallfsi kernel: [25593.097854] [  773]     0   773     1704      644       6       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.098702] [  778]     0   778     1704      623       7       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.099521] [  788]     0   788     1704      627       6       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.100328] [  796]   288   796    14423     1642      14       3        1             0 milter-greylist
Jan  9 03:20:46 firewallfsi kernel: [25593.101157] [  799]     0   799     1704      669       5       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.101954] [  800]     0   800      988      682       5       3        6             0 systemd-logind
Jan  9 03:20:46 firewallfsi kernel: [25593.102770] [  804]     0   804     1704      703       7       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.103561] [  805]     0   805     3234     2132       9       3       18             0 dynamic-ip-upda
Jan  9 03:20:46 firewallfsi kernel: [25593.104356] [  806]     0   806     1797      853       7       3        0             0 watch-services
Jan  9 03:20:46 firewallfsi kernel: [25593.105166] [  807]     0   807     3165     2028       9       3       50             0 mailwarnings
Jan  9 03:20:46 firewallfsi kernel: [25593.105970] [  809]     0   809     1736      740       7       3        0             0 tickle-pog
Jan  9 03:20:46 firewallfsi kernel: [25593.106790] [  810]     0   810     8633     1046      11       3        3             0 rsyslogd
Jan  9 03:20:46 firewallfsi kernel: [25593.107566] [  811]     0   811     1704      683       6       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.108359] [  813]     0   813     3695     1781      11       3       40             0 fetchmail
Jan  9 03:20:46 firewallfsi kernel: [25593.109171] [  814]     0   814     2710     1617      10       3       50             0 udp-sgr
Jan  9 03:20:46 firewallfsi kernel: [25593.109944] [  821]     0   821      800      492       5       3        0             0 mdadm
Jan  9 03:20:46 firewallfsi kernel: [25593.110697] [  835]     0   835     1472      922       6       3       41             0 smartd
Jan  9 03:20:46 firewallfsi kernel: [25593.111426] [  836]     0   836     1704      648       6       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.112119] [  837]     0   837     3266     2092      10       3       42             0 restarter
Jan  9 03:20:46 firewallfsi kernel: [25593.112813] [  838]     0   838     1033      607       6       3        0             0 irqbalance
Jan  9 03:20:46 firewallfsi kernel: [25593.113476] [  858]     0   858     1704      616       7       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.114140] [  859]     0   859     3311     2200      10       3       48             0 watch-ip
Jan  9 03:20:46 firewallfsi kernel: [25593.114787] [  860]    81   860     1700     1052       7       3        0          -900 dbus-daemon
Jan  9 03:20:46 firewallfsi kernel: [25593.115395] [  987]     0   987     2499      365       9       3       16             0 saslauthd
Jan  9 03:20:46 firewallfsi kernel: [25593.116015] [  988]     0   988     2499      111       9       3       15             0 saslauthd
Jan  9 03:20:46 firewallfsi kernel: [25593.116608] [  989]     0   989     2499      113       9       3       13             0 saslauthd
Jan  9 03:20:46 firewallfsi kernel: [25593.117163] [  990]     0   990     2499      113       9       3       13             0 saslauthd
Jan  9 03:20:46 firewallfsi kernel: [25593.117732] [  991]     0   991     2499      112       9       3       14             0 saslauthd
Jan  9 03:20:46 firewallfsi kernel: [25593.118260] [ 1042]     0  1042      583      439       5       3        0             0 acpid
Jan  9 03:20:46 firewallfsi kernel: [25593.118755] [ 1066]     0  1066     7287     1088      11       3       14             0 apcupsd
Jan  9 03:20:46 firewallfsi kernel: [25593.119228] [ 1068]     0  1068     2769      514       8       3       23         -1000 sshd
Jan  9 03:20:46 firewallfsi kernel: [25593.119685] [ 1174]     0  1174      860      467       5       3        0             0 atd
Jan  9 03:20:46 firewallfsi kernel: [25593.120139] [ 1214]    27  1214     1707      727       7       3        0             0 mysqld_safe
Jan  9 03:20:46 firewallfsi kernel: [25593.120557] [ 1323]    25  1323    79966    41422     111       3     4283             0 named
Jan  9 03:20:46 firewallfsi kernel: [25593.120961] [ 1384]    27  1384   124505    11410      60       3     1233             0 mysqld
Jan  9 03:20:46 firewallfsi kernel: [25593.121350] [ 1388]     0  1388     1116      500       6       3        0             0 agetty
Jan  9 03:20:46 firewallfsi kernel: [25593.121732] [ 1389]     0  1389     1116      489       6       3        0             0 agetty
Jan  9 03:20:46 firewallfsi kernel: [25593.122125] [ 1390]     0  1390     1116      514       6       3        0             0 agetty
Jan  9 03:20:46 firewallfsi kernel: [25593.122489] [ 1391]     0  1391     1116      518       6       3        0             0 agetty
Jan  9 03:20:46 firewallfsi kernel: [25593.122867] [ 1392]     0  1392     1116      488       6       3        0             0 agetty
Jan  9 03:20:46 firewallfsi kernel: [25593.123238] [ 1393]     0  1393     1116      528       6       3        0             0 agetty
Jan  9 03:20:46 firewallfsi kernel: [25593.123586] [ 1395]   276  1395   113030    86070     218       3    15425             0 clamd
Jan  9 03:20:46 firewallfsi kernel: [25593.123938] [ 1396]   290  1396    10838     1113      11       3        0             0 clamav-milter
Jan  9 03:20:46 firewallfsi kernel: [25593.124309] [ 1406]     0  1406    12050     6009      26       3      136             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.124669] [ 1442]     0  1442     7049     2384      16       3        2             0 nmbd
Jan  9 03:20:46 firewallfsi kernel: [25593.125034] [ 1443]     0  1443     6840     2239      16       3        7             0 nmbd
Jan  9 03:20:46 firewallfsi kernel: [25593.125366] [ 1489]     0  1489     3829     1506      11       3      106             0 sendmail
Jan  9 03:20:46 firewallfsi kernel: [25593.125730] [ 1549]    23  1549     5440      700      13       3       21             0 squid
Jan  9 03:20:46 firewallfsi kernel: [25593.126070] [ 1551]    23  1551     9371     6015      20       3       79             0 squid
Jan  9 03:20:46 firewallfsi kernel: [25593.126401] [ 1552]    51  1552     3502      704      10       3       57             0 sendmail
Jan  9 03:20:46 firewallfsi kernel: [25593.126759] [ 1622]    23  1622     1179      413       6       3        0             0 unlinkd
Jan  9 03:20:46 firewallfsi kernel: [25593.127116] [ 1767]    48  1767    49254     4004      43       3      185             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.127452] [ 1768]    48  1768    16217     4391      27       3      116             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.127789] [ 1771]    48  1771    16384     4377      28       3      135             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.128139] [ 1787]    48  1787    16218     4047      27       3      138             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.128466] [ 1793]    48  1793    16384     4173      28       3      258             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.128793] [ 1807]     0  1807     1704      632       6       3        0             0 sh
Jan  9 03:20:46 firewallfsi kernel: [25593.129136] [ 1808]     0  1808     2741     1347       9       3      294             0 udp-sgs
Jan  9 03:20:46 firewallfsi kernel: [25593.129462] [ 1863]     0  1863     9561     3486      22       3        7             0 smbd
Jan  9 03:20:46 firewallfsi kernel: [25593.129808] [ 1871]     0  1871     9197     1083      22       3        9             0 smbd
Jan  9 03:20:46 firewallfsi kernel: [25593.130148] [ 1874]     0  1874     9446     1178      22       3        7             0 smbd
Jan  9 03:20:46 firewallfsi kernel: [25593.130466] [ 1953]     0  1953     5116     1937      13       3      185             0 dhclient
Jan  9 03:20:46 firewallfsi kernel: [25593.130789] [ 2025]     0  2025      594      379       5       3        0             0 pptpd
Jan  9 03:20:46 firewallfsi kernel: [25593.131128] [ 2032]     0  2032      954      662       6       3        9             0 dovecot
Jan  9 03:20:46 firewallfsi kernel: [25593.131449] [ 2033]    97  2033      904      545       5       3        0             0 anvil
Jan  9 03:20:46 firewallfsi kernel: [25593.131782] [ 2034]     0  2034      937      560       5       3       51             0 log
Jan  9 03:20:46 firewallfsi kernel: [25593.132111] [ 2191]     0  2191     1899      716       7       3       45             0 crond
Jan  9 03:20:46 firewallfsi kernel: [25593.132429] [ 2192]    38  2192     1536      995       6       3        0             0 ntpd
Jan  9 03:20:46 firewallfsi kernel: [25593.132770] [ 2195]    48  2195    16218     4065      27       3      119             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.133111] [ 2198]    48  2198    16218     4066      27       3      117             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.133427] [ 2199]    48  2199    16218     4084      27       3      115             0 /usr/sbin/httpd
Jan  9 03:20:46 firewallfsi kernel: [25593.133759] [ 2204]   301  2204    11214     4061      26       3        6             0 smbd
Jan  9 03:20:46 firewallfsi kernel: [25593.134091] [ 2211]   177  2211     6833     4305      17       3      316             0 dhcpd
Jan  9 03:20:46 firewallfsi kernel: [25593.134408] [ 2212]     0  2212     4181     1843      11       3        0             0 sshd
Jan  9 03:20:46 firewallfsi kernel: [25593.134753] [ 2214]     0  2214     1584     1115       6       3        0             0 systemd
Jan  9 03:20:46 firewallfsi kernel: [25593.135098] [ 2225]     0  2225     2455      326       8       3       62             0 (sd-pam)
Jan  9 03:20:46 firewallfsi kernel: [25593.135423] [ 2240]     0  2240     4214     1021      11       3        1             0 sshd
Jan  9 03:20:46 firewallfsi kernel: [25593.135771] [ 2247]     0  2247     1266     1006       6       3        0             0 tcsh
Jan  9 03:20:46 firewallfsi kernel: [25593.136112] [ 2532]   301  2532     1590     1065       6       3       17             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.136433] [ 3299]     0  3299     1135      819       6       3        3             0 config
Jan  9 03:20:46 firewallfsi kernel: [25593.136777] [ 3501]   304  3501     1399      988       6       3        1             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.137115] [ 3505]   273  3505     2208     1308       8       3        3             0 imap-login
Jan  9 03:20:46 firewallfsi kernel: [25593.137433] [ 3506]   301  3506     1589     1021       7       3       83             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.137772] [ 4460]   302  4460     1431     1108       6       3        0             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.138109] [ 4672]   303  4672     1402      932       6       3        0             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.138429] [ 6971]   273  6971     2209     1269       8       3        0             0 imap-login
Jan  9 03:20:46 firewallfsi kernel: [25593.138779] [ 6977]   302  6977     1427     1081       6       3        1             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.139127] [ 6984]     0  6984     9675     3727      22       3        7             0 smbd
Jan  9 03:20:46 firewallfsi kernel: [25593.139460] [18001]   273 18001     2208     1380       8       3        0             0 imap-login
Jan  9 03:20:46 firewallfsi kernel: [25593.139818] [18005]   301 18005     1396      958       6       3        0             0 imap
Jan  9 03:20:46 firewallfsi kernel: [25593.140169] [29355]     0 29355     1307      915       6       3        0             0 reboot-when-oom
Jan  9 03:20:46 firewallfsi kernel: [25593.140501] [29356]     0 29356     1307      919       6       3        0             0 watch-ps
Jan  9 03:20:46 firewallfsi kernel: [25593.140852] [ 3232]     0  3232     9656     3456      22       3       36             0 smbd
Jan  9 03:20:46 firewallfsi kernel: [25593.141204] [ 9393]     0  9393     1900      464       7       3       56             0 crond
Jan  9 03:20:46 firewallfsi kernel: [25593.141537] [ 9394]     0  9394     3210     2041      10       3       20             0 freshclam-tec-w
Jan  9 03:20:46 firewallfsi kernel: [25593.141904] [ 9801]     0  9801     1654      419       7       3        9             0 anacron
Jan  9 03:20:46 firewallfsi kernel: [25593.142251] [13714]     0 13714     1396      162       6       3        0             0 sleep
Jan  9 03:20:46 firewallfsi kernel: [25593.142588] [14533]    97 14533     1464      869       6       3        0             0 auth
Jan  9 03:20:46 firewallfsi kernel: [25593.142927] [14534]     0 14534      903      251       5       3        0             0 ssl-params
Jan  9 03:20:46 firewallfsi kernel: [25593.143280] [14944]     0 14944     1396      141       7       3        0             0 sleep
Jan  9 03:20:46 firewallfsi kernel: [25593.143613] Out of memory: Kill process 1395 (clamd) score 10 or sacrifice child
Jan  9 03:20:46 firewallfsi kernel: [25593.143975] Killed process 1395 (clamd) total-vm:452120kB, anon-rss:329076kB, file-rss:15204kB, shmem-rss:0kB
Jan  9 03:20:46 firewallfsi kernel: [25593.158502] oom_reaper: reaped process 1395 (clamd), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB

  reply	other threads:[~2017-01-11 22:53 UTC|newest]

Thread overview: 40+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-01-11 10:32 Trevor Cordes
2017-01-11 12:11 ` Mel Gorman
2017-01-11 12:14   ` Mel Gorman
2017-01-11 22:52     ` Trevor Cordes [this message]
2017-01-12  9:36       ` Michal Hocko
2017-01-15  6:27         ` Trevor Cordes
2017-01-16 11:09           ` Mel Gorman
2017-01-17 13:52             ` Michal Hocko
2017-01-17 14:21               ` Mel Gorman
2017-01-17 14:54                 ` Michal Hocko
2017-01-18  7:25                   ` Trevor Cordes
2017-01-18 17:48                   ` Mel Gorman
2017-01-18 18:07                   ` Mel Gorman
2017-01-19  9:48                   ` Trevor Cordes
2017-01-19 11:37                     ` Michal Hocko
2017-01-20  6:35                       ` Trevor Cordes
2017-01-20 11:02                         ` Mel Gorman
2017-01-20 15:55                           ` Mel Gorman
2017-01-23  0:45                             ` Trevor Cordes
2017-01-23 10:48                               ` Mel Gorman
2017-01-23 11:04                                 ` Mel Gorman
2017-01-25  9:46                                   ` Michal Hocko
2017-01-24 12:59                                 ` Michal Hocko
2017-01-25 10:02                                 ` Trevor Cordes
2017-01-25 12:04                                   ` Michal Hocko
2017-01-29 22:50                                     ` Trevor Cordes
2017-01-30  7:51                                       ` Michal Hocko
2017-02-01  9:29                                         ` Trevor Cordes
2017-02-01 10:14                                           ` Michal Hocko
2017-02-04  0:36                                             ` Trevor Cordes
2017-02-04 20:05                                               ` Rik van Riel
2017-02-05 10:03                                               ` Michal Hocko
2017-02-05 22:53                                                 ` Trevor Cordes
2017-01-30  9:10                                       ` Mel Gorman
2017-01-24 12:54                               ` Michal Hocko
2017-01-26 23:18                                 ` Trevor Cordes
2017-01-27  7:36                                   ` Michal Hocko
2017-01-24 12:51                         ` Michal Hocko
2017-01-18  6:52             ` Trevor Cordes
2017-01-17 13:45           ` Michal Hocko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20170111165232.0b7abe18@pog.tecnopolis.ca \
    --to=trevor@tecnopolis.ca \
    --cc=iamjoonsoo.kim@lge.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mgorman@techsingularity.net \
    --cc=mhocko@kernel.org \
    --cc=minchan@kernel.org \
    --cc=riel@surriel.com \
    --cc=srikar@linux.vnet.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®