mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Trevor Cordes <trevor@tecnopolis.ca>
To: Mel Gorman <mgorman@techsingularity.net>
Cc: Michal Hocko <mhocko@kernel.org>,
	linux-kernel@vger.kernel.org,
	Joonsoo Kim <iamjoonsoo.kim@lge.com>,
	Minchan Kim <minchan@kernel.org>, Rik van Riel <riel@surriel.com>,
	Srikar Dronamraju <srikar@linux.vnet.ibm.com>
Subject: Re: mm, vmscan: commit makes PAE kernel crash nightly (bisected)
Date: Sun, 22 Jan 2017 18:45:59 -0600	[thread overview]
Message-ID: <20170122184559.0b5c0fd8@pog.tecnopolis.ca> (raw)
In-Reply-To: <20170120155553.gjv2x5eycvdudnil@techsingularity.net>

[-- Attachment #1: Type: text/plain, Size: 7523 bytes --]

On 2017-01-20 Mel Gorman wrote:
> > 
> > Thanks for the OOM report. I was expecting it to be a particular
> > shape and my expectations were not matched so it took time to
> > consider it further. Can you try the cumulative patch below? It
> > combines three patches that
> > 
> > 1. Allow slab shrinking even if the LRU patches are unreclaimable in
> >    direct reclaim
> > 2. Shrinks slab based once based on the contents of all memcgs
> > instead of shrinking one at a time
> > 3. Tries to shrink slabs if the lowmem usage is too high
> > 
> > Unfortunately it's only boot tested on x86-64 as I didn't get the
> > chance to setup an i386 test bed.
> >   
> 
> There was one major flaw in that patch. This version fixes it and
> addresses other minor issues. It may still be too agressive shrinking
> slab but worth trying out. Thanks.

I ran with your patch below and it oom'd on the first night.  It was
weird, it didn't hang the system, and my rebooter script started a
reboot but the system never got more than half down before it just sat
there in a weird state where a local console user could still login but
not much was working.  So the patches don't seem to solve the problem.

For the above compile I applied your patches to 4.10.0-rc4+, I hope
that's ok.

Attached is the first oom from that night.  I include some stuff below
the oom where the kernel is obviously having issues and dumping more
strange output.  I don't think I've seen that before.  That probably
explains the strange state it was left in.

Also, completely separate from your patch I ran mhocko's 4.9 tree with
mem=2G to see if lower ram amount would help, but it didn't.  Even with
2G the system oom and hung same as usual.  So far the only thing that
helps at all was the cgroup_disable=memory option, which makes the
problem disappear completely for me.  I added that option to 3 other
boxes I admin with PAE and that plus limiting ram to <4GB gets rid of
the bug.  However, on the RHBZ on this bug I am commenting on, someone
there reports that cgroup_disable=memory doesn't help him at all.

Hopefully the oom attached can help you figure out a next step.  Thanks!

> diff --git a/mm/vmscan.c b/mm/vmscan.c
> index 2281ad310d06..2c735ea24a85 100644
> --- a/mm/vmscan.c
> +++ b/mm/vmscan.c
> @@ -2318,6 +2318,59 @@ static void get_scan_count(struct lruvec
> *lruvec, struct mem_cgroup *memcg, }
>  }
>  
> +#ifdef CONFIG_HIGHMEM
> +static void balance_slab_lowmem(struct pglist_data *pgdat,
> +				struct scan_control *sc)
> +{
> +	unsigned long lru_pages = 0;
> +	unsigned long slab_pages = 0;
> +	unsigned long managed_pages = 0;
> +	int zid;
> +
> +	for (zid = 0; zid < MAX_NR_ZONES; zid++) {
> +		struct zone *zone = &pgdat->node_zones[zid];
> +
> +		if (!populated_zone(zone) || is_highmem_idx(zid))
> +			continue;
> +
> +		lru_pages += zone_page_state(zone,
> NR_ZONE_INACTIVE_FILE);
> +		lru_pages += zone_page_state(zone,
> NR_ZONE_ACTIVE_FILE);
> +		lru_pages += zone_page_state(zone,
> NR_ZONE_INACTIVE_ANON);
> +		lru_pages += zone_page_state(zone,
> NR_ZONE_ACTIVE_ANON);
> +		slab_pages += zone_page_state(zone,
> NR_SLAB_RECLAIMABLE);
> +		slab_pages += zone_page_state(zone,
> NR_SLAB_UNRECLAIMABLE);
> +	}
> +
> +	/* Do not balance until LRU and slab exceeds 50% of lowmem */
> +	if (lru_pages + slab_pages < (managed_pages >> 1))
> +		return;
> +
> +	/*
> +	 * Shrink reclaimable slabs if the number of lowmem slab
> pages is
> +	 * over twice the size of LRU pages. Apply pressure relative
> to
> +	 * the imbalance between LRU and slab pages.
> +	 */
> +	if (slab_pages > lru_pages << 1) {
> +		struct reclaim_state *reclaim_state =
> current->reclaim_state;
> +		unsigned long exceed = slab_pages - (lru_pages << 1);
> +		int nid = pgdat->node_id;
> +
> +		exceed = min(exceed, slab_pages);
> +		shrink_slab(sc->gfp_mask, nid, NULL, exceed >> 3,
> slab_pages);
> +		if (reclaim_state) {
> +			sc->nr_reclaimed +=
> reclaim_state->reclaimed_slab;
> +			reclaim_state->reclaimed_slab = 0;
> +		}
> +	}
> +}
> +#else
> +static void balance_slab_lowmem(struct pglist_data *pgdat,
> +				struct scan_control *sc)
> +{
> +	return;
> +}
> +#endif
> +
>  /*
>   * This is a basic per-node page freer.  Used by both kswapd and
> direct reclaim. */
> @@ -2336,6 +2389,27 @@ static void shrink_node_memcg(struct
> pglist_data *pgdat, struct mem_cgroup *memc 
>  	get_scan_count(lruvec, memcg, sc, nr, lru_pages);
>  
> +	/*
> +	 * If direct reclaiming at elevated priority and the node is
> +	 * unreclaimable then skip LRU reclaim and let kswapd poll
> it.
> +	 */
> +	if (!current_is_kswapd() &&
> +	    sc->priority != DEF_PRIORITY &&
> +	    !pgdat_reclaimable(pgdat)) {
> +		unsigned long nr_scanned;
> +
> +		/*
> +		 * Fake scanning so that slab shrinking will
> continue. For
> +		 * lowmem restricted allocations, shrink
> aggressively.
> +		 */
> +		nr_scanned = SWAP_CLUSTER_MAX << (DEF_PRIORITY -
> sc->priority);
> +		if (!(sc->gfp_mask & __GFP_HIGHMEM))
> +			nr_scanned = max(nr_scanned, *lru_pages);
> +		sc->nr_scanned += nr_scanned;
> +
> +		return;
> +	}
> +
>  	/* Record the original scan target for proportional
> adjustments later */ memcpy(targets, nr, sizeof(nr));
>  
> @@ -2435,6 +2509,8 @@ static void shrink_node_memcg(struct
> pglist_data *pgdat, struct mem_cgroup *memc if
> (inactive_list_is_low(lruvec, false, sc, true))
> shrink_active_list(SWAP_CLUSTER_MAX, lruvec, sc, LRU_ACTIVE_ANON);
> +
> +	balance_slab_lowmem(pgdat, sc);
>  }
>  
>  /* Use reclaim/compaction for costly allocs or under memory pressure
> */ @@ -2533,7 +2609,8 @@ static bool shrink_node(pg_data_t *pgdat,
> struct scan_control *sc) .pgdat = pgdat,
>  			.priority = sc->priority,
>  		};
> -		unsigned long node_lru_pages = 0;
> +		unsigned long slab_pressure = 0;
> +		unsigned long slab_eligible = 0;
>  		struct mem_cgroup *memcg;
>  
>  		nr_reclaimed = sc->nr_reclaimed;
> @@ -2555,12 +2632,8 @@ static bool shrink_node(pg_data_t *pgdat,
> struct scan_control *sc) scanned = sc->nr_scanned;
>  
>  			shrink_node_memcg(pgdat, memcg, sc,
> &lru_pages);
> -			node_lru_pages += lru_pages;
> -
> -			if (memcg)
> -				shrink_slab(sc->gfp_mask,
> pgdat->node_id,
> -					    memcg, sc->nr_scanned -
> scanned,
> -					    lru_pages);
> +			slab_eligible += lru_pages;
> +			slab_pressure += sc->nr_reclaimed -
> reclaimed; 
>  			/* Record the group's reclaim efficiency */
>  			vmpressure(sc->gfp_mask, memcg, false,
> @@ -2586,12 +2659,12 @@ static bool shrink_node(pg_data_t *pgdat,
> struct scan_control *sc) 
>  		/*
>  		 * Shrink the slab caches in the same proportion that
> -		 * the eligible LRU pages were scanned.
> +		 * the eligible LRU pages were scanned. For memcg,
> this
> +		 * will apply the cumulative scanning pressure over
> all
> +		 * memcgs.
>  		 */
> -		if (global_reclaim(sc))
> -			shrink_slab(sc->gfp_mask, pgdat->node_id,
> NULL,
> -				    sc->nr_scanned - nr_scanned,
> -				    node_lru_pages);
> +		shrink_slab(sc->gfp_mask, pgdat->node_id, NULL,
> slab_pressure,
> +
> slab_eligible); 
>  		if (reclaim_state) {
>  			sc->nr_reclaimed +=
> reclaim_state->reclaimed_slab; @@ -2683,10 +2756,6 @@ static void
> shrink_zones(struct zonelist *zonelist, struct scan_control *sc)
> GFP_KERNEL | __GFP_HARDWALL)) continue;
>  
> -			if (sc->priority != DEF_PRIORITY &&
> -			    !pgdat_reclaimable(zone->zone_pgdat))
> -				continue;	/* Let kswapd poll
> it */ -
>  			/*
>  			 * If we already have plenty of memory free
> for
>  			 * compaction in this zone, don't free any
> more.


[-- Attachment #2: oom4 --]
[-- Type: application/octet-stream, Size: 35300 bytes --]

Jan 22 04:04:28 firewallfsi kernel: [38016.566153] sb_mboxtrain.py invoked oom-killer: gfp_mask=0x1420848(GFP_NOFS|__GFP_NOFAIL|__GFP_HARDWALL|__GFP_MOVABLE), nodemask=0, order=0, oom_score_adj=0
Jan 22 04:04:28 firewallfsi kernel: [38016.568190] sb_mboxtrain.py cpuset=/ mems_allowed=0
Jan 22 04:04:28 firewallfsi kernel: [38016.569185] CPU: 7 PID: 6601 Comm: sb_mboxtrain.py Not tainted 4.10.0-rc4+ #17
Jan 22 04:04:28 firewallfsi kernel: [38016.570161] Hardware name: Intel Corporation S1200BTL/S1200BTL, BIOS S1200BT.86B.02.00.0035.030220120927 03/02/2012
Jan 22 04:04:28 firewallfsi kernel: [38016.571145] Call Trace:
Jan 22 04:04:28 firewallfsi kernel: [38016.572124]  dump_stack+0x58/0x81
Jan 22 04:04:28 firewallfsi kernel: [38016.573086]  dump_header+0x64/0x1a6
Jan 22 04:04:28 firewallfsi kernel: [38016.574178]  ? _raw_spin_unlock_irqrestore+0xd/0x10
Jan 22 04:04:28 firewallfsi kernel: [38016.575233]  ? ___ratelimit+0x9f/0x100
Jan 22 04:04:28 firewallfsi kernel: [38016.576197]  oom_kill_process+0x207/0x3d0
Jan 22 04:04:28 firewallfsi kernel: [38016.577150]  ? has_capability_noaudit+0x1a/0x30
Jan 22 04:04:28 firewallfsi kernel: [38016.578108]  ? oom_badness.part.13+0xcb/0x140
Jan 22 04:04:28 firewallfsi kernel: [38016.579068]  out_of_memory+0xf8/0x2a0
Jan 22 04:04:28 firewallfsi kernel: [38016.580025]  __alloc_pages_nodemask+0xb22/0xc30
Jan 22 04:04:28 firewallfsi kernel: [38016.580990]  pagecache_get_page+0xbe/0x2d0
Jan 22 04:04:28 firewallfsi kernel: [38016.581948]  __getblk_gfp+0x104/0x360
Jan 22 04:04:28 firewallfsi kernel: [38016.582899]  __ext4_get_inode_loc+0x104/0x440
Jan 22 04:04:28 firewallfsi kernel: [38016.583840]  ext4_reserve_inode_write+0x2a/0x80
Jan 22 04:04:28 firewallfsi kernel: [38016.584766]  ? jbd2__journal_start+0xbf/0x1b0
Jan 22 04:04:28 firewallfsi kernel: [38016.585667]  ext4_mark_inode_dirty+0x49/0x200
Jan 22 04:04:28 firewallfsi kernel: [38016.586552]  ? ext4_dirty_inode+0x48/0x60
Jan 22 04:04:28 firewallfsi kernel: [38016.587417]  ext4_dirty_inode+0x48/0x60
Jan 22 04:04:28 firewallfsi kernel: [38016.588270]  __mark_inode_dirty+0x150/0x340
Jan 22 04:04:28 firewallfsi kernel: [38016.589114]  generic_update_time+0x66/0xb0
Jan 22 04:04:28 firewallfsi kernel: [38016.589939]  ? __atime_needs_update+0x6e/0x160
Jan 22 04:04:28 firewallfsi kernel: [38016.590744]  ? find_inode_nowait+0xb0/0xb0
Jan 22 04:04:28 firewallfsi kernel: [38016.591530]  touch_atime+0x8f/0xb0
Jan 22 04:04:28 firewallfsi kernel: [38016.592295]  generic_file_read_iter+0x75a/0x8a0
Jan 22 04:04:28 firewallfsi kernel: [38016.593052]  ? unlock_page+0x60/0x60
Jan 22 04:04:28 firewallfsi kernel: [38016.593798]  ext4_file_read_iter+0x2b/0xa0
Jan 22 04:04:28 firewallfsi kernel: [38016.594528]  __vfs_read+0xe0/0x150
Jan 22 04:04:28 firewallfsi kernel: [38016.595237]  vfs_read+0x7b/0x140
Jan 22 04:04:28 firewallfsi kernel: [38016.595923]  SyS_read+0x49/0xb0
Jan 22 04:04:28 firewallfsi kernel: [38016.596586]  do_fast_syscall_32+0x8a/0x150
Jan 22 04:04:28 firewallfsi kernel: [38016.597239]  entry_SYSENTER_32+0x4e/0x7c
Jan 22 04:04:28 firewallfsi kernel: [38016.597880] EIP: 0xb77cbd25
Jan 22 04:04:28 firewallfsi kernel: [38016.598499] EFLAGS: 00200246 CPU: 7
Jan 22 04:04:28 firewallfsi kernel: [38016.599099] EAX: ffffffda EBX: 00000004 ECX: 80f04384 EDX: 00002000
Jan 22 04:04:28 firewallfsi kernel: [38016.599694] ESI: 80ac1c30 EDI: 00002ff2 EBP: 80f04384 ESP: bf829838
Jan 22 04:04:28 firewallfsi kernel: [38016.600281]  DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
Jan 22 04:04:28 firewallfsi kernel: [38016.600874] Mem-Info:
Jan 22 04:04:28 firewallfsi kernel: [38016.601433] active_anon:195761 inactive_anon:1207 isolated_anon:0
Jan 22 04:04:28 firewallfsi kernel: [38016.601433]  active_file:105882 inactive_file:482932 isolated_file:32
Jan 22 04:04:28 firewallfsi kernel: [38016.601433]  unevictable:0 dirty:4 writeback:8 unstable:0
Jan 22 04:04:28 firewallfsi kernel: [38016.601433]  slab_reclaimable:183989 slab_unreclaimable:11756
Jan 22 04:04:28 firewallfsi kernel: [38016.601433]  mapped:27071 shmem:1396 pagetables:1593 bounce:8
Jan 22 04:04:28 firewallfsi kernel: [38016.601433]  free:222933 free_pcp:538 free_cma:0
Jan 22 04:04:28 firewallfsi kernel: [38016.604519] Node 0 active_anon:783044kB inactive_anon:4828kB active_file:423528kB inactive_file:1931728kB unevictable:0kB isolated(anon):0kB isolated(file):128kB mapped:108284kB dirty:16kB writeback:32kB shmem:5584kB writeback_tmp:0kB unstable:0kB pages_scanned:59206274 all_unreclaimable? yes
Jan 22 04:04:28 firewallfsi kernel: [38016.606602] DMA free:3144kB min:68kB low:84kB high:100kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15900kB mlocked:0kB slab_reclaimable:10812kB slab_unreclaimable:1268kB kernel_stack:0kB pagetables:0kB bounce:4kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:28 firewallfsi kernel: [38016.609095] lowmem_reserve[]: 0 777 4733 4733
Jan 22 04:04:28 firewallfsi kernel: [38016.609894] Normal free:3528kB min:3532kB low:4412kB high:5292kB active_anon:0kB inactive_anon:0kB active_file:2732kB inactive_file:152kB unevictable:0kB writepending:0kB present:892920kB managed:816828kB mlocked:0kB slab_reclaimable:725144kB slab_unreclaimable:45756kB kernel_stack:2736kB pagetables:0kB bounce:28kB free_pcp:1480kB local_pcp:280kB free_cma:0kB
Jan 22 04:04:28 firewallfsi kernel: [38016.612467] lowmem_reserve[]: 0 0 31652 31652
Jan 22 04:04:28 firewallfsi kernel: [38016.613354] HighMem free:885060kB min:512kB low:5008kB high:9504kB active_anon:783044kB inactive_anon:4828kB active_file:420880kB inactive_file:1931404kB unevictable:0kB writepending:48kB present:4051548kB managed:4051548kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:6372kB bounce:0kB free_pcp:672kB local_pcp:124kB free_cma:0kB
Jan 22 04:04:28 firewallfsi kernel: [38016.616233] lowmem_reserve[]: 0 0 0 0
Jan 22 04:04:28 firewallfsi kernel: [38016.617230] DMA: 12*4kB (UE) 13*8kB (E) 63*16kB (UE) 33*32kB (UE) 13*64kB (UE) 1*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3176kB
Jan 22 04:04:28 firewallfsi kernel: [38016.619309] Normal: 412*4kB (MH) 235*8kB (UMH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3528kB
Jan 22 04:04:28 firewallfsi kernel: [38016.621498] HighMem: 1*4kB (U) 54*8kB (UM) 25*16kB (U) 4*32kB (UM) 72*64kB (U) 49*128kB (UM) 37*256kB (UM) 39*512kB (UM) 8*1024kB (UM) 0*2048kB 204*4096kB (M) = 885060kB
Jan 22 04:04:28 firewallfsi kernel: [38016.624026] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 22 04:04:28 firewallfsi kernel: [38016.625361] 590204 total pagecache pages
Jan 22 04:04:28 firewallfsi kernel: [38016.626827] 0 pages in swap cache
Jan 22 04:04:28 firewallfsi kernel: [38016.628047] Swap cache stats: add 0, delete 0, find 0/0
Jan 22 04:04:28 firewallfsi kernel: [38016.629385] Free swap  = 33784572kB
Jan 22 04:04:28 firewallfsi kernel: [38016.630847] Total swap = 33784572kB
Jan 22 04:04:28 firewallfsi kernel: [38016.632337] 1240111 pages RAM
Jan 22 04:04:28 firewallfsi kernel: [38016.633788] 1012887 pages HighMem/MovableOnly
Jan 22 04:04:28 firewallfsi kernel: [38016.635170] 19042 pages reserved
Jan 22 04:04:28 firewallfsi kernel: [38016.636634] 0 pages hwpoisoned
Jan 22 04:04:28 firewallfsi kernel: [38016.638082] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
Jan 22 04:04:28 firewallfsi kernel: [38016.639581] [  593]     0   593     5324     4066      14       3        0             0 systemd-journal
Jan 22 04:04:28 firewallfsi kernel: [38016.641082] [  629]     0   629     3548     1176       9       3        0         -1000 systemd-udevd
Jan 22 04:04:28 firewallfsi kernel: [38016.642490] [  733]     0   733     1472      998       6       3        0             0 smartd
Jan 22 04:04:28 firewallfsi kernel: [38016.643721] [  748]     0   748     8633     1062      11       3        0             0 rsyslogd
Jan 22 04:04:28 firewallfsi kernel: [38016.645057] [  759]     0   759     1704      655       7       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.646322] [  760]   288   760    14457     1693      15       3        0             0 milter-greylist
Jan 22 04:04:28 firewallfsi kernel: [38016.647631] [  785]     0   785      808      487       5       3        0             0 mdadm
Jan 22 04:04:28 firewallfsi kernel: [38016.648860] [  809]     0   809      583      423       5       3        0             0 acpid
Jan 22 04:04:28 firewallfsi kernel: [38016.650077] [  810]    81   810     1700     1038       7       3        0          -900 dbus-daemon
Jan 22 04:04:28 firewallfsi kernel: [38016.651299] [  857]     0   857     3062     1648      10       3        0             0 fetchmail
Jan 22 04:04:28 firewallfsi kernel: [38016.652513] [  894]     0   894     2499      381       8       3        0             0 saslauthd
Jan 22 04:04:28 firewallfsi kernel: [38016.653717] [  895]     0   895     2499      125       8       3        0             0 saslauthd
Jan 22 04:04:28 firewallfsi kernel: [38016.654906] [  896]     0   896     2499      125       8       3        0             0 saslauthd
Jan 22 04:04:28 firewallfsi kernel: [38016.656096] [  897]     0   897     2499      125       8       3        0             0 saslauthd
Jan 22 04:04:28 firewallfsi kernel: [38016.657443] [  898]     0   898     2499      125       8       3        0             0 saslauthd
Jan 22 04:04:28 firewallfsi kernel: [38016.658844] [  979]     0   979     2769      736       9       3        0         -1000 sshd
Jan 22 04:04:28 firewallfsi kernel: [38016.660331] [ 1049]     0  1049      988      733       5       3        0             0 systemd-logind
Jan 22 04:04:28 firewallfsi kernel: [38016.661467] [ 1053]     0  1053     7287     1267      11       3        0             0 apcupsd
Jan 22 04:04:28 firewallfsi kernel: [38016.662809] [ 1093]     0  1093      860      492       4       3        0             0 atd
Jan 22 04:04:28 firewallfsi kernel: [38016.664110] [ 1142]    27  1142     1707      723       6       3        0             0 mysqld_safe
Jan 22 04:04:28 firewallfsi kernel: [38016.665411] [ 1191]     0  1191     1116      482       6       3        0             0 agetty
Jan 22 04:04:28 firewallfsi kernel: [38016.666540] [ 1192]     0  1192     1116      535       6       3        0             0 agetty
Jan 22 04:04:28 firewallfsi kernel: [38016.667773] [ 1193]     0  1193     1116      528       5       3        0             0 agetty
Jan 22 04:04:28 firewallfsi kernel: [38016.668969] [ 1194]     0  1194     1116      509       6       3        0             0 agetty
Jan 22 04:04:28 firewallfsi kernel: [38016.669919] [ 1195]     0  1195     1116      490       6       3        0             0 agetty
Jan 22 04:04:28 firewallfsi kernel: [38016.670785] [ 1196]     0  1196     1116      491       6       3        0             0 agetty
Jan 22 04:04:28 firewallfsi kernel: [38016.671745] [ 1313]    27  1313   126039    14603      64       3        0             0 mysqld
Jan 22 04:04:28 firewallfsi kernel: [38016.672737] [ 1343]     0  1343     7049     2368      17       3        0             0 nmbd
Jan 22 04:04:28 firewallfsi kernel: [38016.673702] [ 1345]     0  1345     6840     2264      17       3        0             0 nmbd
Jan 22 04:04:28 firewallfsi kernel: [38016.674614] [ 1353]    25  1353    81136    46879     113       3        0             0 named
Jan 22 04:04:28 firewallfsi kernel: [38016.675502] [ 1415]   276  1415   115809   104485     223       3        0             0 clamd
Jan 22 04:04:28 firewallfsi kernel: [38016.676354] [ 1417]     0  1417    12052     6485      26       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.677167] [ 1418]   290  1418    10838     1168      11       3        0             0 clamav-milter
Jan 22 04:04:28 firewallfsi kernel: [38016.677928] [ 1542]    23  1542     5440     1187      15       3        0             0 squid
Jan 22 04:04:28 firewallfsi kernel: [38016.678684] [ 1544]    23  1544     9541     6462      20       3        0             0 squid
Jan 22 04:04:28 firewallfsi kernel: [38016.679406] [ 1547]    23  1547     1179      420       6       3        0             0 unlinkd
Jan 22 04:04:28 firewallfsi kernel: [38016.680105] [ 1585]    48  1585    49256     4559      45       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.680813] [ 1586]    48  1586    16220     4558      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.681460] [ 1592]    48  1592    16216     4557      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.682102] [ 1608]    48  1608    16216     4556      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.682730] [ 1611]    48  1611    16218     4294      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.683322] [ 1768]     0  1768     9561     3584      23       3        0             0 smbd
Jan 22 04:04:28 firewallfsi kernel: [38016.683843] [ 1769]     0  1769     9197     1114      22       3        0             0 smbd
Jan 22 04:04:28 firewallfsi kernel: [38016.684345] [ 1770]     0  1770     9446     1219      22       3        0             0 smbd
Jan 22 04:04:28 firewallfsi kernel: [38016.684844] [ 1842]     0  1842     5116     2167      13       3        0             0 dhclient
Jan 22 04:04:28 firewallfsi kernel: [38016.685346] [ 1931]     0  1931      594      434       5       3        0             0 pptpd
Jan 22 04:04:28 firewallfsi kernel: [38016.685929] [ 1938]     0  1938      954      638       4       3        0             0 dovecot
Jan 22 04:04:28 firewallfsi kernel: [38016.686499] [ 1939]    97  1939      904      565       5       3        0             0 anvil
Jan 22 04:04:28 firewallfsi kernel: [38016.687060] [ 1940]     0  1940      937      614       5       3        0             0 log
Jan 22 04:04:28 firewallfsi kernel: [38016.687621] [ 1942]     0  1942     1142      783       5       3        0             0 config
Jan 22 04:04:28 firewallfsi kernel: [38016.688179] [ 1943]    48  1943    16220     4283      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.688734] [ 1949]   177  1949     6833     4729      17       3        0             0 dhcpd
Jan 22 04:04:28 firewallfsi kernel: [38016.689289] [ 1950]     0  1950     1907      769       7       3        0             0 crond
Jan 22 04:04:28 firewallfsi kernel: [38016.689890] [ 1951]    38  1951     1536     1093       6       3        0             0 ntpd
Jan 22 04:04:28 firewallfsi kernel: [38016.690456] [ 1962]     0  1962    11222     4005      26       3        0             0 smbd
Jan 22 04:04:28 firewallfsi kernel: [38016.690991] [ 1971]   302  1971     1447     1089       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.691572] [ 1972]   304  1972     1399      988       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.692078] [ 1977]   303  1977     1394      941       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.692626] [ 1979]   301  1979     1638     1161       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.693151] [ 2763]   273  2763     2208     1442       8       3        0             0 imap-login
Jan 22 04:04:28 firewallfsi kernel: [38016.693714] [ 2767]   301  2767     1659     1130       7       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.694267] [ 5041]     0  5041     4181     1974      11       3        0             0 sshd
Jan 22 04:04:28 firewallfsi kernel: [38016.694832] [ 5043]     0  5043     1584     1144       6       3        0             0 systemd
Jan 22 04:04:28 firewallfsi kernel: [38016.695379] [ 5051]     0  5051     2456      390       8       3        0             0 (sd-pam)
Jan 22 04:04:28 firewallfsi kernel: [38016.695935] [ 5070]     0  5070     4214      935      11       3        0             0 sshd
Jan 22 04:04:28 firewallfsi kernel: [38016.696486] [ 5078]     0  5078     1188      931       5       3        0             0 tcsh
Jan 22 04:04:28 firewallfsi kernel: [38016.697024] [11258]   273 11258     2209     1413       8       3        0             0 imap-login
Jan 22 04:04:28 firewallfsi kernel: [38016.697577] [11261]   301 11261     1401      928       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.698073] [18933]    48 18933    16220     4295      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.698540] [27720]   273 27720     2209     1453       8       3        0             0 imap-login
Jan 22 04:04:28 firewallfsi kernel: [38016.699010] [27724]   302 27724     1423     1047       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.699551] [31627]    48 31627    16216     3530      28       3        0             0 /usr/sbin/httpd
Jan 22 04:04:28 firewallfsi kernel: [38016.700148] [ 9644]     0  9644     1307      922       6       3        0             0 reboot-when-oom
Jan 22 04:04:28 firewallfsi kernel: [38016.700758] [13818]   301 13818     1462     1086       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.701368] [14022]   301 14022     3879     1423       8       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.701982] [15362]     0 15362     1900      565       7       3        0             0 crond
Jan 22 04:04:28 firewallfsi kernel: [38016.702595] [15363]     0 15363     1705      681       6       3        0             0 raid-check
Jan 22 04:04:28 firewallfsi kernel: [38016.703203] [28256]   167 28256    19314     2952      20       3        0             0 polkitd
Jan 22 04:04:28 firewallfsi kernel: [38016.703824] [32762]     0 32762     1704      641       7       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.704430] [32764]     0 32764     1704      640       6       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.705047] [32766]     0 32766     1736      743       6       3        0             0 tickle-pog
Jan 22 04:04:28 firewallfsi kernel: [38016.705579] [32767]     0 32767     3165     2066      10       3        0             0 mailwarnings
Jan 22 04:04:28 firewallfsi kernel: [38016.706072] [  762]     0   762     1908      577       7       3        0             0 crond
Jan 22 04:04:28 firewallfsi kernel: [38016.706656] [  764]     0   764     3209     2085      10       3        0             0 freshclam-tec-w
Jan 22 04:04:28 firewallfsi kernel: [38016.707239] [  986]     0   986     1673      595       7       3        0             0 anacron
Jan 22 04:04:28 firewallfsi kernel: [38016.707853] [ 1565]     0  1565     1704      658       7       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.708473] [ 1566]     0  1566     1704      641       6       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.709095] [ 1567]     0  1567     1704      640       6       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.709707] [ 1568]     0  1568     1704      688       6       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.710306] [ 1569]     0  1569     2707     1633       9       3        0             0 udp-sgr
Jan 22 04:04:28 firewallfsi kernel: [38016.710920] [ 1570]     0  1570     3309     2229      11       3        0             0 watch-ip
Jan 22 04:04:28 firewallfsi kernel: [38016.711531] [ 1571]     0  1571     2741     1666       9       3        0             0 udp-sgs
Jan 22 04:04:28 firewallfsi kernel: [38016.712121] [ 1572]     0  1572     3238     2121      10       3        0             0 dynamic-ip-upda
Jan 22 04:04:28 firewallfsi kernel: [38016.712726] [ 1638]     0  1638     3829     1711      11       3        0             0 sendmail
Jan 22 04:04:28 firewallfsi kernel: [38016.713239] [ 1661]    51  1661     3501      736      12       3        0             0 sendmail
Jan 22 04:04:28 firewallfsi kernel: [38016.713747] [ 2317]     0  2317     1033      652       6       3        0             0 irqbalance
Jan 22 04:04:28 firewallfsi kernel: [38016.714254] [ 2897]     0  2897     1704      633       7       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.714765] [ 2898]     0  2898     3264     2209      10       3        0             0 restarter
Jan 22 04:04:28 firewallfsi kernel: [38016.715342] [ 2914]     0  2914     1704      660       7       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.715900] [ 2915]     0  2915     1769      783       8       3        0             0 watch-services
Jan 22 04:04:28 firewallfsi kernel: [38016.716409] [ 4260]     0  4260     1704      741       6       3        0             0 run-parts
Jan 22 04:04:28 firewallfsi kernel: [38016.717003] [ 5595]     0  5595     1704      642       6       3        0             0 train-spam
Jan 22 04:04:28 firewallfsi kernel: [38016.717516] [ 5596]     0  5596     1638      265       6       3        0             0 awk
Jan 22 04:04:28 firewallfsi kernel: [38016.718022] [ 5601]     0  5601     3199     2118       9       3        0             0 train-spam
Jan 22 04:04:28 firewallfsi kernel: [38016.718539] [ 6573]     0  6573     3375     1484      10       3        0             0 sudo
Jan 22 04:04:28 firewallfsi kernel: [38016.719134] [ 6577]   301  6577     1603     1184       7       3        0             0 systemd
Jan 22 04:04:28 firewallfsi kernel: [38016.719711] [ 6585]   301  6585     4817      703      10       3        0             0 (sd-pam)
Jan 22 04:04:28 firewallfsi kernel: [38016.720256] [ 6601]   301  6601    11251     9610      25       3        0             0 sb_mboxtrain.py
Jan 22 04:04:28 firewallfsi kernel: [38016.720864] [12163]   273 12163     2209     1416       8       3        0             0 imap-login
Jan 22 04:04:28 firewallfsi kernel: [38016.721396] [12167]   301 12167     1433     1065       6       3        0             0 imap
Jan 22 04:04:28 firewallfsi kernel: [38016.721930] [12599]     0 12599     1396      169       6       3        0             0 sleep
Jan 22 04:04:28 firewallfsi kernel: [38016.722466] [12687]     0 12687     1704      699       6       3        0             0 sh
Jan 22 04:04:28 firewallfsi kernel: [38016.722995] [12688]     0 12688     1769      763       6       3        0             0 iptables-regen
Jan 22 04:04:28 firewallfsi kernel: [38016.723533] [12974]     0 12974     1396      140       6       3        0             0 sleep
Jan 22 04:04:28 firewallfsi kernel: [38016.724061] [13085]     0 13085     3838     1975      11       3        0             0 sendmail
Jan 22 04:04:28 firewallfsi kernel: [38016.724674] [13112]     0 13112     1396      142       6       3        0             0 sleep
Jan 22 04:04:28 firewallfsi kernel: [38016.725235] Out of memory: Kill process 1415 (clamd) score 10 or sacrifice child
Jan 22 04:04:28 firewallfsi kernel: [38016.725776] Killed process 1415 (clamd) total-vm:463236kB, anon-rss:401612kB, file-rss:16328kB, shmem-rss:0kB
Jan 22 04:04:28 firewallfsi kernel: [38017.327183] iptables-regen: page allocation stalls for 10990ms, order:1, mode:0x17000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK)
Jan 22 04:04:28 firewallfsi kernel: [38017.327616] CPU: 1 PID: 12688 Comm: iptables-regen Not tainted 4.10.0-rc4+ #17
Jan 22 04:04:28 firewallfsi kernel: [38017.328032] Hardware name: Intel Corporation S1200BTL/S1200BTL, BIOS S1200BT.86B.02.00.0035.030220120927 03/02/2012
Jan 22 04:04:28 firewallfsi kernel: [38017.328475] Call Trace:
Jan 22 04:04:28 firewallfsi kernel: [38017.328907]  dump_stack+0x58/0x81
Jan 22 04:04:28 firewallfsi kernel: [38017.329337]  warn_alloc+0xf6/0x110
Jan 22 04:04:28 firewallfsi kernel: [38017.329765]  __alloc_pages_nodemask+0x9fe/0xc30
Jan 22 04:04:28 firewallfsi kernel: [38017.330196]  ? kmem_cache_alloc+0xf7/0x1c0
Jan 22 04:04:28 firewallfsi kernel: [38017.330627]  ? __kunmap_atomic+0xa3/0x120
Jan 22 04:04:28 firewallfsi kernel: [38017.331069]  ? copy_process.part.44+0x531/0x1590
Jan 22 04:04:28 firewallfsi kernel: [38017.331506]  copy_process.part.44+0x108/0x1590
Jan 22 04:04:28 firewallfsi kernel: [38017.331950]  ? ext4_llseek+0xad/0x520
Jan 22 04:04:28 firewallfsi kernel: [38017.332384]  _do_fork+0xd4/0x370
Jan 22 04:04:28 firewallfsi kernel: [38017.332833]  ? __audit_syscall_exit+0x1e6/0x270
Jan 22 04:04:28 firewallfsi kernel: [38017.333269]  ? _copy_to_user+0x26/0x30
Jan 22 04:04:28 firewallfsi kernel: [38017.333710]  SyS_clone+0x2c/0x30
Jan 22 04:04:28 firewallfsi kernel: [38017.334148]  do_fast_syscall_32+0x8a/0x150
Jan 22 04:04:28 firewallfsi kernel: [38017.334595]  entry_SYSENTER_32+0x4e/0x7c
Jan 22 04:04:28 firewallfsi kernel: [38017.335053] EIP: 0xb77a4d25
Jan 22 04:04:28 firewallfsi kernel: [38017.335505] EFLAGS: 00000246 CPU: 1
Jan 22 04:04:28 firewallfsi kernel: [38017.335953] EAX: ffffffda EBX: 01200011 ECX: 00000000 EDX: 00000000
Jan 22 04:04:28 firewallfsi kernel: [38017.336420] ESI: 00000000 EDI: b759e768 EBP: bfd70dd8 ESP: bfd70d90
Jan 22 04:04:28 firewallfsi kernel: [38017.336900]  DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
Jan 22 04:04:28 firewallfsi kernel: [38017.337376] Mem-Info:
Jan 22 04:04:28 firewallfsi kernel: [38017.337848] active_anon:185471 inactive_anon:1207 isolated_anon:0
Jan 22 04:04:28 firewallfsi kernel: [38017.337848]  active_file:105818 inactive_file:482899 isolated_file:0
Jan 22 04:04:28 firewallfsi kernel: [38017.337848]  unevictable:0 dirty:4 writeback:8 unstable:0
Jan 22 04:04:28 firewallfsi kernel: [38017.337848]  slab_reclaimable:183989 slab_unreclaimable:11748
Jan 22 04:04:28 firewallfsi kernel: [38017.337848]  mapped:27071 shmem:1396 pagetables:1593 bounce:8
Jan 22 04:04:28 firewallfsi kernel: [38017.337848]  free:232808 free_pcp:836 free_cma:0
Jan 22 04:04:28 firewallfsi kernel: [38017.340805] Node 0 active_anon:741100kB inactive_anon:4828kB active_file:423272kB inactive_file:1931596kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:108284kB dirty:16kB writeback:32kB shmem:5584kB writeback_tmp:0kB unstable:0kB pages_scanned:92715 all_unreclaimable? no
Jan 22 04:04:28 firewallfsi kernel: [38017.342451] DMA free:3176kB min:68kB low:84kB high:100kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15900kB mlocked:0kB slab_reclaimable:10812kB slab_unreclaimable:1236kB kernel_stack:0kB pagetables:0kB bounce:4kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:28 firewallfsi kernel: [38017.344284] lowmem_reserve[]: 0 777 4733 4733
Jan 22 04:04:28 firewallfsi kernel: [38017.344925] Normal free:3404kB min:3532kB low:4412kB high:5292kB active_anon:0kB inactive_anon:0kB active_file:2384kB inactive_file:228kB unevictable:0kB writepending:0kB present:892920kB managed:816828kB mlocked:0kB slab_reclaimable:725144kB slab_unreclaimable:45756kB kernel_stack:2736kB pagetables:0kB bounce:28kB free_pcp:1612kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:28 firewallfsi kernel: [38017.346966] lowmem_reserve[]: 0 0 31652 31652
Jan 22 04:04:28 firewallfsi kernel: [38017.347667] HighMem free:924652kB min:512kB low:5008kB high:9504kB active_anon:738748kB inactive_anon:4828kB active_file:420880kB inactive_file:1931404kB unevictable:0kB writepending:48kB present:4051548kB managed:4051548kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:6372kB bounce:0kB free_pcp:1732kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:28 firewallfsi kernel: [38017.349941] lowmem_reserve[]: 0 0 0 0
Jan 22 04:04:28 firewallfsi kernel: [38017.350712] DMA: 12*4kB (UE) 13*8kB (E) 63*16kB (UE) 33*32kB (UE) 13*64kB (UE) 1*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3176kB
Jan 22 04:04:28 firewallfsi kernel: [38017.352292] Normal: 405*4kB (MH) 224*8kB (UMH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3412kB
Jan 22 04:04:28 firewallfsi kernel: [38017.353888] HighMem: 589*4kB (UM) 334*8kB (UM) 132*16kB (UM) 41*32kB (UM) 101*64kB (UM) 65*128kB (UM) 47*256kB (UM) 47*512kB (UM) 13*1024kB (UM) 10*2048kB (M) 204*4096kB (M) = 928708kB
Jan 22 04:04:28 firewallfsi kernel: [38017.355508] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 22 04:04:29 firewallfsi kernel: [38017.356333] 590204 total pagecache pages
Jan 22 04:04:29 firewallfsi kernel: [38017.357170] 0 pages in swap cache
Jan 22 04:04:29 firewallfsi kernel: [38017.357997] Swap cache stats: add 0, delete 0, find 0/0
Jan 22 04:04:29 firewallfsi kernel: [38017.358828] Free swap  = 33784572kB
Jan 22 04:04:29 firewallfsi kernel: [38017.359653] Total swap = 33784572kB
Jan 22 04:04:29 firewallfsi kernel: [38017.360490] 1240111 pages RAM
Jan 22 04:04:29 firewallfsi kernel: [38017.361306] 1012887 pages HighMem/MovableOnly
Jan 22 04:04:29 firewallfsi kernel: [38017.362131] 19042 pages reserved
Jan 22 04:04:29 firewallfsi kernel: [38017.362955] 0 pages hwpoisoned
Jan 22 04:04:30 firewallfsi kernel: [38018.444679] systemd: page allocation stalls for 11297ms, order:1, mode:0x17000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK)
Jan 22 04:04:30 firewallfsi kernel: [38018.446183] CPU: 0 PID: 1 Comm: systemd Not tainted 4.10.0-rc4+ #17
Jan 22 04:04:30 firewallfsi kernel: [38018.447717] Hardware name: Intel Corporation S1200BTL/S1200BTL, BIOS S1200BT.86B.02.00.0035.030220120927 03/02/2012
Jan 22 04:04:30 firewallfsi kernel: [38018.449292] Call Trace:
Jan 22 04:04:30 firewallfsi kernel: [38018.450837]  dump_stack+0x58/0x81
Jan 22 04:04:30 firewallfsi kernel: [38018.452102]  warn_alloc+0xf6/0x110
Jan 22 04:04:30 firewallfsi kernel: [38018.453412]  __alloc_pages_nodemask+0x9fe/0xc30
Jan 22 04:04:30 firewallfsi kernel: [38018.454677]  ? fd_install+0x10/0x30
Jan 22 04:04:30 firewallfsi kernel: [38018.456159]  ? kmem_cache_alloc+0xf7/0x1c0
Jan 22 04:04:30 firewallfsi kernel: [38018.457725]  ? autofs_dev_ioctl+0x134/0x360
Jan 22 04:04:30 firewallfsi kernel: [38018.459271]  ? copy_process.part.44+0x531/0x1590
Jan 22 04:04:30 firewallfsi kernel: [38018.460795]  copy_process.part.44+0x108/0x1590
Jan 22 04:04:30 firewallfsi kernel: [38018.462066]  ? autofs_dev_ioctl_openmount+0xf0/0xf0
Jan 22 04:04:30 firewallfsi kernel: [38018.463330]  ? do_vfs_ioctl+0x8c/0x690
Jan 22 04:04:30 firewallfsi kernel: [38018.464565]  _do_fork+0xd4/0x370
Jan 22 04:04:30 firewallfsi kernel: [38018.465788]  SyS_clone+0x2c/0x30
Jan 22 04:04:30 firewallfsi kernel: [38018.467118]  do_int80_syscall_32+0x5c/0xc0
Jan 22 04:04:30 firewallfsi kernel: [38018.468586]  entry_INT80_32+0x31/0x31
Jan 22 04:04:30 firewallfsi kernel: [38018.470031] EIP: 0xb756ff18
Jan 22 04:04:30 firewallfsi kernel: [38018.471428] EFLAGS: 00000296 CPU: 0
Jan 22 04:04:30 firewallfsi kernel: [38018.472744] EAX: ffffffda EBX: 003d0f00 ECX: b735c2e4 EDX: b735cba8
Jan 22 04:04:30 firewallfsi kernel: [38018.473853] ESI: bfad32b0 EDI: b735cba8 EBP: bfad3398 ESP: bfad3280
Jan 22 04:04:30 firewallfsi kernel: [38018.474921]  DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b
Jan 22 04:04:30 firewallfsi kernel: [38018.475996] Mem-Info:
Jan 22 04:04:30 firewallfsi kernel: [38018.477082] active_anon:175742 inactive_anon:1207 isolated_anon:0
Jan 22 04:04:30 firewallfsi kernel: [38018.477082]  active_file:105848 inactive_file:482918 isolated_file:96
Jan 22 04:04:30 firewallfsi kernel: [38018.477082]  unevictable:0 dirty:39 writeback:1 unstable:0
Jan 22 04:04:30 firewallfsi kernel: [38018.477082]  slab_reclaimable:183989 slab_unreclaimable:11755
Jan 22 04:04:30 firewallfsi kernel: [38018.477082]  mapped:27032 shmem:1396 pagetables:1593 bounce:0
Jan 22 04:04:30 firewallfsi kernel: [38018.477082]  free:242713 free_pcp:30 free_cma:0
Jan 22 04:04:30 firewallfsi kernel: [38018.483943] Node 0 active_anon:702968kB inactive_anon:4828kB active_file:423392kB inactive_file:1931672kB unevictable:0kB isolated(anon):0kB isolated(file):384kB mapped:108128kB dirty:156kB writeback:4kB shmem:5584kB writeback_tmp:0kB unstable:0kB pages_scanned:2255055 all_unreclaimable? no
Jan 22 04:04:30 firewallfsi kernel: [38018.486726] DMA free:3144kB min:68kB low:84kB high:100kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15900kB mlocked:0kB slab_reclaimable:10812kB slab_unreclaimable:1268kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:30 firewallfsi kernel: [38018.489865] lowmem_reserve[]: 0 777 4733 4733
Jan 22 04:04:30 firewallfsi kernel: [38018.490992] Normal free:4868kB min:3532kB low:4412kB high:5292kB active_anon:0kB inactive_anon:0kB active_file:2652kB inactive_file:212kB unevictable:0kB writepending:0kB present:892920kB managed:816828kB mlocked:0kB slab_reclaimable:725144kB slab_unreclaimable:45752kB kernel_stack:2728kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:30 firewallfsi kernel: [38018.494375] lowmem_reserve[]: 0 0 31652 31652
Jan 22 04:04:30 firewallfsi kernel: [38018.495509] HighMem free:962840kB min:512kB low:5008kB high:9504kB active_anon:702968kB inactive_anon:4828kB active_file:420880kB inactive_file:1931404kB unevictable:0kB writepending:160kB present:4051548kB managed:4051548kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:6372kB bounce:0kB free_pcp:116kB local_pcp:0kB free_cma:0kB
Jan 22 04:04:30 firewallfsi kernel: [38018.498746] lowmem_reserve[]: 0 0 0 0
Jan 22 04:04:30 firewallfsi kernel: [38018.500062] DMA: 12*4kB (UE) 13*8kB (E) 63*16kB (UE) 32*32kB (UE) 13*64kB (UE) 1*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3144kB
Jan 22 04:04:30 firewallfsi kernel: [38018.502846] Normal: 660*4kB (UMEH) 299*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5032kB
Jan 22 04:04:30 firewallfsi kernel: [38018.505364] HighMem: 1246*4kB (UM) 841*8kB (UM) 504*16kB (UM) 266*32kB (UM) 191*64kB (UM) 90*128kB (UM) 55*256kB (UM) 50*512kB (UM) 11*1024kB (UM) 12*2048kB (M) 204*4096kB (M) = 963136kB
Jan 22 04:04:30 firewallfsi kernel: [38018.507741] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jan 22 04:04:30 firewallfsi kernel: [38018.509066] 590175 total pagecache pages
Jan 22 04:04:30 firewallfsi kernel: [38018.510535] 0 pages in swap cache
Jan 22 04:04:30 firewallfsi kernel: [38018.512006] Swap cache stats: add 0, delete 0, find 0/0
Jan 22 04:04:30 firewallfsi kernel: [38018.513480] Free swap  = 33784572kB
Jan 22 04:04:30 firewallfsi kernel: [38018.514871] Total swap = 33784572kB
Jan 22 04:04:30 firewallfsi kernel: [38018.516058] 1240111 pages RAM
Jan 22 04:04:30 firewallfsi kernel: [38018.517242] 1012887 pages HighMem/MovableOnly
Jan 22 04:04:30 firewallfsi kernel: [38018.518427] 19042 pages reserved
Jan 22 04:04:30 firewallfsi kernel: [38018.519833] 0 pages hwpoisoned

  reply	other threads:[~2017-01-23  0:46 UTC|newest]

Thread overview: 40+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-01-11 10:32 Trevor Cordes
2017-01-11 12:11 ` Mel Gorman
2017-01-11 12:14   ` Mel Gorman
2017-01-11 22:52     ` Trevor Cordes
2017-01-12  9:36       ` Michal Hocko
2017-01-15  6:27         ` Trevor Cordes
2017-01-16 11:09           ` Mel Gorman
2017-01-17 13:52             ` Michal Hocko
2017-01-17 14:21               ` Mel Gorman
2017-01-17 14:54                 ` Michal Hocko
2017-01-18  7:25                   ` Trevor Cordes
2017-01-18 17:48                   ` Mel Gorman
2017-01-18 18:07                   ` Mel Gorman
2017-01-19  9:48                   ` Trevor Cordes
2017-01-19 11:37                     ` Michal Hocko
2017-01-20  6:35                       ` Trevor Cordes
2017-01-20 11:02                         ` Mel Gorman
2017-01-20 15:55                           ` Mel Gorman
2017-01-23  0:45                             ` Trevor Cordes [this message]
2017-01-23 10:48                               ` Mel Gorman
2017-01-23 11:04                                 ` Mel Gorman
2017-01-25  9:46                                   ` Michal Hocko
2017-01-24 12:59                                 ` Michal Hocko
2017-01-25 10:02                                 ` Trevor Cordes
2017-01-25 12:04                                   ` Michal Hocko
2017-01-29 22:50                                     ` Trevor Cordes
2017-01-30  7:51                                       ` Michal Hocko
2017-02-01  9:29                                         ` Trevor Cordes
2017-02-01 10:14                                           ` Michal Hocko
2017-02-04  0:36                                             ` Trevor Cordes
2017-02-04 20:05                                               ` Rik van Riel
2017-02-05 10:03                                               ` Michal Hocko
2017-02-05 22:53                                                 ` Trevor Cordes
2017-01-30  9:10                                       ` Mel Gorman
2017-01-24 12:54                               ` Michal Hocko
2017-01-26 23:18                                 ` Trevor Cordes
2017-01-27  7:36                                   ` Michal Hocko
2017-01-24 12:51                         ` Michal Hocko
2017-01-18  6:52             ` Trevor Cordes
2017-01-17 13:45           ` Michal Hocko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20170122184559.0b5c0fd8@pog.tecnopolis.ca \
    --to=trevor@tecnopolis.ca \
    --cc=iamjoonsoo.kim@lge.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mgorman@techsingularity.net \
    --cc=mhocko@kernel.org \
    --cc=minchan@kernel.org \
    --cc=riel@surriel.com \
    --cc=srikar@linux.vnet.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

Powered by JetHome