View All Products
Compute
Storage
Networking
Databases
Services
Developer Tools
Industries
Pricing
Community
Engage With Us
Community ▶ Questions ▶ Kernel log entires
Log in to Ask a Question

Kernel log entires

performance

I'm seeing this in my daily Logwatch emails, in the Kernal section…

6 Time(s): 0 pages HighMem
1 Time(s): 1081 pages in swap cache
6 Time(s): 133104 pages RAM
1 Time(s): 1400 pages in swap cache
1 Time(s): 1510 pages in swap cache
1 Time(s): 1617 pages in swap cache
1 Time(s): 2180 pages in swap cache
1 Time(s): 38661 pages shared
1 Time(s): 5322 pages in swap cache
1 Time(s): 57045 pages shared
6 Time(s): 5833 pages reserved
1 Time(s): 58831 pages shared
1 Time(s): 71279 pages shared
1 Time(s): 72521 pages shared
1 Time(s): 73713 pages shared
1 Time(s): 77249 pages non-shared
1 Time(s): 80396 total pagecache pages
1 Time(s): 89509 pages non-shared
1 Time(s): 90983 pages non-shared
1 Time(s): 91016 total pagecache pages
1 Time(s): 92318 total pagecache pages
1 Time(s): 92715 total pagecache pages
1 Time(s): 93394 total pagecache pages
1 Time(s): 95494 pages non-shared
1 Time(s): 96340 total pagecache pages
1 Time(s): 96930 pages non-shared
1 Time(s): 97392 pages non-shared
6 Time(s): CPU    0: hi:    0, btch:   1 usd:   0
1 Time(s): CPU    0: hi:  186, btch:  31 usd:  40
1 Time(s): CPU    0: hi:  186, btch:  31 usd:  56
1 Time(s): CPU    0: hi:  186, btch:  31 usd: 102
1 Time(s): CPU    0: hi:  186, btch:  31 usd: 142
1 Time(s): CPU    0: hi:  186, btch:  31 usd: 144
1 Time(s): CPU    0: hi:  186, btch:  31 usd: 170
6 Time(s): CPU    1: hi:    0, btch:   1 usd:   0
1 Time(s): CPU    1: hi:  186, btch:  31 usd:  36
1 Time(s): CPU    1: hi:  186, btch:  31 usd:  43
1 Time(s): CPU    1: hi:  186, btch:  31 usd:  52
1 Time(s): CPU    1: hi:  186, btch:  31 usd:  74
1 Time(s): CPU    1: hi:  186, btch:  31 usd: 140
1 Time(s): CPU    1: hi:  186, btch:  31 usd: 159
6 Time(s): CPU    2: hi:    0, btch:   1 usd:   0
1 Time(s): CPU    2: hi:  186, btch:  31 usd:  33
1 Time(s): CPU    2: hi:  186, btch:  31 usd:  64
1 Time(s): CPU    2: hi:  186, btch:  31 usd: 177
1 Time(s): CPU    2: hi:  186, btch:  31 usd: 178
1 Time(s): CPU    2: hi:  186, btch:  31 usd: 180
1 Time(s): CPU    2: hi:  186, btch:  31 usd: 183
6 Time(s): CPU    3: hi:    0, btch:   1 usd:   0
1 Time(s): CPU    3: hi:  186, btch:  31 usd:  18
1 Time(s): CPU    3: hi:  186, btch:  31 usd:  23
1 Time(s): CPU    3: hi:  186, btch:  31 usd:  46
1 Time(s): CPU    3: hi:  186, btch:  31 usd:  70
1 Time(s): CPU    3: hi:  186, btch:  31 usd: 128
1 Time(s): CPU    3: hi:  186, btch:  31 usd: 129
6 Time(s): Call Trace:
1 Time(s): DMA free:2248kB min:84kB low:104kB high:124kB active_anon:1544kB inactive_anon:1532kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:40kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:408kB kernel_stack:176kB pagetables:8kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
1 Time(s): DMA free:2808kB min:84kB low:104kB high:124kB active_anon:996kB inactive_anon:1144kB active_file:280kB inactive_file:440kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:20kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:392kB kernel_stack:168kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
1 Time(s): DMA free:2816kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:1892kB inactive_file:1100kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:4kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:340kB kernel_stack:48kB pagetables:80kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
1 Time(s): DMA free:3192kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:1760kB inactive_file:1104kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:228kB kernel_stack:8kB pagetables:4kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1 Time(s): DMA free:4020kB min:84kB low:104kB high:124kB active_anon:984kB inactive_anon:416kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):132kB isolated(file):0kB present:15808kB mlocked:0kB dirty:12kB writeback:24kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:356kB kernel_stack:88kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:34 all_unreclaimable? no
1 Time(s): DMA free:4476kB min:84kB low:104kB high:124kB active_anon:828kB inactive_anon:504kB active_file:0kB inactive_file:8kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:0kB mapped:308kB shmem:308kB slab_reclaimable:1036kB slab_unreclaimable:316kB kernel_stack:24kB pagetables:4kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
6 Time(s): DMA per-cpu:
1 Time(s): DMA: 159*4kB 224*8kB 99*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4012kB
1 Time(s): DMA: 168*4kB 149*8kB 23*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2232kB
1 Time(s): DMA: 327*4kB 247*8kB 75*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4484kB
1 Time(s): DMA: 518*4kB 86*8kB 19*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3192kB
1 Time(s): DMA: 526*4kB 63*8kB 11*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2816kB
1 Time(s): DMA: 596*4kB 43*8kB 5*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2808kB
1 Time(s): Free swap  = 217876kB
1 Time(s): Free swap  = 230492kB
1 Time(s): Free swap  = 235008kB
1 Time(s): Free swap  = 238024kB
1 Time(s): Free swap  = 245528kB
1 Time(s): Free swap  = 248160kB
6 Time(s): Mem-Info:
1 Time(s): Normal free:105788kB min:2816kB low:3520kB high:4224kB active_anon:31764kB inactive_anon:31792kB active_file:116672kB inactive_file:179824kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:80kB writeback:0kB mapped:14340kB shmem:3448kB slab_reclaimable:10488kB slab_unreclaimable:10924kB kernel_stack:840kB pagetables:1416kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:33 all_unreclaimable? no
1 Time(s): Normal free:22544kB min:2816kB low:3520kB high:4224kB active_anon:41032kB inactive_anon:34436kB active_file:239284kB inactive_file:127696kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:512064kB mlocked:0kB dirty:444kB writeback:0kB mapped:16128kB shmem:6688kB slab_reclaimable:10260kB slab_unreclaimable:11284kB kernel_stack:824kB pagetables:1792kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
1 Time(s): Normal free:3456kB min:2816kB low:3520kB high:4224kB active_anon:88532kB inactive_anon:28248kB active_file:272520kB inactive_file:72004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:396kB writeback:0kB mapped:15088kB shmem:15152kB slab_reclaimable:10076kB slab_unreclaimable:11180kB kernel_stack:840kB pagetables:2272kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:77 all_unreclaimable? no
1 Time(s): Normal free:34872kB min:2816kB low:3520kB high:4224kB active_anon:63648kB inactive_anon:11664kB active_file:216696kB inactive_file:138524kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:512064kB mlocked:0kB dirty:304kB writeback:0kB mapped:15276kB shmem:9452kB slab_reclaimable:10180kB slab_unreclaimable:11096kB kernel_stack:896kB pagetables:1956kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
1 Time(s): Normal free:3608kB min:2816kB low:3520kB high:4224kB active_anon:61464kB inactive_anon:48408kB active_file:251432kB inactive_file:99620kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:380kB writeback:0kB mapped:16112kB shmem:12560kB slab_reclaimable:10104kB slab_unreclaimable:11224kB kernel_stack:744kB pagetables:2244kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:89 all_unreclaimable? no
1 Time(s): Normal free:7892kB min:2816kB low:3520kB high:4224kB active_anon:52016kB inactive_anon:51868kB active_file:210276kB inactive_file:142076kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:512064kB mlocked:0kB dirty:380kB writeback:0kB mapped:16124kB shmem:11284kB slab_reclaimable:10152kB slab_unreclaimable:11192kB kernel_stack:776kB pagetables:2344kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
6 Time(s): Normal per-cpu:
1 Time(s): Normal: 16991*4kB 4728*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 105788kB
1 Time(s): Normal: 1845*4kB 64*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 7892kB
1 Time(s): Normal: 4368*4kB 634*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22544kB
1 Time(s): Normal: 6846*4kB 939*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 34896kB
1 Time(s): Normal: 690*4kB 106*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3608kB
1 Time(s): Normal: 820*4kB 20*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3456kB
1 Time(s): Pid: 12286, comm: apache2 Not tainted 3.0.4-linode38 #1
1 Time(s): Pid: 19519, comm: apache2 Not tainted 3.0.4-linode38 #1
1 Time(s): Pid: 20303, comm: apache2 Not tainted 3.0.4-linode38 #1
1 Time(s): Pid: 23868, comm: apache2 Not tainted 3.0.4-linode38 #1
1 Time(s): Pid: 3718, comm: apache2 Not tainted 3.0.4-linode38 #1
1 Time(s): Pid: 5731, comm: apache2 Not tainted 3.0.4-linode38 #1
1 Time(s): Swap cache stats: add 865854, delete 860532, find 24034534/24119272
1 Time(s): Swap cache stats: add 877526, delete 875346, find 24107494/24193578
1 Time(s): Swap cache stats: add 880208, delete 878698, find 24150742/24237073
1 Time(s): Swap cache stats: add 882918, delete 881301, find 24430105/24516996
1 Time(s): Swap cache stats: add 889704, delete 888304, find 25438294/25526844
1 Time(s): Swap cache stats: add 891644, delete 890564, find 26214855/26303788
6 Time(s): Total swap = 262140kB
1 Time(s): [<c010368f>] ? xen_mc_flush+0x7f/0x190
2 Time(s): [<c0103e95>] ? pte_pfn_to_mfn+0xb5/0xd0
2 Time(s): [<c0104c7a>] ? xen_batched_set_pte+0x1a/0xf0
4 Time(s): [<c0105c27>] ? xen_force_evtchn_callback+0x17/0x30
2 Time(s): [<c010625a>] ? do_stolen_accounting+0x21a/0x250
1 Time(s): [<c01063fb>] ? xen_restore_fl_direct_reloc+0x4/0x4
3 Time(s): [<c0106404>] ? check_events+0x8/0xc
3 Time(s): [<c014000a>] ? mod_timer_pending+0xba/0x110
2 Time(s): [<c0175781>] ? handle_percpu_irq+0x31/0x50
1 Time(s): [<c018ae23>] ? free_hot_cold_page+0xd3/0x140
6 Time(s): [<c018b258>] ? warn_alloc_failed+0x98/0x100
5 Time(s): [<c018b7a4>] ? __alloc_pages_nodemask+0xf4/0x630
6 Time(s): [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
1 Time(s): [<c01a2a17>] ? remove_vma+0x37/0x50
1 Time(s): [<c01a39a2>] ? do_munmap+0x202/0x280
1 Time(s): [<c01b1991>] ? kmem_cache_free+0x41/0x60
6 Time(s): [<c01b22b3>] ? T.833+0xb3/0x2e0
6 Time(s): [<c01b2726>] ? cache_alloc_refill+0x246/0x290
6 Time(s): [<c01b282d>] ? __kmalloc+0xbd/0xd0
6 Time(s): [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
6 Time(s): [<c01b52b6>] ? rw_verify_area+0x66/0x120
6 Time(s): [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
6 Time(s): [<c01b58ee>] ? vfs_writev+0x3e/0x60
6 Time(s): [<c01b5a11>] ? sys_writev+0x41/0xa0
1 Time(s): [<c01cd481>] ? vfsmount_lock_local_unlock+0x11/0x20
3 Time(s): [<c01cf606>] ? mntput_no_expire+0x46/0x170
1 Time(s): [<c045709f>] ? cpumask_any_but+0x1f/0x30
12 Time(s): [<c0532250>] ? sock_aio_dtor+0x10/0x10
6 Time(s): [<c0532366>] ? sock_aio_write+0x116/0x170
6 Time(s): [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
6 Time(s): [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
6 Time(s): [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
6 Time(s): [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
6 Time(s): [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
6 Time(s): [<c05c7568>] ? ip_local_out+0x18/0x20
12 Time(s): [<c05c8020>] ? ip_finish_output2+0x260/0x260
6 Time(s): [<c05c815b>] ? ip_finish_output+0x13b/0x300
6 Time(s): [<c05c83ca>] ? ip_output+0xaa/0xe0
3 Time(s): [<c05d0aae>] ? tcp_sendmsg+0x81e/0xb30
3 Time(s): [<c05d0cce>] ? tcp_sendmsg+0xa3e/0xb30
6 Time(s): [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
6 Time(s): [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
3 Time(s): [<c05ddc9d>] ? tcp_push_one+0x2d/0x40
3 Time(s): [<c05ddcd4>] ? __tcp_push_pending_frames+0x24/0x90
6 Time(s): [<c05eed37>] ? inet_sendmsg+0x47/0xb0
6 Time(s): [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
6 Time(s): [<c060f0ff>] ? ipt_do_table+0x24f/0x580
6 Time(s): [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
5 Time(s): [<c06b0000>] ? sctp_err_lookup+0x90/0x110
3 Time(s): [<c06bf835>] ? _raw_spin_lock+0x5/0x10
6 Time(s): [<c06bfb91>] ? syscall_call+0x7/0xb
1 Time(s): active_anon:10258 inactive_anon:8609 isolated_anon:32
1 Time(s): active_anon:13253 inactive_anon:13253 isolated_anon:32
1 Time(s): active_anon:15752 inactive_anon:12485 isolated_anon:32
1 Time(s): active_anon:15912 inactive_anon:2916 isolated_anon:32
1 Time(s): active_anon:22379 inactive_anon:7166 isolated_anon:33
1 Time(s): active_anon:8148 inactive_anon:8074 isolated_anon:32
1 Time(s): active_file:29168 inactive_file:44958 isolated_file:0
1 Time(s): active_file:52639 inactive_file:35629 isolated_file:0
1 Time(s): active_file:54614 inactive_file:34907 isolated_file:0
1 Time(s): active_file:60294 inactive_file:32199 isolated_file:0
1 Time(s): active_file:62858 inactive_file:24904 isolated_file:0
1 Time(s): active_file:68130 inactive_file:18002 isolated_file:0
4 Time(s): apache2: page allocation failure: order:3, mode:0x20
2 Time(s): apache2: page allocation failure: order:4, mode:0x20
1 Time(s): free:1464 slab_reclaimable:2784 slab_unreclaimable:2908
1 Time(s): free:1869 slab_reclaimable:2777 slab_unreclaimable:2884
1 Time(s): free:2675 slab_reclaimable:2796 slab_unreclaimable:2896
1 Time(s): free:27566 slab_reclaimable:2881 slab_unreclaimable:2810
1 Time(s): free:6340 slab_reclaimable:2823 slab_unreclaimable:2906
1 Time(s): free:9516 slab_reclaimable:2803 slab_unreclaimable:2831
6 Time(s): lowmem_reserve[]: 0 0 0 0
6 Time(s): lowmem_reserve[]: 0 500 500 500
1 Time(s): mapped:3662 shmem:939 pagetables:355 bounce:0
1 Time(s): mapped:3772 shmem:3788 pagetables:573 bounce:0
1 Time(s): mapped:3819 shmem:2363 pagetables:490 bounce:0
1 Time(s): mapped:4028 shmem:3140 pagetables:563 bounce:0
1 Time(s): mapped:4031 shmem:2821 pagetables:592 bounce:0
1 Time(s): mapped:4032 shmem:1672 pagetables:468 bounce:0
1 Time(s): unevictable:0 dirty:100 writeback:0 unstable:0
1 Time(s): unevictable:0 dirty:102 writeback:4 unstable:0
1 Time(s): unevictable:0 dirty:112 writeback:0 unstable:0
1 Time(s): unevictable:0 dirty:20 writeback:0 unstable:0
1 Time(s): unevictable:0 dirty:76 writeback:0 unstable:0
1 Time(s): unevictable:0 dirty:95 writeback:10 unstable:0</c06bfb91></c06bf835></c06b0000></c066530d></c060f0ff></c0607ad3></c05eed37></c05ddcd4></c05ddc9d></c05dd965></c05daf25></c05d0cce></c05d0aae></c05c83ca></c05c815b></c05c8020></c05c7568></c0557a62></c05439d9></c05436dd></c053ad3d></c053a7fe></c0532366></c0532250></c045709f></c01cf606></c01cd481></c01b5a11></c01b58ee></c01b57ba></c01b52b6></c01b5036></c01b282d></c01b2726></c01b22b3></c01b1991></c01a39a2></c01a2a17></c018baa4></c018b7a4></c018b258></c018ae23></c0175781></c014000a></c0106404></c01063fb></c010625a></c0105c27></c0104c7a></c0103e95></c010368f>

I'm not exactly a Linux novice, but, I must admit that I am novice enough to be unfamiliar with these log entries. I have a few VMs and I've not seen this before on any of them.

I do have the Logwatch level cranked to 10, so this could be normal and I just don't know it.

This machine just runs a general LAMP stack (built using a StackScript).

Any insight into what these entries may mean, what may cause them, and the best course to take would be appreciated.

10 Replies

Looks like what logwatch sends out after a box has been rebooted. Have you rebooted recently?

I haven't. This box has been up for 20 days. These entries appear every day.

Check /var/log/messages for the messages you see it should have the messages in context, post the content here.

Thanks for the assist.

These are the entries for the day in question. There an many more similar for other days.

Dec  5 06:26:52 armed kernel: apache2: page allocation failure: order:3, mode:0x20
Dec  5 06:26:52 armed kernel: Pid: 23868, comm: apache2 Not tainted 3.0.4-linode38 #1
Dec  5 06:26:52 armed kernel: Call Trace:
Dec  5 06:26:52 armed kernel: [<c018b258>] ? warn_alloc_failed+0x98/0x100
Dec  5 06:26:52 armed kernel: [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
Dec  5 06:26:52 armed kernel: [<c014000a>] ? mod_timer_pending+0xba/0x110
Dec  5 06:26:52 armed kernel: [<c01b22b3>] ? T.833+0xb3/0x2e0
Dec  5 06:26:52 armed kernel: [<c01b2726>] ? cache_alloc_refill+0x246/0x290
Dec  5 06:26:52 armed kernel: [<c060f0ff>] ? ipt_do_table+0x24f/0x580
Dec  5 06:26:52 armed kernel: [<c01b282d>] ? __kmalloc+0xbd/0xd0
Dec  5 06:26:52 armed kernel: [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
Dec  5 06:26:52 armed kernel: [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
Dec  5 06:26:52 armed kernel: [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
Dec  5 06:26:52 armed kernel: [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
Dec  5 06:26:52 armed kernel: [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
Dec  5 06:26:52 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 06:26:52 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 06:26:52 armed kernel: [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
Dec  5 06:26:52 armed kernel: [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
Dec  5 06:26:52 armed kernel: [<c05c815b>] ? ip_finish_output+0x13b/0x300
Dec  5 06:26:52 armed kernel: [<c05c83ca>] ? ip_output+0xaa/0xe0
Dec  5 06:26:52 armed kernel: [<c05c7568>] ? ip_local_out+0x18/0x20
Dec  5 06:26:52 armed kernel: [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
Dec  5 06:26:52 armed kernel: [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
Dec  5 06:26:52 armed kernel: [<c05ddcd4>] ? __tcp_push_pending_frames+0x24/0x90
Dec  5 06:26:52 armed kernel: [<c05d0aae>] ? tcp_sendmsg+0x81e/0xb30
Dec  5 06:26:52 armed kernel: [<c018b7a4>] ? __alloc_pages_nodemask+0xf4/0x630
Dec  5 06:26:52 armed kernel: [<c0105c27>] ? xen_force_evtchn_callback+0x17/0x30
Dec  5 06:26:52 armed kernel: [<c05eed37>] ? inet_sendmsg+0x47/0xb0
Dec  5 06:26:52 armed kernel: [<c010368f>] ? xen_mc_flush+0x7f/0x190
Dec  5 06:26:52 armed kernel: [<c0532366>] ? sock_aio_write+0x116/0x170
Dec  5 06:26:52 armed kernel: [<c0106404>] ? check_events+0x8/0xc
Dec  5 06:26:52 armed kernel: [<c045709f>] ? cpumask_any_but+0x1f/0x30
Dec  5 06:26:52 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 06:26:52 armed kernel: [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
Dec  5 06:26:52 armed kernel: [<c01b52b6>] ? rw_verify_area+0x66/0x120
Dec  5 06:26:52 armed kernel: [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
Dec  5 06:26:52 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 06:26:52 armed kernel: [<c0175781>] ? handle_percpu_irq+0x31/0x50
Dec  5 06:26:52 armed kernel: [<c0105c27>] ? xen_force_evtchn_callback+0x17/0x30
Dec  5 06:26:52 armed kernel: [<c01b58ee>] ? vfs_writev+0x3e/0x60
Dec  5 06:26:52 armed kernel: [<c01b5a11>] ? sys_writev+0x41/0xa0
Dec  5 06:26:52 armed kernel: [<c06bfb91>] ? syscall_call+0x7/0xb
Dec  5 06:26:52 armed kernel: [<c06b0000>] ? sctp_err_lookup+0x90/0x110
Dec  5 06:26:52 armed kernel: Mem-Info:
Dec  5 06:26:52 armed kernel: DMA per-cpu:
Dec  5 06:26:52 armed kernel: CPU    0: hi:    0, btch:   1 usd:   0
Dec  5 06:26:52 armed kernel: CPU    1: hi:    0, btch:   1 usd:   0
Dec  5 06:26:52 armed kernel: CPU    2: hi:    0, btch:   1 usd:   0
Dec  5 06:26:52 armed kernel: CPU    3: hi:    0, btch:   1 usd:   0
Dec  5 06:26:52 armed kernel: Normal per-cpu:
Dec  5 06:26:52 armed kernel: CPU    0: hi:  186, btch:  31 usd:  56
Dec  5 06:26:52 armed kernel: CPU    1: hi:  186, btch:  31 usd:  36
Dec  5 06:26:52 armed kernel: CPU    2: hi:  186, btch:  31 usd: 178
Dec  5 06:26:52 armed kernel: CPU    3: hi:  186, btch:  31 usd:  46
Dec  5 06:26:52 armed kernel: active_anon:8148 inactive_anon:8074 isolated_anon:32
Dec  5 06:26:52 armed kernel: active_file:29168 inactive_file:44958 isolated_file:0
Dec  5 06:26:52 armed kernel: unevictable:0 dirty:20 writeback:0 unstable:0
Dec  5 06:26:52 armed kernel: free:27566 slab_reclaimable:2881 slab_unreclaimable:2810
Dec  5 06:26:52 armed kernel: mapped:3662 shmem:939 pagetables:355 bounce:0
Dec  5 06:26:52 armed kernel: DMA free:4476kB min:84kB low:104kB high:124kB active_anon:828kB inactive_anon:504kB active_file:0kB inactive_file:8kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:0kB mapped:308kB shmem:308kB slab_reclaimable:1036kB slab_unreclaimable:316kB kernel_stack:24kB pagetables:4kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
Dec  5 06:26:52 armed kernel: lowmem_reserve[]: 0 500 500 500
Dec  5 06:26:52 armed kernel: Normal free:105788kB min:2816kB low:3520kB high:4224kB active_anon:31764kB inactive_anon:31792kB active_file:116672kB inactive_file:179824kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:80kB writeback:0kB mapped:14340kB shmem:3448kB slab_reclaimable:10488kB slab_unreclaimable:10924kB kernel_stack:840kB pagetables:1416kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:33 all_unreclaimable? no
Dec  5 06:26:52 armed kernel: lowmem_reserve[]: 0 0 0 0
Dec  5 06:26:52 armed kernel: DMA: 327*4kB 247*8kB 75*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4484kB
Dec  5 06:26:52 armed kernel: Normal: 16991*4kB 4728*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 105788kB
Dec  5 06:26:52 armed kernel: 80396 total pagecache pages
Dec  5 06:26:52 armed kernel: 5322 pages in swap cache
Dec  5 06:26:52 armed kernel: Swap cache stats: add 865854, delete 860532, find 24034534/24119272
Dec  5 06:26:52 armed kernel: Free swap  = 217876kB
Dec  5 06:26:52 armed kernel: Total swap = 262140kB
Dec  5 06:26:52 armed kernel: 133104 pages RAM
Dec  5 06:26:52 armed kernel: 0 pages HighMem
Dec  5 06:26:52 armed kernel: 5833 pages reserved
Dec  5 06:26:52 armed kernel: 38661 pages shared
Dec  5 06:26:52 armed kernel: 77249 pages non-shared
Dec  5 06:36:42 armed rsyslogd: [origin software="rsyslogd" swVersion="4.2.0" x-pid="1913" x-info="http://www.rsyslog.com"] rsyslogd was HUPed, type 'lightweight'.
Dec  5 08:10:27 armed kernel: apache2: page allocation failure: order:3, mode:0x20
Dec  5 08:10:27 armed kernel: Pid: 3718, comm: apache2 Not tainted 3.0.4-linode38 #1
Dec  5 08:10:27 armed kernel: Call Trace:
Dec  5 08:10:27 armed kernel: [<c018b258>] ? warn_alloc_failed+0x98/0x100
Dec  5 08:10:27 armed kernel: [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
Dec  5 08:10:27 armed kernel: [<c014000a>] ? mod_timer_pending+0xba/0x110
Dec  5 08:10:27 armed kernel: [<c01b22b3>] ? T.833+0xb3/0x2e0
Dec  5 08:10:27 armed kernel: [<c01b2726>] ? cache_alloc_refill+0x246/0x290
Dec  5 08:10:27 armed kernel: [<c060f0ff>] ? ipt_do_table+0x24f/0x580
Dec  5 08:10:27 armed kernel: [<c01b282d>] ? __kmalloc+0xbd/0xd0
Dec  5 08:10:27 armed kernel: [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
Dec  5 08:10:27 armed kernel: [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
Dec  5 08:10:27 armed kernel: [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
Dec  5 08:10:27 armed kernel: [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
Dec  5 08:10:27 armed kernel: [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
Dec  5 08:10:27 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 08:10:27 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 08:10:27 armed kernel: [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
Dec  5 08:10:27 armed kernel: [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
Dec  5 08:10:27 armed kernel: [<c05c815b>] ? ip_finish_output+0x13b/0x300
Dec  5 08:10:27 armed kernel: [<c05c83ca>] ? ip_output+0xaa/0xe0
Dec  5 08:10:27 armed kernel: [<c05c7568>] ? ip_local_out+0x18/0x20
Dec  5 08:10:27 armed kernel: [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
Dec  5 08:10:27 armed kernel: [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
Dec  5 08:10:27 armed kernel: [<c05ddcd4>] ? __tcp_push_pending_frames+0x24/0x90
Dec  5 08:10:27 armed kernel: [<c05d0aae>] ? tcp_sendmsg+0x81e/0xb30
Dec  5 08:10:27 armed kernel: [<c018b7a4>] ? __alloc_pages_nodemask+0xf4/0x630
Dec  5 08:10:27 armed kernel: [<c05eed37>] ? inet_sendmsg+0x47/0xb0
Dec  5 08:10:27 armed kernel: [<c0532366>] ? sock_aio_write+0x116/0x170
Dec  5 08:10:27 armed kernel: [<c0106404>] ? check_events+0x8/0xc
Dec  5 08:10:27 armed kernel: [<c01063fb>] ? xen_restore_fl_direct_reloc+0x4/0x4
Dec  5 08:10:27 armed kernel: [<c018ae23>] ? free_hot_cold_page+0xd3/0x140
Dec  5 08:10:27 armed kernel: [<c0105c27>] ? xen_force_evtchn_callback+0x17/0x30
Dec  5 08:10:27 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 08:10:27 armed kernel: [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
Dec  5 08:10:27 armed kernel: [<c01b52b6>] ? rw_verify_area+0x66/0x120
Dec  5 08:10:27 armed kernel: [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
Dec  5 08:10:27 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 08:10:27 armed kernel: [<c01b1991>] ? kmem_cache_free+0x41/0x60
Dec  5 08:10:27 armed kernel: [<c01a2a17>] ? remove_vma+0x37/0x50
Dec  5 08:10:27 armed kernel: [<c01a39a2>] ? do_munmap+0x202/0x280
Dec  5 08:10:27 armed kernel: [<c01b58ee>] ? vfs_writev+0x3e/0x60
Dec  5 08:10:27 armed kernel: [<c01b5a11>] ? sys_writev+0x41/0xa0
Dec  5 08:10:27 armed kernel: [<c06bfb91>] ? syscall_call+0x7/0xb
Dec  5 08:10:27 armed kernel: [<c06b0000>] ? sctp_err_lookup+0x90/0x110
Dec  5 08:10:27 armed kernel: Mem-Info:
Dec  5 08:10:27 armed kernel: DMA per-cpu:
Dec  5 08:10:27 armed kernel: CPU    0: hi:    0, btch:   1 usd:   0
Dec  5 08:10:27 armed kernel: CPU    1: hi:    0, btch:   1 usd:   0
Dec  5 08:10:27 armed kernel: CPU    2: hi:    0, btch:   1 usd:   0
Dec  5 08:10:27 armed kernel: CPU    3: hi:    0, btch:   1 usd:   0
Dec  5 08:10:27 armed kernel: Normal per-cpu:
Dec  5 08:10:27 armed kernel: CPU    0: hi:  186, btch:  31 usd: 142
Dec  5 08:10:27 armed kernel: CPU    1: hi:  186, btch:  31 usd:  52
Dec  5 08:10:27 armed kernel: CPU    2: hi:  186, btch:  31 usd: 180
Dec  5 08:10:27 armed kernel: CPU    3: hi:  186, btch:  31 usd:  18
Dec  5 08:10:27 armed kernel: active_anon:10258 inactive_anon:8609 isolated_anon:32
Dec  5 08:10:27 armed kernel: active_file:60294 inactive_file:32199 isolated_file:0
Dec  5 08:10:27 armed kernel: unevictable:0 dirty:112 writeback:0 unstable:0
Dec  5 08:10:27 armed kernel: free:6340 slab_reclaimable:2823 slab_unreclaimable:2906
Dec  5 08:10:27 armed kernel: mapped:4032 shmem:1672 pagetables:468 bounce:0
Dec  5 08:10:27 armed kernel: DMA free:2816kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:1892kB inactive_file:1100kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:4kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:340kB kernel_stack:48kB pagetables:80kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
Dec  5 08:10:27 armed kernel: lowmem_reserve[]: 0 500 500 500
Dec  5 08:10:27 armed kernel: Normal free:22544kB min:2816kB low:3520kB high:4224kB active_anon:41032kB inactive_anon:34436kB active_file:239284kB inactive_file:127696kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:512064kB mlocked:0kB dirty:444kB writeback:0kB mapped:16128kB shmem:6688kB slab_reclaimable:10260kB slab_unreclaimable:11284kB kernel_stack:824kB pagetables:1792kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
Dec  5 08:10:27 armed kernel: lowmem_reserve[]: 0 0 0 0
Dec  5 08:10:27 armed kernel: DMA: 526*4kB 63*8kB 11*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2816kB
Dec  5 08:10:27 armed kernel: Normal: 4368*4kB 634*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22544kB
Dec  5 08:10:27 armed kernel: 96340 total pagecache pages
Dec  5 08:10:27 armed kernel: 2180 pages in swap cache
Dec  5 08:10:27 armed kernel: Swap cache stats: add 877526, delete 875346, find 24107494/24193578
Dec  5 08:10:27 armed kernel: Free swap  = 230492kB
Dec  5 08:10:27 armed kernel: Total swap = 262140kB
Dec  5 08:10:27 armed kernel: 133104 pages RAM
Dec  5 08:10:27 armed kernel: 0 pages HighMem
Dec  5 08:10:27 armed kernel: 5833 pages reserved
Dec  5 08:10:27 armed kernel: 57045 pages shared
Dec  5 08:10:27 armed kernel: 90983 pages non-shared
Dec  5 08:23:09 armed kernel: apache2: page allocation failure: order:4, mode:0x20
Dec  5 08:23:09 armed kernel: Pid: 5731, comm: apache2 Not tainted 3.0.4-linode38 #1
Dec  5 08:23:09 armed kernel: Call Trace:
Dec  5 08:23:09 armed kernel: [<c018b258>] ? warn_alloc_failed+0x98/0x100
Dec  5 08:23:09 armed kernel: [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
Dec  5 08:23:09 armed kernel: [<c010625a>] ? do_stolen_accounting+0x21a/0x250
Dec  5 08:23:09 armed kernel: [<c01b22b3>] ? T.833+0xb3/0x2e0
Dec  5 08:23:09 armed kernel: [<c01b2726>] ? cache_alloc_refill+0x246/0x290
Dec  5 08:23:09 armed kernel: [<c060f0ff>] ? ipt_do_table+0x24f/0x580
Dec  5 08:23:09 armed kernel: [<c01b282d>] ? __kmalloc+0xbd/0xd0
Dec  5 08:23:09 armed kernel: [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
Dec  5 08:23:09 armed kernel: [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
Dec  5 08:23:09 armed kernel: [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
Dec  5 08:23:09 armed kernel: [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
Dec  5 08:23:09 armed kernel: [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
Dec  5 08:23:09 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 08:23:09 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 08:23:09 armed kernel: [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
Dec  5 08:23:09 armed kernel: [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
Dec  5 08:23:09 armed kernel: [<c05c815b>] ? ip_finish_output+0x13b/0x300
Dec  5 08:23:09 armed kernel: [<c05c83ca>] ? ip_output+0xaa/0xe0
Dec  5 08:23:09 armed kernel: [<c05c7568>] ? ip_local_out+0x18/0x20
Dec  5 08:23:09 armed kernel: [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
Dec  5 08:23:09 armed kernel: [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
Dec  5 08:23:09 armed kernel: [<c05ddc9d>] ? tcp_push_one+0x2d/0x40
Dec  5 08:23:09 armed kernel: [<c05d0cce>] ? tcp_sendmsg+0xa3e/0xb30
Dec  5 08:23:09 armed kernel: [<c018b7a4>] ? __alloc_pages_nodemask+0xf4/0x630
Dec  5 08:23:09 armed kernel: [<c05eed37>] ? inet_sendmsg+0x47/0xb0
Dec  5 08:23:09 armed kernel: [<c0532366>] ? sock_aio_write+0x116/0x170
Dec  5 08:23:09 armed kernel: [<c0104c7a>] ? xen_batched_set_pte+0x1a/0xf0
Dec  5 08:23:09 armed kernel: [<c0103e95>] ? pte_pfn_to_mfn+0xb5/0xd0
Dec  5 08:23:09 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 08:23:09 armed kernel: [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
Dec  5 08:23:09 armed kernel: [<c01b52b6>] ? rw_verify_area+0x66/0x120
Dec  5 08:23:09 armed kernel: [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
Dec  5 08:23:09 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 08:23:09 armed kernel: [<c06bf835>] ? _raw_spin_lock+0x5/0x10
Dec  5 08:23:09 armed kernel: [<c01cf606>] ? mntput_no_expire+0x46/0x170
Dec  5 08:23:09 armed kernel: [<c01b58ee>] ? vfs_writev+0x3e/0x60
Dec  5 08:23:09 armed kernel: [<c01b5a11>] ? sys_writev+0x41/0xa0
Dec  5 08:23:09 armed kernel: [<c06bfb91>] ? syscall_call+0x7/0xb
Dec  5 08:23:09 armed kernel: Mem-Info:
Dec  5 08:23:09 armed kernel: DMA per-cpu:
Dec  5 08:23:09 armed kernel: CPU    0: hi:    0, btch:   1 usd:   0
Dec  5 08:23:09 armed kernel: CPU    1: hi:    0, btch:   1 usd:   0
Dec  5 08:23:09 armed kernel: CPU    2: hi:    0, btch:   1 usd:   0
Dec  5 08:23:09 armed kernel: CPU    3: hi:    0, btch:   1 usd:   0
Dec  5 08:23:09 armed kernel: Normal per-cpu:
Dec  5 08:23:09 armed kernel: CPU    0: hi:  186, btch:  31 usd: 170
Dec  5 08:23:09 armed kernel: CPU    1: hi:  186, btch:  31 usd:  43
Dec  5 08:23:09 armed kernel: CPU    2: hi:  186, btch:  31 usd:  33
Dec  5 08:23:09 armed kernel: CPU    3: hi:  186, btch:  31 usd:  23
Dec  5 08:23:09 armed kernel: active_anon:15912 inactive_anon:2916 isolated_anon:32
Dec  5 08:23:09 armed kernel: active_file:54614 inactive_file:34907 isolated_file:0
Dec  5 08:23:09 armed kernel: unevictable:0 dirty:76 writeback:0 unstable:0
Dec  5 08:23:09 armed kernel: free:9516 slab_reclaimable:2803 slab_unreclaimable:2831
Dec  5 08:23:09 armed kernel: mapped:3819 shmem:2363 pagetables:490 bounce:0
Dec  5 08:23:09 armed kernel: DMA free:3192kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:1760kB inactive_file:1104kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:228kB kernel_stack:8kB pagetables:4kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Dec  5 08:23:09 armed kernel: lowmem_reserve[]: 0 500 500 500
Dec  5 08:23:09 armed kernel: Normal free:34872kB min:2816kB low:3520kB high:4224kB active_anon:63648kB inactive_anon:11664kB active_file:216696kB inactive_file:138524kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:512064kB mlocked:0kB dirty:304kB writeback:0kB mapped:15276kB shmem:9452kB slab_reclaimable:10180kB slab_unreclaimable:11096kB kernel_stack:896kB pagetables:1956kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
Dec  5 08:23:09 armed kernel: lowmem_reserve[]: 0 0 0 0
Dec  5 08:23:09 armed kernel: DMA: 518*4kB 86*8kB 19*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3192kB
Dec  5 08:23:09 armed kernel: Normal: 6846*4kB 939*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 34896kB
Dec  5 08:23:09 armed kernel: 93394 total pagecache pages
Dec  5 08:23:09 armed kernel: 1510 pages in swap cache
Dec  5 08:23:09 armed kernel: Swap cache stats: add 880208, delete 878698, find 24150742/24237073
Dec  5 08:23:09 armed kernel: Free swap  = 235008kB
Dec  5 08:23:09 armed kernel: Total swap = 262140kB
Dec  5 08:23:09 armed kernel: 133104 pages RAM
Dec  5 08:23:09 armed kernel: 0 pages HighMem
Dec  5 08:23:09 armed kernel: 5833 pages reserved
Dec  5 08:23:09 armed kernel: 58831 pages shared
Dec  5 08:23:09 armed kernel: 89509 pages non-shared
Dec  5 10:07:36 armed kernel: apache2: page allocation failure: order:3, mode:0x20
Dec  5 10:07:36 armed kernel: Pid: 19519, comm: apache2 Not tainted 3.0.4-linode38 #1
Dec  5 10:07:36 armed kernel: Call Trace:
Dec  5 10:07:36 armed kernel: [<c018b258>] ? warn_alloc_failed+0x98/0x100
Dec  5 10:07:36 armed kernel: [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
Dec  5 10:07:36 armed kernel: [<c01b22b3>] ? T.833+0xb3/0x2e0
Dec  5 10:07:36 armed kernel: [<c01b2726>] ? cache_alloc_refill+0x246/0x290
Dec  5 10:07:36 armed kernel: [<c060f0ff>] ? ipt_do_table+0x24f/0x580
Dec  5 10:07:36 armed kernel: [<c01b282d>] ? __kmalloc+0xbd/0xd0
Dec  5 10:07:36 armed kernel: [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
Dec  5 10:07:36 armed kernel: [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
Dec  5 10:07:36 armed kernel: [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
Dec  5 10:07:36 armed kernel: [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
Dec  5 10:07:36 armed kernel: [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
Dec  5 10:07:36 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 10:07:36 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 10:07:36 armed kernel: [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
Dec  5 10:07:36 armed kernel: [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
Dec  5 10:07:36 armed kernel: [<c05c815b>] ? ip_finish_output+0x13b/0x300
Dec  5 10:07:36 armed kernel: [<c05c83ca>] ? ip_output+0xaa/0xe0
Dec  5 10:07:36 armed kernel: [<c05c7568>] ? ip_local_out+0x18/0x20
Dec  5 10:07:36 armed kernel: [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
Dec  5 10:07:36 armed kernel: [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
Dec  5 10:07:36 armed kernel: [<c05ddc9d>] ? tcp_push_one+0x2d/0x40
Dec  5 10:07:36 armed kernel: [<c05d0cce>] ? tcp_sendmsg+0xa3e/0xb30
Dec  5 10:07:36 armed kernel: [<c018b7a4>] ? __alloc_pages_nodemask+0xf4/0x630
Dec  5 10:07:36 armed kernel: [<c05eed37>] ? inet_sendmsg+0x47/0xb0
Dec  5 10:07:36 armed kernel: [<c0532366>] ? sock_aio_write+0x116/0x170
Dec  5 10:07:36 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 10:07:36 armed kernel: [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
Dec  5 10:07:36 armed kernel: [<c01cd481>] ? vfsmount_lock_local_unlock+0x11/0x20
Dec  5 10:07:36 armed kernel: [<c01b52b6>] ? rw_verify_area+0x66/0x120
Dec  5 10:07:36 armed kernel: [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
Dec  5 10:07:36 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 10:07:36 armed kernel: [<c06bf835>] ? _raw_spin_lock+0x5/0x10
Dec  5 10:07:36 armed kernel: [<c01cf606>] ? mntput_no_expire+0x46/0x170
Dec  5 10:07:36 armed kernel: [<c01b58ee>] ? vfs_writev+0x3e/0x60
Dec  5 10:07:36 armed kernel: [<c01b5a11>] ? sys_writev+0x41/0xa0
Dec  5 10:07:36 armed kernel: [<c06bfb91>] ? syscall_call+0x7/0xb
Dec  5 10:07:36 armed kernel: [<c06b0000>] ? sctp_err_lookup+0x90/0x110
Dec  5 10:07:36 armed kernel: Mem-Info:
Dec  5 10:07:36 armed kernel: DMA per-cpu:
Dec  5 10:07:36 armed kernel: CPU    0: hi:    0, btch:   1 usd:   0
Dec  5 10:07:36 armed kernel: CPU    1: hi:    0, btch:   1 usd:   0
Dec  5 10:07:36 armed kernel: CPU    2: hi:    0, btch:   1 usd:   0
Dec  5 10:07:36 armed kernel: CPU    3: hi:    0, btch:   1 usd:   0
Dec  5 10:07:36 armed kernel: Normal per-cpu:
Dec  5 10:07:36 armed kernel: CPU    0: hi:  186, btch:  31 usd: 102
Dec  5 10:07:36 armed kernel: CPU    1: hi:  186, btch:  31 usd:  74
Dec  5 10:07:36 armed kernel: CPU    2: hi:  186, btch:  31 usd: 177
Dec  5 10:07:36 armed kernel: CPU    3: hi:  186, btch:  31 usd: 128
Dec  5 10:07:36 armed kernel: active_anon:13253 inactive_anon:13253 isolated_anon:32
Dec  5 10:07:36 armed kernel: active_file:52639 inactive_file:35629 isolated_file:0
Dec  5 10:07:36 armed kernel: unevictable:0 dirty:100 writeback:0 unstable:0
Dec  5 10:07:36 armed kernel: free:2675 slab_reclaimable:2796 slab_unreclaimable:2896
Dec  5 10:07:36 armed kernel: mapped:4031 shmem:2821 pagetables:592 bounce:0
Dec  5 10:07:36 armed kernel: DMA free:2808kB min:84kB low:104kB high:124kB active_anon:996kB inactive_anon:1144kB active_file:280kB inactive_file:440kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:20kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:392kB kernel_stack:168kB pagetables:24kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
Dec  5 10:07:36 armed kernel: lowmem_reserve[]: 0 500 500 500
Dec  5 10:07:36 armed kernel: Normal free:7892kB min:2816kB low:3520kB high:4224kB active_anon:52016kB inactive_anon:51868kB active_file:210276kB inactive_file:142076kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:512064kB mlocked:0kB dirty:380kB writeback:0kB mapped:16124kB shmem:11284kB slab_reclaimable:10152kB slab_unreclaimable:11192kB kernel_stack:776kB pagetables:2344kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:64 all_unreclaimable? no
Dec  5 10:07:36 armed kernel: lowmem_reserve[]: 0 0 0 0
Dec  5 10:07:36 armed kernel: DMA: 596*4kB 43*8kB 5*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2808kB
Dec  5 10:07:36 armed kernel: Normal: 1845*4kB 64*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 7892kB
Dec  5 10:07:36 armed kernel: 92715 total pagecache pages
Dec  5 10:07:36 armed kernel: 1617 pages in swap cache
Dec  5 10:07:36 armed kernel: Swap cache stats: add 882918, delete 881301, find 24430105/24516996
Dec  5 10:07:36 armed kernel: Free swap  = 238024kB
Dec  5 10:07:36 armed kernel: Total swap = 262140kB
Dec  5 10:07:36 armed kernel: 133104 pages RAM
Dec  5 10:07:36 armed kernel: 0 pages HighMem
Dec  5 10:07:36 armed kernel: 5833 pages reserved
Dec  5 10:07:36 armed kernel: 72521 pages shared
Dec  5 10:07:36 armed kernel: 95494 pages non-shared
Dec  5 15:30:41 armed kernel: apache2: page allocation failure: order:3, mode:0x20
Dec  5 15:30:41 armed kernel: Pid: 20303, comm: apache2 Not tainted 3.0.4-linode38 #1
Dec  5 15:30:41 armed kernel: Call Trace:
Dec  5 15:30:41 armed kernel: [<c018b258>] ? warn_alloc_failed+0x98/0x100
Dec  5 15:30:41 armed kernel: [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
Dec  5 15:30:41 armed kernel: [<c014000a>] ? mod_timer_pending+0xba/0x110
Dec  5 15:30:41 armed kernel: [<c01b22b3>] ? T.833+0xb3/0x2e0
Dec  5 15:30:41 armed kernel: [<c01b2726>] ? cache_alloc_refill+0x246/0x290
Dec  5 15:30:41 armed kernel: [<c060f0ff>] ? ipt_do_table+0x24f/0x580
Dec  5 15:30:41 armed kernel: [<c01b282d>] ? __kmalloc+0xbd/0xd0
Dec  5 15:30:41 armed kernel: [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
Dec  5 15:30:41 armed kernel: [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
Dec  5 15:30:41 armed kernel: [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
Dec  5 15:30:41 armed kernel: [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
Dec  5 15:30:41 armed kernel: [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
Dec  5 15:30:41 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 15:30:41 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 15:30:41 armed kernel: [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
Dec  5 15:30:41 armed kernel: [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
Dec  5 15:30:41 armed kernel: [<c05c815b>] ? ip_finish_output+0x13b/0x300
Dec  5 15:30:41 armed kernel: [<c05c83ca>] ? ip_output+0xaa/0xe0
Dec  5 15:30:41 armed kernel: [<c05c7568>] ? ip_local_out+0x18/0x20
Dec  5 15:30:41 armed kernel: [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
Dec  5 15:30:41 armed kernel: [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
Dec  5 15:30:41 armed kernel: [<c05ddcd4>] ? __tcp_push_pending_frames+0x24/0x90
Dec  5 15:30:41 armed kernel: [<c05d0aae>] ? tcp_sendmsg+0x81e/0xb30
Dec  5 15:30:41 armed kernel: [<c010625a>] ? do_stolen_accounting+0x21a/0x250
Dec  5 15:30:41 armed kernel: [<c05eed37>] ? inet_sendmsg+0x47/0xb0
Dec  5 15:30:41 armed kernel: [<c0532366>] ? sock_aio_write+0x116/0x170
Dec  5 15:30:41 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 15:30:41 armed kernel: [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
Dec  5 15:30:41 armed kernel: [<c01b52b6>] ? rw_verify_area+0x66/0x120
Dec  5 15:30:41 armed kernel: [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
Dec  5 15:30:41 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 15:30:41 armed kernel: [<c0175781>] ? handle_percpu_irq+0x31/0x50
Dec  5 15:30:41 armed kernel: [<c0105c27>] ? xen_force_evtchn_callback+0x17/0x30
Dec  5 15:30:41 armed kernel: [<c01b58ee>] ? vfs_writev+0x3e/0x60
Dec  5 15:30:41 armed kernel: [<c01b5a11>] ? sys_writev+0x41/0xa0
Dec  5 15:30:41 armed kernel: [<c06bfb91>] ? syscall_call+0x7/0xb
Dec  5 15:30:41 armed kernel: [<c06b0000>] ? sctp_err_lookup+0x90/0x110
Dec  5 15:30:41 armed kernel: Mem-Info:
Dec  5 15:30:41 armed kernel: DMA per-cpu:
Dec  5 15:30:41 armed kernel: CPU    0: hi:    0, btch:   1 usd:   0
Dec  5 15:30:41 armed kernel: CPU    1: hi:    0, btch:   1 usd:   0
Dec  5 15:30:41 armed kernel: CPU    2: hi:    0, btch:   1 usd:   0
Dec  5 15:30:41 armed kernel: CPU    3: hi:    0, btch:   1 usd:   0
Dec  5 15:30:41 armed kernel: Normal per-cpu:
Dec  5 15:30:41 armed kernel: CPU    0: hi:  186, btch:  31 usd: 144
Dec  5 15:30:41 armed kernel: CPU    1: hi:  186, btch:  31 usd: 159
Dec  5 15:30:41 armed kernel: CPU    2: hi:  186, btch:  31 usd:  64
Dec  5 15:30:41 armed kernel: CPU    3: hi:  186, btch:  31 usd: 129
Dec  5 15:30:41 armed kernel: active_anon:15752 inactive_anon:12485 isolated_anon:32
Dec  5 15:30:41 armed kernel: active_file:62858 inactive_file:24904 isolated_file:0
Dec  5 15:30:41 armed kernel: unevictable:0 dirty:95 writeback:10 unstable:0
Dec  5 15:30:41 armed kernel: free:1464 slab_reclaimable:2784 slab_unreclaimable:2908
Dec  5 15:30:41 armed kernel: mapped:4028 shmem:3140 pagetables:563 bounce:0
Dec  5 15:30:41 armed kernel: DMA free:2248kB min:84kB low:104kB high:124kB active_anon:1544kB inactive_anon:1532kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:40kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:408kB kernel_stack:176kB pagetables:8kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
Dec  5 15:30:41 armed kernel: lowmem_reserve[]: 0 500 500 500
Dec  5 15:30:41 armed kernel: Normal free:3608kB min:2816kB low:3520kB high:4224kB active_anon:61464kB inactive_anon:48408kB active_file:251432kB inactive_file:99620kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:380kB writeback:0kB mapped:16112kB shmem:12560kB slab_reclaimable:10104kB slab_unreclaimable:11224kB kernel_stack:744kB pagetables:2244kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:89 all_unreclaimable? no
Dec  5 15:30:41 armed kernel: lowmem_reserve[]: 0 0 0 0
Dec  5 15:30:41 armed kernel: DMA: 168*4kB 149*8kB 23*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2232kB
Dec  5 15:30:41 armed kernel: Normal: 690*4kB 106*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3608kB
Dec  5 15:30:41 armed kernel: 92318 total pagecache pages
Dec  5 15:30:41 armed kernel: 1400 pages in swap cache
Dec  5 15:30:41 armed kernel: Swap cache stats: add 889704, delete 888304, find 25438294/25526844
Dec  5 15:30:41 armed kernel: Free swap  = 245528kB
Dec  5 15:30:41 armed kernel: Total swap = 262140kB
Dec  5 15:30:41 armed kernel: 133104 pages RAM
Dec  5 15:30:41 armed kernel: 0 pages HighMem
Dec  5 15:30:41 armed kernel: 5833 pages reserved
Dec  5 15:30:41 armed kernel: 71279 pages shared
Dec  5 15:30:41 armed kernel: 97392 pages non-shared
Dec  5 19:09:31 armed kernel: apache2: page allocation failure: order:4, mode:0x20
Dec  5 19:09:31 armed kernel: Pid: 12286, comm: apache2 Not tainted 3.0.4-linode38 #1
Dec  5 19:09:31 armed kernel: Call Trace:
Dec  5 19:09:31 armed kernel: [<c018b258>] ? warn_alloc_failed+0x98/0x100
Dec  5 19:09:31 armed kernel: [<c018baa4>] ? __alloc_pages_nodemask+0x3f4/0x630
Dec  5 19:09:31 armed kernel: [<c01b22b3>] ? T.833+0xb3/0x2e0
Dec  5 19:09:31 armed kernel: [<c01b2726>] ? cache_alloc_refill+0x246/0x290
Dec  5 19:09:31 armed kernel: [<c060f0ff>] ? ipt_do_table+0x24f/0x580
Dec  5 19:09:31 armed kernel: [<c01b282d>] ? __kmalloc+0xbd/0xd0
Dec  5 19:09:31 armed kernel: [<c053a7fe>] ? pskb_expand_head+0x12e/0x200
Dec  5 19:09:31 armed kernel: [<c066530d>] ? packet_rcv_spkt+0xfd/0x140
Dec  5 19:09:31 armed kernel: [<c053ad3d>] ? __pskb_pull_tail+0x4d/0x2b0
Dec  5 19:09:31 armed kernel: [<c0607ad3>] ? ipv4_confirm+0xf3/0x1b0
Dec  5 19:09:31 armed kernel: [<c05436dd>] ? dev_hard_start_xmit+0x1dd/0x3e0
Dec  5 19:09:31 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 19:09:31 armed kernel: [<c05c8020>] ? ip_finish_output2+0x260/0x260
Dec  5 19:09:31 armed kernel: [<c0557a62>] ? sch_direct_xmit+0xb2/0x170
Dec  5 19:09:31 armed kernel: [<c05439d9>] ? dev_queue_xmit+0xf9/0x320
Dec  5 19:09:31 armed kernel: [<c05c815b>] ? ip_finish_output+0x13b/0x300
Dec  5 19:09:31 armed kernel: [<c05c83ca>] ? ip_output+0xaa/0xe0
Dec  5 19:09:31 armed kernel: [<c05c7568>] ? ip_local_out+0x18/0x20
Dec  5 19:09:31 armed kernel: [<c05daf25>] ? tcp_transmit_skb+0x385/0x670
Dec  5 19:09:31 armed kernel: [<c05dd965>] ? tcp_write_xmit+0x1e5/0x4f0
Dec  5 19:09:31 armed kernel: [<c0106404>] ? check_events+0x8/0xc
Dec  5 19:09:31 armed kernel: [<c05ddc9d>] ? tcp_push_one+0x2d/0x40
Dec  5 19:09:31 armed kernel: [<c05d0cce>] ? tcp_sendmsg+0xa3e/0xb30
Dec  5 19:09:31 armed kernel: [<c018b7a4>] ? __alloc_pages_nodemask+0xf4/0x630
Dec  5 19:09:31 armed kernel: [<c05eed37>] ? inet_sendmsg+0x47/0xb0
Dec  5 19:09:31 armed kernel: [<c0532366>] ? sock_aio_write+0x116/0x170
Dec  5 19:09:31 armed kernel: [<c0104c7a>] ? xen_batched_set_pte+0x1a/0xf0
Dec  5 19:09:31 armed kernel: [<c0103e95>] ? pte_pfn_to_mfn+0xb5/0xd0
Dec  5 19:09:31 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 19:09:31 armed kernel: [<c01b5036>] ? do_sync_readv_writev+0xb6/0xf0
Dec  5 19:09:31 armed kernel: [<c01b52b6>] ? rw_verify_area+0x66/0x120
Dec  5 19:09:31 armed kernel: [<c01b57ba>] ? do_readv_writev+0xaa/0x1a0
Dec  5 19:09:31 armed kernel: [<c0532250>] ? sock_aio_dtor+0x10/0x10
Dec  5 19:09:31 armed kernel: [<c06bf835>] ? _raw_spin_lock+0x5/0x10
Dec  5 19:09:31 armed kernel: [<c01cf606>] ? mntput_no_expire+0x46/0x170
Dec  5 19:09:31 armed kernel: [<c01b58ee>] ? vfs_writev+0x3e/0x60
Dec  5 19:09:31 armed kernel: [<c01b5a11>] ? sys_writev+0x41/0xa0
Dec  5 19:09:31 armed kernel: [<c06bfb91>] ? syscall_call+0x7/0xb
Dec  5 19:09:31 armed kernel: [<c06b0000>] ? sctp_err_lookup+0x90/0x110
Dec  5 19:09:31 armed kernel: Mem-Info:
Dec  5 19:09:31 armed kernel: DMA per-cpu:
Dec  5 19:09:31 armed kernel: CPU    0: hi:    0, btch:   1 usd:   0
Dec  5 19:09:31 armed kernel: CPU    1: hi:    0, btch:   1 usd:   0
Dec  5 19:09:31 armed kernel: CPU    2: hi:    0, btch:   1 usd:   0
Dec  5 19:09:31 armed kernel: CPU    3: hi:    0, btch:   1 usd:   0
Dec  5 19:09:31 armed kernel: Normal per-cpu:
Dec  5 19:09:31 armed kernel: CPU    0: hi:  186, btch:  31 usd:  40
Dec  5 19:09:31 armed kernel: CPU    1: hi:  186, btch:  31 usd: 140
Dec  5 19:09:31 armed kernel: CPU    2: hi:  186, btch:  31 usd: 183
Dec  5 19:09:31 armed kernel: CPU    3: hi:  186, btch:  31 usd:  70
Dec  5 19:09:31 armed kernel: active_anon:22379 inactive_anon:7166 isolated_anon:33
Dec  5 19:09:31 armed kernel: active_file:68130 inactive_file:18002 isolated_file:0
Dec  5 19:09:31 armed kernel: unevictable:0 dirty:102 writeback:4 unstable:0
Dec  5 19:09:31 armed kernel: free:1869 slab_reclaimable:2777 slab_unreclaimable:2884
Dec  5 19:09:31 armed kernel: mapped:3772 shmem:3788 pagetables:573 bounce:0
Dec  5 19:09:31 armed kernel: DMA free:4020kB min:84kB low:104kB high:124kB active_anon:984kB inactive_anon:416kB active_file:0kB inactive_file:4kB unevictable:0kB isolated(anon):132kB isolated(file):0kB present:15808kB mlocked:0kB dirty:12kB writeback:24kB mapped:0kB shmem:0kB slab_reclaimable:1032kB slab_unreclaimable:356kB kernel_stack:88kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:34 all_unreclaimable? no
Dec  5 19:09:31 armed kernel: lowmem_reserve[]: 0 500 500 500
Dec  5 19:09:31 armed kernel: Normal free:3456kB min:2816kB low:3520kB high:4224kB active_anon:88532kB inactive_anon:28248kB active_file:272520kB inactive_file:72004kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:396kB writeback:0kB mapped:15088kB shmem:15152kB slab_reclaimable:10076kB slab_unreclaimable:11180kB kernel_stack:840kB pagetables:2272kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:77 all_unreclaimable? no
Dec  5 19:09:31 armed kernel: lowmem_reserve[]: 0 0 0 0
Dec  5 19:09:31 armed kernel: DMA: 159*4kB 224*8kB 99*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4012kB
Dec  5 19:09:31 armed kernel: Normal: 820*4kB 20*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3456kB
Dec  5 19:09:31 armed kernel: 91016 total pagecache pages
Dec  5 19:09:31 armed kernel: 1081 pages in swap cache
Dec  5 19:09:31 armed kernel: Swap cache stats: add 891644, delete 890564, find 26214855/26303788
Dec  5 19:09:31 armed kernel: Free swap  = 248160kB
Dec  5 19:09:31 armed kernel: Total swap = 262140kB
Dec  5 19:09:31 armed kernel: 133104 pages RAM
Dec  5 19:09:31 armed kernel: 0 pages HighMem
Dec  5 19:09:31 armed kernel: 5833 pages reserved
Dec  5 19:09:31 armed kernel: 73713 pages shared
Dec  5 19:09:31 armed kernel: 96930 pages non-shared</c06b0000></c06bfb91></c01b5a11></c01b58ee></c01cf606></c06bf835></c0532250></c01b57ba></c01b52b6></c01b5036></c0532250></c0103e95></c0104c7a></c0532366></c05eed37></c018b7a4></c05d0cce></c05ddc9d></c0106404></c05dd965></c05daf25></c05c7568></c05c83ca></c05c815b></c05439d9></c0557a62></c05c8020></c05c8020></c05436dd></c0607ad3></c053ad3d></c066530d></c053a7fe></c01b282d></c060f0ff></c01b2726></c01b22b3></c018baa4></c018b258></c06b0000></c06bfb91></c01b5a11></c01b58ee></c0105c27></c0175781></c0532250></c01b57ba></c01b52b6></c01b5036></c0532250></c0532366></c05eed37></c010625a></c05d0aae></c05ddcd4></c05dd965></c05daf25></c05c7568></c05c83ca></c05c815b></c05439d9></c0557a62></c05c8020></c05c8020></c05436dd></c0607ad3></c053ad3d></c066530d></c053a7fe></c01b282d></c060f0ff></c01b2726></c01b22b3></c014000a></c018baa4></c018b258></c06b0000></c06bfb91></c01b5a11></c01b58ee></c01cf606></c06bf835></c0532250></c01b57ba></c01b52b6></c01cd481></c01b5036></c0532250></c0532366></c05eed37></c018b7a4></c05d0cce></c05ddc9d></c05dd965></c05daf25></c05c7568></c05c83ca></c05c815b></c05439d9></c0557a62></c05c8020></c05c8020></c05436dd></c0607ad3></c053ad3d></c066530d></c053a7fe></c01b282d></c060f0ff></c01b2726></c01b22b3></c018baa4></c018b258></c06bfb91></c01b5a11></c01b58ee></c01cf606></c06bf835></c0532250></c01b57ba></c01b52b6></c01b5036></c0532250></c0103e95></c0104c7a></c0532366></c05eed37></c018b7a4></c05d0cce></c05ddc9d></c05dd965></c05daf25></c05c7568></c05c83ca></c05c815b></c05439d9></c0557a62></c05c8020></c05c8020></c05436dd></c0607ad3></c053ad3d></c066530d></c053a7fe></c01b282d></c060f0ff></c01b2726></c01b22b3></c010625a></c018baa4></c018b258></c06b0000></c06bfb91></c01b5a11></c01b58ee></c01a39a2></c01a2a17></c01b1991></c0532250></c01b57ba></c01b52b6></c01b5036></c0532250></c0105c27></c018ae23></c01063fb></c0106404></c0532366></c05eed37></c018b7a4></c05d0aae></c05ddcd4></c05dd965></c05daf25></c05c7568></c05c83ca></c05c815b></c05439d9></c0557a62></c05c8020></c05c8020></c05436dd></c0607ad3></c053ad3d></c066530d></c053a7fe></c01b282d></c060f0ff></c01b2726></c01b22b3></c014000a></c018baa4></c018b258></c06b0000></c06bfb91></c01b5a11></c01b58ee></c0105c27></c0175781></c0532250></c01b57ba></c01b52b6></c01b5036></c0532250></c045709f></c0106404></c0532366></c010368f></c05eed37></c0105c27></c018b7a4></c05d0aae></c05ddcd4></c05dd965></c05daf25></c05c7568></c05c83ca></c05c815b></c05439d9></c0557a62></c05c8020></c05c8020></c05436dd></c0607ad3></c053ad3d></c066530d></c053a7fe></c01b282d></c060f0ff></c01b2726></c01b22b3></c014000a></c018baa4></c018b258>

What's the output of uname -a

Linux armed 3.0.4-linode38 #1 SMP Thu Sep 22 14:59:08 EDT 2011 i686 GNU/Linux

If you look at the top it says Dec 5 06:26:52 armed kernel: apache2: page allocation failure: order:3, mode:0x20

Which is the same as what you see here http://forum.linode.com/viewtopic.php?t=7805&start=15 might want to poke linode support and let them know you're having issues with the linode kernel they might be able to help.

Hmmm.

Alright. Will do.

Thanks!

Well, vm.minfreekbytes = 8192 fixed that for me.

If you have disk thrashing problems, you might need even higher reserve for the incoming network buffer, but it'll be better to fix thrashing instead. ;)

Indeed, that is what fixed my issue.

This is an excerpt from the reply I got to my support request…

> You'll want to check the output of this command after your Linode reboots:

sysctl vm.minfreekbytes

If it is lower than "16384", please raise it using the following command:

sysctl vm.minfreekbytes=16384

You'll also want to add this line to your "/etc/sysctl.conf" file to make the change stick across reboots:

vm/minfreekbytes = 16384

It solved the problem.

They did also recommend some MySQL and Apache optimization, but I had already done that some ago.

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Log in to Reply
Community Code of Conduct