Kernel msgs (errors?) in Logwatch since restore from backup

Hello all,

I've been running a Debian Lenny LAMP server since last Sept and have been very happy with it. Linux has always been a hobby for me and most times I run up against something new, I can figure it out with a bit of googling. Something has me stumped though and I'm hoping you guys can shed a little light on the situation.

Around May 5th I accidentally deleted something important from my server. In order to get it back, I restored my server from the most recent nightly backup. Ever since then, in about 95% of my daily logwatch reports, I have loooooong list of kernel messages. Logwatch doesn't call them errors, but they very well could be. I never had stuff like this in my reports before the restore, but now it's almost every day.

Here is an example of the output:

Kernel

2 Time(s): 0 pages HighMem

1 Time(s): 103012 pages non-shared

1 Time(s): 103812 pages non-shared

2 Time(s): 133104 pages RAM

1 Time(s): 33970 pages shared

1 Time(s): 36819 pages shared

1 Time(s): 51273 total pagecache pages

1 Time(s): 54141 total pagecache pages

2 Time(s): 5637 pages reserved

1 Time(s): 9198 pages in swap cache

1 Time(s): 9331 pages in swap cache

2 Time(s): [] ? irq_exit+0x65/0x70

2 Time(s): CPU 0: hi: 0, btch: 1 usd: 0

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 25

1 Time(s): CPU 0: hi: 186, btch: 31 usd: 91

2 Time(s): CPU 1: hi: 0, btch: 1 usd: 0

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 110

1 Time(s): CPU 1: hi: 186, btch: 31 usd: 179

2 Time(s): CPU 2: hi: 0, btch: 1 usd: 0

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 40

1 Time(s): CPU 2: hi: 186, btch: 31 usd: 59

2 Time(s): CPU 3: hi: 0, btch: 1 usd: 0

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 50

1 Time(s): CPU 3: hi: 186, btch: 31 usd: 56

2 Time(s): Call Trace:

1 Time(s): DMA free:2060kB min:84kB low:104kB high:124kB activeanon:196kB inactiveanon:2328kB activefile:1508kB inactivefile:980kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:0kB mapped:704kB shmem:0kB slabreclaimable:24kB slabunreclaimable:36kB kernelstack:0kB pagetables:0kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

1 Time(s): DMA free:2096kB min:84kB low:104kB high:124kB activeanon:100kB inactiveanon:2328kB activefile:1584kB inactivefile:996kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15808kB mlocked:0kB dirty:0kB writeback:0kB mapped:704kB shmem:0kB slabreclaimable:24kB slabunreclaimable:4kB kernelstack:0kB pagetables:0kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

2 Time(s): DMA per-cpu:

1 Time(s): DMA: 1814kB 1018kB 116kB 032kB 264kB 1128kB 1256kB 0512kB 01024kB 02048kB 0*4096kB = 2060kB

1 Time(s): DMA: 1844kB 1008kB 116kB 132kB 264kB 1128kB 1256kB 0512kB 01024kB 02048kB 0*4096kB = 2096kB

1 Time(s): Free swap = 188888kB

1 Time(s): Free swap = 190336kB

2 Time(s): Mem-Info:

1 Time(s): Normal free:13620kB min:2816kB low:3520kB high:4224kB activeanon:142404kB inactiveanon:152700kB activefile:98448kB inactivefile:67208kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:0kB writeback:0kB mapped:17476kB shmem:8kB slabreclaimable:7512kB slabunreclaimable:6084kB kernelstack:1104kB pagetables:2504kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

1 Time(s): Normal free:6952kB min:2816kB low:3520kB high:4224kB activeanon:174856kB inactiveanon:116056kB activefile:130808kB inactivefile:45852kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:512064kB mlocked:0kB dirty:24kB writeback:0kB mapped:18772kB shmem:8kB slabreclaimable:7608kB slabunreclaimable:6068kB kernelstack:1120kB pagetables:2760kB unstable:0kB bounce:0kB writebacktmp:0kB pagesscanned:0 allunreclaimable? no

2 Time(s): Normal per-cpu:

1 Time(s): Normal: 15414kB 6288kB 14916kB 132kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 13604kB

1 Time(s): Normal: 2404kB 3998kB 14116kB 1732kB 064kB 0128kB 0256kB 0512kB 01024kB 02048kB 0*4096kB = 6952kB

1 Time(s): Pid: 0, comm: swapper Not tainted 2.6.38.3-linode32 #1

1 Time(s): Pid: 269, comm: kswapd0 Not tainted 2.6.38.3-linode32 #1

1 Time(s): Swap cache stats: add 1054305, delete 1044974, find 5701264/5891884

1 Time(s): Swap cache stats: add 1055406, delete 1046208, find 5703305/5894027

2 Time(s): Total swap = 262140kB

1 Time(s): [] ? hypercall_page+0x227/0x1010

1 Time(s): [] ? hypercall_page+0x3a7/0x1010

6 Time(s): [] ? xenforceevtchn_callback+0x17/0x30

1 Time(s): [] ? xensafehalt+0xf/0x20

1 Time(s): [] ? xenirqenabledirectend+0x0/0x1

2 Time(s): [] ? xenrestorefldirectend+0x0/0x1

1 Time(s): [] ? check_events+0x8/0xc

1 Time(s): [] ? cpu_idle+0x42/0x70

1 Time(s): [] ? kernelthreadhelper+0x6/0x10

2 Time(s): [] ? xendoupcall+0x7/0xc

1 Time(s): [] ? default_idle+0x2f/0x60

1 Time(s): [] ? finishtaskswitch+0x47/0xb0

2 Time(s): [] ? _dosoftirq+0x0/0x130

2 Time(s): [] ? _dosoftirq+0x7c/0x130

2 Time(s): [] ? localbhenable+0x16/0x80

1 Time(s): [] ? trytodeltimersync+0x4a/0x80

1 Time(s): [] ? kthread+0x0/0x80

1 Time(s): [] ? kthread+0x74/0x80

1 Time(s): [] ? autoremovewakefunction+0x0/0x40

1 Time(s): [] ? zonewatermarkok_safe+0x8f/0xa0

2 Time(s): [] ? _allocpages_nodemask+0x4f0/0x670

1 Time(s): [] ? kswapd+0x0/0x7b0

1 Time(s): [] ? kswapd+0x78e/0x7b0

1 Time(s): [] ? setpgdatpercpu_threshold+0x87/0xa0

2 Time(s): [] ? kmemcachefree+0x46/0x120

2 Time(s): [] ? cacheallocrefill+0x2f9/0x520

2 Time(s): [] ? __kmalloc+0xb4/0xe0

2 Time(s): [] ? xenevtchndo_upcall+0x1d/0x30

2 Time(s): [] ? xennet_poll+0x7f5/0xc20

2 Time(s): [] ? pskbexpandhead+0x12e/0x200

2 Time(s): [] ? _pskbpull_tail+0x4d/0x2b0

2 Time(s): [] ? _netifreceive_skb+0x32d/0x510

2 Time(s): [] ? netifreceiveskb+0x67/0x70

2 Time(s): [] ? netrxaction+0x9a/0x130

2 Time(s): [] ? devhardstart_xmit+0x26a/0x520

2 Time(s): [] ? devqueuexmit+0x121/0x550

1 Time(s): [] ? neighresolveoutput+0xf5/0x310

1 Time(s): [] ? eth_header+0x0/0xc0

1 Time(s): [] ? eth_header+0x10/0xc0

2 Time(s): [] ? schdirectxmit+0xb2/0x170

2 Time(s): [] ? nf_iterate+0x74/0xa0

2 Time(s): [] ? iprcvfinish+0xf6/0x3c0

2 Time(s): [] ? iplocaldeliver_finish+0x0/0x220

2 Time(s): [] ? iplocaldeliver_finish+0x97/0x220

2 Time(s): [] ? iplocalout+0x18/0x20

2 Time(s): [] ? ipqueuexmit+0x137/0x3a0

4 Time(s): [] ? ipfinishoutput+0x0/0x300

2 Time(s): [] ? ipfinishoutput+0x134/0x300

2 Time(s): [] ? ip_output+0xaa/0xe0

2 Time(s): [] ? tcprcvestablished+0x594/0x840

2 Time(s): [] ? tcptransmitskb+0x372/0x7e0

2 Time(s): [] ? tcpwritexmit+0x198/0x980

2 Time(s): [] ? _tcppushpendingframes+0x24/0x90

2 Time(s): [] ? tcpv4do_rcv+0xd6/0x230

2 Time(s): [] ? tcpv4rcv+0x6cc/0x7b0

2 Time(s): [] ? packetrcvspkt+0xfd/0x140

1 Time(s): [] ? schedule+0x219/0x8b0

1 Time(s): [] ? unknown_bootoption+0x0/0x190

1 Time(s): [] ? start_kernel+0x2da/0x2df

1 Time(s): [] ? xenstartkernel+0x530/0x538

1 Time(s): activeanon:35650 inactiveanon:38757 isolated_anon:0

1 Time(s): activeanon:43739 inactiveanon:29596 isolated_anon:0

1 Time(s): activefile:24989 inactivefile:17047 isolated_file:0

1 Time(s): activefile:33098 inactivefile:11712 isolated_file:0

1 Time(s): free:2262 slabreclaimable:1908 slabunreclaimable:1518

1 Time(s): free:3920 slabreclaimable:1884 slabunreclaimable:1530

3 Time(s): imklog 3.18.6, log source = /proc/kmsg started.

1 Time(s): kswapd0: page allocation failure. order:3, mode:0x20

2 Time(s): lowmem_reserve[]: 0 0 0 0

2 Time(s): lowmem_reserve[]: 0 500 500 500

1 Time(s): mapped:4545 shmem:2 pagetables:626 bounce:0

1 Time(s): mapped:4869 shmem:2 pagetables:690 bounce:0

1 Time(s): swapper: page allocation failure. order:4, mode:0x20

1 Time(s): unevictable:0 dirty:0 writeback:0 unstable:0

1 Time(s): unevictable:0 dirty:6 writeback:0 unstable:0

I had to add all those line breaks by hand, so hopefully I found them all. :)

Anybody know if this is something to be worried about? How to make it stop? Why a restoration would cause this?

Your thoughts are greatly appreciated.

Thanks in advance.

4 Replies

@Waldo X:

Why a restoration would cause this?
It wouldn't. Please reboot into the latest kernel and this will likely alleviate the problem for you.

Hope that helps!

-Chris

Hi, and thanks for the reply.

Can you please elaborate on "reboot into the latest kernel"?

How would I go about that?

Thanks again.

Log in, Linodes tab, dashboard, make sure the configuration profile is set to "Latest 2.6 Paravirt", reboot. That's it! :)

-Chris

Thanks, I had just found the Boot Settings–>Kernel section of Configuration Profile and was wondering what kernel it should be set to. When I looked there, it was already set to "Latest 2.6 Paravirt (2.6.39.1-linode34", however, when I checked my kernel version on the server it was "2.6.38.3-linode32".

A reboot, as you suggested, has updated it, so hopefully that'll clear up the log reports.

Thanks!

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Community Code of Conduct