View All Products
Compute
Storage
Networking
Databases
Services
Developer Tools
Industries
Pricing
Community
Engage With Us
Community ▶ Questions ▶ 2.6.29-linode19 / 2.6.30.5-linode20 issues
Log in to Ask a Question

2.6.29-linode19 / 2.6.30.5-linode20 issues

general

Running 32-bit Gentoo and updated world, last night. Was running 2.6.29-linode19, and decided to try 2.6.30.5-linode20 since I was going to reboot (and since caker moved 2.6.29 to the deprecated list).

It hangs on boot:

Showing last 100 lines from current boot
-----------------------------------------
 00000000 00000000 00000000 00000000 e3221584 e3224b80 e3221580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0>01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00 
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2483f28
CR2: 00000000964439d8
---[ end trace 28ff39c8e0512d27 ]---
BUG: unable to handle kernel paging request at 964438d8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 00000004bd039007 
Oops: 0002 [#3] SMP 
last sysfs file: 
Modules linked in:

Pid: 12, comm: events/1 Tainted: G      D    (2.6.30.5-linode20 #1) 
EIP: 0061:[<c0172b50>] EFLAGS: 00010246 CPU: 1
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96443880 EBX: ffffffff ECX: 00000200 EDX: f5752040
ESI: c06fb200 EDI: c06fb100 EBP: e2481f2c ESP: e2481f28
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0069
Process events/1 (pid: 12, ti=e2480000 task=e245d420 task.ti=e2480000)
Stack:
 00000100 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 e3211584 e3214b80 e3211580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0>01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00 
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2481f28
CR2: 00000000964438d8
---[ end trace 28ff39c8e0512d28 ]---
BUG: unable to handle kernel paging request at 96442fd8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 000000052d058027 
Oops: 0002 [#4] SMP 
last sysfs file: 
Modules linked in:

Pid: 11, comm: events/0 Tainted: G      D    (2.6.30.5-linode20 #1) 
EIP: 0061:[<c0172b50>] EFLAGS: 00010246 CPU: 0
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96442f80 EBX: 00000001 ECX: 00000200 EDX: f5752000
ESI: c06fa980 EDI: c06fa900 EBP: e247ff2c ESP: e247ff28
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0069
Process events/0 (pid: 11, ti=e247e000 task=e245d810 task.ti=e247e000)
Stack:
 00000080 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 e3201584 e3204b80 e3201580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0>01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00 
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e247ff28
CR2: 0000000096442fd8
---[ end trace 28ff39c8e0512d29 ]---
udev: starting version 141
udev: deprecated sysfs layout; update the kernel or disable CONFIG_SYSFS_DEPRECATED; some udev features will n
ot work correctly
                                                     [ ok ]
 * Populating /dev with existing devices through uevents ...              [ ok ]
 * Waiting for uevents to be processed ...                                [ ok ]
 * Mounting devpts at /dev/pts ...                                        [ ok ]
 * Checking root filesystem .../dev/xvda: clean, 580007/6209536 files, 6110565/12419072 blocks
                                           [ ok ]
 * Remounting root filesystem read/write ...EXT3 FS on xvda, internal journal
                              [ ok ]
FATAL: Could not load /lib/modules/2.6.30.5-linode20/modules.dep: No such file or directory
 * Checking all filesystems ...                                           [ ok ]
 * Mounting local filesystems ...                                         [ ok ]
 * Mounting misc binary format filesystem ...                             [ ok ]
 * Activating (possible) swap ...Adding 655352k swap on /dev/xvdb.  Priority:-1 extents:1 across:655352k SS
                                         [ ok ]
 * Setting system clock using the hardware clock [UTC] ...                [ ok ]
 * Configuring kernel parameters ...                                      [ ok ]
 * Updating environment ...                                               [ ok ]
 * Cleaning /var/lock, /var/run ...                                       [ ok ]
 * Wiping /tmp directory ...                                              [ ok ]

 <hangs forever="" here="" -="" normally="" udev-postmount="" runs="" now=""></hangs></c0172b50></f0></c0108757></c013da70></c013dab9></c013ae80></c013ddb0></c011ee9b></c013afac></c0172bab></c0172ba0></c0172b50></c0172b50></c0172b50></f0></c0108757></c013da70></c013dab9></c013ae80></c013ddb0></c011ee9b></c013afac></c0172bab></c0172ba0></c0172b50></c0172b50></c0172b50></f0></c0108757></c013da70></c013dab9></c013ae80></c013ddb0></c011ee9b></c013afac></c0172bab></c0172ba0>

Switching back to 2.6.29-linode18 results in a boot, but there is an Oops:

Showing last 100 lines from current boot
-----------------------------------------
 00000000 00000000 00000000 00000000 e3221584 e3224b80 e3221580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d
 c0 8d 84 97 80 06 00 00 <f0>01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2483f28
CR2: 00000000964439d8
---[ end trace 28ff39c8e0512d27 ]---
BUG: unable to handle kernel paging request at 964438d8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 00000004bd039007
Oops: 0002 [#3] SMP
last sysfs file:
Modules linked in:

Pid: 12, comm: events/1 Tainted: G      D    (2.6.30.5-linode20 #1)
EIP: 0061:[<c0172b50>] EFLAGS: 00010246 CPU: 1
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96443880 EBX: ffffffff ECX: 00000200 EDX: f5752040
EIP is at refresh_cpu_vm_stats+0x70/0xc0
EAX: 96443880 EBX: ffffffff ECX: 00000200 EDX: f5752040
ESI: c06fb200 EDI: c06fb100 EBP: e2481f2c ESP: e2481f28
 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0069
Process events/1 (pid: 12, ti=e2480000 task=e245d420 task.ti=e2480000)
Stack:
 00000100 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
 00000000 00000000 00000000 00000000 e3211584 e3214b80 e3211580 c0172ba0
Call Trace:
 [<c0172ba0>] ? vmstat_update+0x0/0x30
 [<c0172bab>] ? vmstat_update+0xb/0x30
 [<c013afac>] ? worker_thread+0x12c/0x1c0
 [<c011ee9b>] ? __wake_up_common+0x4b/0x80
 [<c013ddb0>] ? autoremove_wake_function+0x0/0x40
 [<c013ae80>] ? worker_thread+0x0/0x1c0
 [<c013dab9>] ? kthread+0x49/0x80
 [<c013da70>] ? kthread+0x0/0x80
 [<c0108757>] ? kernel_thread_helper+0x7/0x10
Code: 15 00 74 2f ff 15 1c 2c 6d c0 89 c1 ff 15 24 2c 6d c0 0f be 5c 16 15 89 c8 c6 44 16 15 00 ff 15 20 2c 6d c0 8d 84 97 80 06 00 00 <f0>01 58 58 01 5c 95 00 83 c2 01 83 fa 13 75 c2 e8 4b 7c 42 00
EIP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0 SS:ESP 0069:e2481f28
CR2: 00000000964438d8
---[ end trace 28ff39c8e0512d28 ]---
BUG: unable to handle kernel paging request at 96442fd8
IP: [<c0172b50>] refresh_cpu_vm_stats+0x70/0xc0
*pdpt = 000000052d058027
Oops: 0002 [#4] SMP
last sysfs file:
Modules linked in:

Pid: 11, comm: events/0 Tainted: G      D    (2.6.30.5-linode20 #1)</c0172b50></c0172b50></f0></c0108757></c013da70></c013dab9></c013ae80></c013ddb0></c011ee9b></c013afac></c0172bab></c0172ba0></c0172b50></c0172b50></c0172b50></f0></c0108757></c013da70></c013dab9></c013ae80></c013ddb0></c011ee9b></c013afac></c0172bab></c0172ba0>

Interestingly, using pv-grub to boot a kernel compiled using gentoo-sources (2.6.30-gentoo-r6) based on /proc/config.gz from 2.6.29-linode19 I get no Oops. That said, the initial boot of this pv-grub kernel resulting in a panic during udev-postmount. Subsequent boot worked.

4 Replies

Linode Staff

You're getting this because the host your Linode is on has a very old Xen stack, which doesn't support our latest versions of pv_ops based kernels. Submit a ticket and we'll move you to an updated host.

-Chris

OK, will do. FYI, pv-grub kernel panic'd shortly after booting:

------------[ cut here ]------------
 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069
Process apache2 (pid: 5955, ti=d7c68000 task=e1ccdc00 task.ti=d7c68000)
Stack:
 c05c7740 e2524420 c0125e40 0011aee0 00000000 00000000 00000200 e16f3f4c
 e171ff4c 00000000 e15696c8 c03a2020 e24df3c0 000011e7 e1569700 00000000
 00000001 e15696c8 00000001 c03a2683 d7ce9600 00001743 e184e6c8 e184e6c4
Call Trace:
 [<c0125e40>] ? try_to_wake_up+0xa0/0x1d0
 [<c03a2020>] ? update_queue+0x80/0xb0
 [<c03a2683>] ? sys_semtimedop+0x3d3/0x6e0
 [<c0121000>] ? init_sched_build_groups+0xd0/0x130
 [<c01051d6>] ? __raw_callee_save_xen_save_fl+0x6/0x8
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0165f74>] ? find_get_page+0x24/0xb0
 [<c016631b>] ? find_lock_page+0x1b/0x70
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c0166954>] ? filemap_fault+0x124/0x400
 [<c0487953>] ? release_sock+0x13/0xa0
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c0104290>] ? xen_set_pte_at+0x80/0xf0
 [<c0178f81>] ? __do_fault+0x3b1/0x490
 [<c018cbcb>] ? fd_install+0x3b/0x50
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c017ae49>] ? handle_mm_fault+0x169/0x900
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c05c3e3e>] ? _spin_unlock_irqrestore+0x1e/0x30
 [<c01babd2>] ? ep_scan_ready_list+0x142/0x150
 [<c05c3dd5>] ? _spin_lock+0x5/0x10
 [<c019b2a3>] ? set_close_on_exec+0x43/0x60
 [<c010bd54>] ? sys_ipc+0x74/0x2f0
 [<c01051ee>] ? __raw_callee_save_xen_irq_enable+0x6/0x8
 [<c0107d1c>] ? sysenter_past_esp+0x3d/0x63
 [<c0107d54>] ? sysenter_do_call+0x12/0x28
Code: c2 74 0e 0f ae f0 89 f6 8b 46 04 f6 40 0c 04 74 09 5b 5e c3 8d b6 00 00 00 00 89 d0 ff 15 f0 4e 6f c0 5b 5e 8d b6 00 00 00 00 c3 <0f> 0b eb fe 8d 76 00 53 89 c3 8b 0c 85 a0 d6 73 c0 ba 00 96 7a
EIP: [<c011e6c9>] resched_task+0x69/0x70 SS:ESP 0069:d7c69d48
---[ end trace 69daa05273def3ad ]---
Kernel panic - not syncing: Fatal exception
Pid: 5955, comm: apache2 Tainted: G      D W  2.6.30-gentoo-r6 #1
Call Trace:
 [<c05c146d>] ? panic+0x42/0xeb
 [<c010b2b6>] ? oops_end+0x76/0xa0
 [<c010903f>] ? do_invalid_op+0x7f/0x90
 [<c011e6c9>] ? resched_task+0x69/0x70
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c010599f>] ? xen_sched_clock+0x1f/0x80
 [<c05c40e5>] ? error_code+0x6d/0x74
 [<c012007b>] ? sched_group_rt_runtime+0x3b/0x70
 [<c05c00d8>] ? wakeup_secondary_cpu_via_init+0xc8/0x234
 [<c0108fc0>] ? do_invalid_op+0x0/0x90
 [<c011e6c9>] ? resched_task+0x69/0x70
 [<c0125e40>] ? try_to_wake_up+0xa0/0x1d0
 [<c03a2020>] ? update_queue+0x80/0xb0
 [<c03a2683>] ? sys_semtimedop+0x3d3/0x6e0
 [<c0121000>] ? init_sched_build_groups+0xd0/0x130
 [<c01051d6>] ? __raw_callee_save_xen_save_fl+0x6/0x8
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0117235>] ? pvclock_clocksource_read+0x55/0xc0
 [<c0165f74>] ? find_get_page+0x24/0xb0
 [<c016631b>] ? find_lock_page+0x1b/0x70
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c0166954>] ? filemap_fault+0x124/0x400
 [<c0487953>] ? release_sock+0x13/0xa0
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c0104290>] ? xen_set_pte_at+0x80/0xf0
 [<c0178f81>] ? __do_fault+0x3b1/0x490
 [<c018cbcb>] ? fd_install+0x3b/0x50
 [<c0166830>] ? filemap_fault+0x0/0x400
 [<c017ae49>] ? handle_mm_fault+0x169/0x900
 [<c01051de>] ? __raw_callee_save_xen_restore_fl+0x6/0x8
 [<c05c3e3e>] ? _spin_unlock_irqrestore+0x1e/0x30
 [<c01babd2>] ? ep_scan_ready_list+0x142/0x150
 [<c05c3dd5>] ? _spin_lock+0x5/0x10
 [<c019b2a3>] ? set_close_on_exec+0x43/0x60
 [<c010bd54>] ? sys_ipc+0x74/0x2f0
 [<c01051ee>] ? __raw_callee_save_xen_irq_enable+0x6/0x8
 [<c0107d1c>] ? sysenter_past_esp+0x3d/0x63
 [<c0107d54>] ? sysenter_do_call+0x12/0x28
Rebooting in 3 seconds..</c0107d54></c0107d1c></c01051ee></c010bd54></c019b2a3></c05c3dd5></c01babd2></c05c3e3e></c01051de></c017ae49></c0166830></c018cbcb></c0178f81></c0104290></c01051de></c0487953></c0166954></c0166830></c016631b></c0165f74></c0117235></c0117235></c01051d6></c0121000></c03a2683></c03a2020></c0125e40></c011e6c9></c0108fc0></c05c00d8></c012007b></c05c40e5></c010599f></c0117235></c011e6c9></c010903f></c010b2b6></c05c146d></c011e6c9></c0107d54></c0107d1c></c01051ee></c010bd54></c019b2a3></c05c3dd5></c01babd2></c05c3e3e></c01051de></c017ae49></c0166830></c018cbcb></c0178f81></c0104290></c01051de></c0487953></c0166954></c0166830></c016631b></c0165f74></c0117235></c0117235></c01051d6></c0121000></c03a2683></c03a2020></c0125e40>

Migration did the trick.

BTW, Linode support was excellent as usual. My migration was ready literally a few minutes after I logged the ticket. I've never had such good customer support.

Linode Staff

Would you like fries with that shake?

Glad it worked out…

-Chris

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Log in to Reply
Community Code of Conduct