[lttng-dev] LTTng Module Kernel Oops

Mathieu Desnoyers mathieu.desnoyers at efficios.com
Thu Apr 12 10:15:43 EDT 2012


* Ryan.Kyser at jci.com (Ryan.Kyser at jci.com) wrote:
> I am getting the following kernel oops almost every time I start tracing 
> or event just enable events. Any ideas on how to narrow down this problem 
> further?

Are there some particular events that are causing this when you enable
them ?

Having your .config would be helpful.

Also, I've seen something similar caused by THUMB2 support, and the fact
that we use kallsyms to lookup symbol names. So it might or might not be
related (we have fixed it since then).

Adding some printk into the lttng-modules code to narrow down where the
oops occurs might help, as the backtrace does not seem to point anywhere
interesting.

Thanks,

Mathieu

> 
> [  136.167157] Internal error: Oops - undefined instruction: 0 [#1] 
> PREEMPT SMP
> [  136.174214] last sysfs file: /sys/bus/platform/drivers/fec/uevent
> [  136.180312] Modules linked in: lttng_probe_timer lttng_probe_statedump 
> lttng_probe_signal lttng_probe_sched lttng_probe_irq lttng_probe_block 
> lttng_types lttng_probe_lttng lttng_ring_buffer_metadata_mmap_client 
> lttng_ring_buffer_client_mmap_overwrite 
> lttng_ring_buffer_client_mmap_discard lttng_ring_buffer_metadata_client 
> lttng_ring_buffer_client_overwrite lttng_ring_buffer_client_discard 
> lttng_tracer lttng_ftrace lttng_statedump lttng_lib_ring_buffer 
> lttng_kprobes lttng_kretprobes fec serport mchpar1xxx serio evdev galcore
> [  136.226984] CPU: 0    Not tainted  (2.6.38 #1)
> [  136.231439] PC is at cpu_idle+0x70/0xb0
> [  136.235283] LR is at arch_idle+0x9c/0xb8
> [  136.239213] pc : [<80044710>]    lr : [<8004e7f8>]    psr: 60000013
> [  136.239218] sp : 803ebf88  ip : 803ebf60  fp : 803ebfa4
> [  136.250707] r10: 00000000  r9 : 412fc09a  r8 : 810e2100
> [  136.255937] r7 : 8002b89c  r6 : 804216e4  r5 : 80400854  r4 : 803ea000
> [  136.262468] r3 : 60000013  r2 : 803ebf60  r1 : 00000002  r0 : 00000010
> [  136.269001] Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM Segment 
> kernel
> [  136.276316] Control: 10c53c7d  Table: 6c11404a  DAC: 00000015
> [  136.282067] Process swapper (pid: 0, stack limit = 0x803ea2f0)
> [  136.287904] Stack: (0x803ebf88 to 0x803ec000)
> [  136.292268] bf80:                   00000001 803ea000 80421640 803fb980 
> 803ebfbc 803ebfa8
> [  136.300453] bfa0: 8030e1f4 800446ac 8002bf88 803fc074 803ebff4 803ebfc0 
> 800089f8 8030e16c
> [  136.308637] bfc0: 80008384 00000000 00000000 8002b89c 00000000 10c53c7d 
> 803fb9d0 8002b898
> [  136.316821] bfe0: 8040084c 10000000 00000000 803ebff8 1000803c 8000875c 
> 00000000 00000000
> [  136.325001] Backtrace:
> [  136.327472] [<800446a0>] (cpu_idle+0x0/0xb0) from [<8030e1f4>] 
> (rest_init+0x94/0xac)
> [  136.335219]  r6:803fb980 r5:80421640 r4:803ea000 r3:00000001
> [  136.340941] [<8030e160>] (rest_init+0x0/0xac) from [<800089f8>] 
> (start_kernel+0x2a8/0x304)
> [  136.349208]  r4:803fc074 r3:8002bf88
> [  136.352824] [<80008750>] (start_kernel+0x0/0x304) from [<1000803c>] 
> (0x1000803c)
> [  136.360223]  r8:10000000 r7:8040084c r6:8002b898 r5:803fb9d0 
> r4:10c53c7d
> [  136.366996] Code: 0a000002 e59f0040 e3a010ce eb009010 (f1080080)
> [  136.373253] ---[ end trace 04a97301dfea50bf ]---
> [  136.377910] Kernel panic - not syncing: Attempted to kill the idle 
> task!
> [  136.384615] Backtrace:
> [  136.387095] [<800479a8>] (dump_backtrace+0x0/0x114) from [<803129f0>] 
> (dump_stack+0x20/0x24)
> [  136.395568]  r6:803ea000 r5:0000000b r4:80422550 r3:00000002
> [  136.401319] [<803129d0>] (dump_stack+0x0/0x24) from [<80312a70>] 
> (panic+0x7c/0x19c)
> [  136.409021] [<803129f4>] (panic+0x0/0x19c) from [<8006bba4>] 
> (do_exit+0x70/0x680)
> [  136.416507]  r3:00000000 r2:803ebdd0 r1:803ebda0 r0:803a6268
> [  136.422252]  r7:00000000
> [  136.424807] [<8006bb34>] (do_exit+0x0/0x680) from [<80047e28>] 
> (die+0x278/0x2b4)
> [  136.432236]  r7:00000000
> [  136.434792] [<80047bb0>] (die+0x0/0x2b4) from [<80047ec0>] 
> (arm_notify_die+0x5c/0x60)
> [  136.442670] [<80047e64>] (arm_notify_die+0x0/0x60) from [<8003e120>] 
> (do_undefinstr+0x120/0x138)
> [  136.451503] [<8003e000>] (do_undefinstr+0x0/0x138) from [<803164e4>] 
> (__und_svc+0x44/0x60)
> [  136.459826] Exception stack(0x803ebf00 to 0x803ebf48)
> [  136.464885] bf00: 00000010 00000002 803ebf60 60000013 803ea000 80400854 
> 804216e4 8002b89c
> [  136.473104] bf20: 810e2100 412fc09a 00000000 803ebfa4 803ebf60 803ebf88 
> 8004e7f8 80044710
> [  136.481316] bf40: 60000013 ffffffff
> [  136.484807]  r7:00000000 r6:80316814 r5:803ebf34 r4:ffffffff
> [  136.490556] [<800446a0>] (cpu_idle+0x0/0xb0) from [<8030e1f4>] 
> (rest_init+0x94/0xac)
> [  136.498333]  r6:803fb980 r5:80421640 r4:803ea000 r3:00000001
> [  136.504052] [<8030e160>] (rest_init+0x0/0xac) from [<800089f8>] 
> (start_kernel+0x2a8/0x304)
> [  136.512352]  r4:803fc074 r3:8002bf88
> [  136.515961] [<80008750>] (start_kernel+0x0/0x304) from [<1000803c>] 
> (0x1000803c)
> [  136.523390]  r8:10000000 r7:8040084c r6:8002b898 r5:803fb9d0 
> r4:10c53c7d
> [  136.530195] CPU1: stopping
> [  136.532904] Backtrace:
> [  136.535375] [<800479a8>] (dump_backtrace+0x0/0x114) from [<803129f0>] 
> (dump_stack+0x20/0x24)
> [  136.543817]  r6:00000006 r5:00000001 r4:00000000 r3:00000000
> [  136.549537] [<803129d0>] (dump_stack+0x0/0x24) from [<8003e454>] 
> (do_IPI+0xf4/0x164)
> [  136.557293] [<8003e360>] (do_IPI+0x0/0x164) from [<8031640c>] 
> (__irq_svc+0x4c/0xc0)
> [  136.564953] Exception stack(0xe1f03f60 to 0xe1f03fa8)
> [  136.570011] 3f60: 00000002 00000002 e1f03f90 00000000 e1f02000 80400854 
> 804216e4 804217e4
> [  136.578195] 3f80: 70000000 412fc09a 00000000 e1f03fb4 e1f03f90 e1f03fa8 
> 8004e800 8004451c
> [  136.586376] 3fa0: 20000013 ffffffff
> [  136.589865]  r5:f2a00100 r4:ffffffff
> [  136.593472] [<800444e8>] (default_idle+0x0/0x38) from [<800446f8>] 
> (cpu_idle+0x58/0xb0)
> [  136.601488] [<800446a0>] (cpu_idle+0x0/0xb0) from [<80026724>] 
> (secondary_start_kernel+0x134/0x150)
> [  136.610537]  r6:e1f02000 r5:00000001 r4:8040a12c r3:00000002
> [  136.616256] [<800265f0>] (secondary_start_kernel+0x0/0x150) from 
> [<100260ac>] (0x100260ac)
> [  136.624523]  r6:10c03c7d r5:00000015 r4:71f0406a r3:80026094
> 
> 
> Thank you,
> Ryan Kyser
> 
> 
> _______________________________________________
> lttng-dev mailing list
> lttng-dev at lists.lttng.org
> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev

-- 
Mathieu Desnoyers
Operating System Efficiency R&D Consultant
EfficiOS Inc.
http://www.efficios.com



More information about the lttng-dev mailing list