[lttng-dev] LTTng Module Kernel Oops

Mathieu Desnoyers mathieu.desnoyers at efficios.com
Tue Apr 17 10:07:00 EDT 2012


* Mathieu Desnoyers (mathieu.desnoyers at efficios.com) wrote:
> * Ryan.Kyser at jci.com (Ryan.Kyser at jci.com) wrote:
> > I am getting the following kernel oops almost every time I start tracing 
> > or event just enable events. Any ideas on how to narrow down this problem 
> > further?
> 
> Are there some particular events that are causing this when you enable
> them ?
> 
> Having your .config would be helpful.
> 
> Also, I've seen something similar caused by THUMB2 support, and the fact
> that we use kallsyms to lookup symbol names. So it might or might not be
> related (we have fixed it since then).
> 
> Adding some printk into the lttng-modules code to narrow down where the
> oops occurs might help, as the backtrace does not seem to point anywhere
> interesting.

For the records, Ryan told me in a private email that the source of the
OOPS does not appear to be LTTng.

Thanks,

Mathieu

> 
> Thanks,
> 
> Mathieu
> 
> > 
> > [  136.167157] Internal error: Oops - undefined instruction: 0 [#1] 
> > PREEMPT SMP
> > [  136.174214] last sysfs file: /sys/bus/platform/drivers/fec/uevent
> > [  136.180312] Modules linked in: lttng_probe_timer lttng_probe_statedump 
> > lttng_probe_signal lttng_probe_sched lttng_probe_irq lttng_probe_block 
> > lttng_types lttng_probe_lttng lttng_ring_buffer_metadata_mmap_client 
> > lttng_ring_buffer_client_mmap_overwrite 
> > lttng_ring_buffer_client_mmap_discard lttng_ring_buffer_metadata_client 
> > lttng_ring_buffer_client_overwrite lttng_ring_buffer_client_discard 
> > lttng_tracer lttng_ftrace lttng_statedump lttng_lib_ring_buffer 
> > lttng_kprobes lttng_kretprobes fec serport mchpar1xxx serio evdev galcore
> > [  136.226984] CPU: 0    Not tainted  (2.6.38 #1)
> > [  136.231439] PC is at cpu_idle+0x70/0xb0
> > [  136.235283] LR is at arch_idle+0x9c/0xb8
> > [  136.239213] pc : [<80044710>]    lr : [<8004e7f8>]    psr: 60000013
> > [  136.239218] sp : 803ebf88  ip : 803ebf60  fp : 803ebfa4
> > [  136.250707] r10: 00000000  r9 : 412fc09a  r8 : 810e2100
> > [  136.255937] r7 : 8002b89c  r6 : 804216e4  r5 : 80400854  r4 : 803ea000
> > [  136.262468] r3 : 60000013  r2 : 803ebf60  r1 : 00000002  r0 : 00000010
> > [  136.269001] Flags: nZCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM Segment 
> > kernel
> > [  136.276316] Control: 10c53c7d  Table: 6c11404a  DAC: 00000015
> > [  136.282067] Process swapper (pid: 0, stack limit = 0x803ea2f0)
> > [  136.287904] Stack: (0x803ebf88 to 0x803ec000)
> > [  136.292268] bf80:                   00000001 803ea000 80421640 803fb980 
> > 803ebfbc 803ebfa8
> > [  136.300453] bfa0: 8030e1f4 800446ac 8002bf88 803fc074 803ebff4 803ebfc0 
> > 800089f8 8030e16c
> > [  136.308637] bfc0: 80008384 00000000 00000000 8002b89c 00000000 10c53c7d 
> > 803fb9d0 8002b898
> > [  136.316821] bfe0: 8040084c 10000000 00000000 803ebff8 1000803c 8000875c 
> > 00000000 00000000
> > [  136.325001] Backtrace:
> > [  136.327472] [<800446a0>] (cpu_idle+0x0/0xb0) from [<8030e1f4>] 
> > (rest_init+0x94/0xac)
> > [  136.335219]  r6:803fb980 r5:80421640 r4:803ea000 r3:00000001
> > [  136.340941] [<8030e160>] (rest_init+0x0/0xac) from [<800089f8>] 
> > (start_kernel+0x2a8/0x304)
> > [  136.349208]  r4:803fc074 r3:8002bf88
> > [  136.352824] [<80008750>] (start_kernel+0x0/0x304) from [<1000803c>] 
> > (0x1000803c)
> > [  136.360223]  r8:10000000 r7:8040084c r6:8002b898 r5:803fb9d0 
> > r4:10c53c7d
> > [  136.366996] Code: 0a000002 e59f0040 e3a010ce eb009010 (f1080080)
> > [  136.373253] ---[ end trace 04a97301dfea50bf ]---
> > [  136.377910] Kernel panic - not syncing: Attempted to kill the idle 
> > task!
> > [  136.384615] Backtrace:
> > [  136.387095] [<800479a8>] (dump_backtrace+0x0/0x114) from [<803129f0>] 
> > (dump_stack+0x20/0x24)
> > [  136.395568]  r6:803ea000 r5:0000000b r4:80422550 r3:00000002
> > [  136.401319] [<803129d0>] (dump_stack+0x0/0x24) from [<80312a70>] 
> > (panic+0x7c/0x19c)
> > [  136.409021] [<803129f4>] (panic+0x0/0x19c) from [<8006bba4>] 
> > (do_exit+0x70/0x680)
> > [  136.416507]  r3:00000000 r2:803ebdd0 r1:803ebda0 r0:803a6268
> > [  136.422252]  r7:00000000
> > [  136.424807] [<8006bb34>] (do_exit+0x0/0x680) from [<80047e28>] 
> > (die+0x278/0x2b4)
> > [  136.432236]  r7:00000000
> > [  136.434792] [<80047bb0>] (die+0x0/0x2b4) from [<80047ec0>] 
> > (arm_notify_die+0x5c/0x60)
> > [  136.442670] [<80047e64>] (arm_notify_die+0x0/0x60) from [<8003e120>] 
> > (do_undefinstr+0x120/0x138)
> > [  136.451503] [<8003e000>] (do_undefinstr+0x0/0x138) from [<803164e4>] 
> > (__und_svc+0x44/0x60)
> > [  136.459826] Exception stack(0x803ebf00 to 0x803ebf48)
> > [  136.464885] bf00: 00000010 00000002 803ebf60 60000013 803ea000 80400854 
> > 804216e4 8002b89c
> > [  136.473104] bf20: 810e2100 412fc09a 00000000 803ebfa4 803ebf60 803ebf88 
> > 8004e7f8 80044710
> > [  136.481316] bf40: 60000013 ffffffff
> > [  136.484807]  r7:00000000 r6:80316814 r5:803ebf34 r4:ffffffff
> > [  136.490556] [<800446a0>] (cpu_idle+0x0/0xb0) from [<8030e1f4>] 
> > (rest_init+0x94/0xac)
> > [  136.498333]  r6:803fb980 r5:80421640 r4:803ea000 r3:00000001
> > [  136.504052] [<8030e160>] (rest_init+0x0/0xac) from [<800089f8>] 
> > (start_kernel+0x2a8/0x304)
> > [  136.512352]  r4:803fc074 r3:8002bf88
> > [  136.515961] [<80008750>] (start_kernel+0x0/0x304) from [<1000803c>] 
> > (0x1000803c)
> > [  136.523390]  r8:10000000 r7:8040084c r6:8002b898 r5:803fb9d0 
> > r4:10c53c7d
> > [  136.530195] CPU1: stopping
> > [  136.532904] Backtrace:
> > [  136.535375] [<800479a8>] (dump_backtrace+0x0/0x114) from [<803129f0>] 
> > (dump_stack+0x20/0x24)
> > [  136.543817]  r6:00000006 r5:00000001 r4:00000000 r3:00000000
> > [  136.549537] [<803129d0>] (dump_stack+0x0/0x24) from [<8003e454>] 
> > (do_IPI+0xf4/0x164)
> > [  136.557293] [<8003e360>] (do_IPI+0x0/0x164) from [<8031640c>] 
> > (__irq_svc+0x4c/0xc0)
> > [  136.564953] Exception stack(0xe1f03f60 to 0xe1f03fa8)
> > [  136.570011] 3f60: 00000002 00000002 e1f03f90 00000000 e1f02000 80400854 
> > 804216e4 804217e4
> > [  136.578195] 3f80: 70000000 412fc09a 00000000 e1f03fb4 e1f03f90 e1f03fa8 
> > 8004e800 8004451c
> > [  136.586376] 3fa0: 20000013 ffffffff
> > [  136.589865]  r5:f2a00100 r4:ffffffff
> > [  136.593472] [<800444e8>] (default_idle+0x0/0x38) from [<800446f8>] 
> > (cpu_idle+0x58/0xb0)
> > [  136.601488] [<800446a0>] (cpu_idle+0x0/0xb0) from [<80026724>] 
> > (secondary_start_kernel+0x134/0x150)
> > [  136.610537]  r6:e1f02000 r5:00000001 r4:8040a12c r3:00000002
> > [  136.616256] [<800265f0>] (secondary_start_kernel+0x0/0x150) from 
> > [<100260ac>] (0x100260ac)
> > [  136.624523]  r6:10c03c7d r5:00000015 r4:71f0406a r3:80026094
> > 
> > 
> > Thank you,
> > Ryan Kyser
> > 
> > 
> > _______________________________________________
> > lttng-dev mailing list
> > lttng-dev at lists.lttng.org
> > http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
> 
> -- 
> Mathieu Desnoyers
> Operating System Efficiency R&D Consultant
> EfficiOS Inc.
> http://www.efficios.com

-- 
Mathieu Desnoyers
Operating System Efficiency R&D Consultant
EfficiOS Inc.
http://www.efficios.com



More information about the lttng-dev mailing list