[lttng-dev] lttng Crash seen after stopping the traces.
Jonnavithula Sharma
sarmajprs at gmail.com
Tue Jul 30 05:39:40 EDT 2013
Sorry.Missed the attachment in previous mail.Enclosed here is the console
log for the crash with lttng-modules 2.2.1.
Regards,
Sarma j
On Tue, Jul 30, 2013 at 11:08 AM, Jonnavithula Sharma
<sarmajprs at gmail.com>wrote:
> Hi Jeremie,
>
> We tried with the latest version(2.2.1) of lttng-modules. We are able to
> reproduce the same crash with the same steps.
>
> Am i missing anything here?
>
> Regards,
> Sarma J
>
>
> On Mon, Jul 29, 2013 at 9:05 PM, Jérémie Galarneau <
> jeremie.galarneau at efficios.com> wrote:
>
>> Hi,
>>
>> Can you try to reproduce the problem with the latest version of
>> lttng-modules (v2.2.1)? There were some bug fixes to the ring buffer
>> that may correct your problem.
>>
>> Thanks for reporting,
>> Jérémie
>>
>> On Mon, Jul 29, 2013 at 9:45 AM, Jonnavithula Sharma
>> <sarmajprs at gmail.com> wrote:
>> > Hi
>> >
>> > We are currently running lttng on our CPE with 64 MB RAM.We are
>> observing a
>> > crash after stopping the traces and even if we leave our CPE for few min
>> > after starting the trace we are observing this crash.Please find the
>> > attachment for the crash log.
>> >
>> > Let us know if any one has faced this issue and your help is highly
>> > appreciated in resolving this issue.
>> >
>> >
>> > Regards,
>> > Sarma J
>> >
>> > _______________________________________________
>> > lttng-dev mailing list
>> > lttng-dev at lists.lttng.org
>> > http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
>> >
>>
>>
>>
>> --
>> Jérémie Galarneau
>> EfficiOS Inc.
>> http://www.efficios.com
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lttng.org/pipermail/lttng-dev/attachments/20130730/7d5c9ab2/attachment.html>
-------------- next part --------------
root at ltqcpe:~# lttng-sessiond -d -vvv
root at ltqcpe:~# lttng create trace
Session trace created.
Traces will be written in /root/lttng-traces/trace-20130722-185900
root at ltqcpe:~# lttng enable-channel ch -s trace -k
Kernel channel ch enabled for session trace
root at ltqcpe:~# lttng enable-event ev -s trace -k
Error: Event ev: Enable kernel event failed (channel channel0, session trace)
Warning: Some command(s) went wrong
root at ltqcpe:~# lttng enable-event ev -k sched_switch
Error: Event ev: Enable kernel event failed (channel channel0, session trace)
Warning: Some command(s) went wrong
root at ltqcpe:~# lttng enable-event sched_switch -k
kernel event sched_switch created in channel channel0
root at ltqcpe:~# lttng start
Tracing started for session trace
root at ltqcpe:~# ping 192.168.1.3
PING 192.168.1.3 (192.168.1.3): 56 data bytes
64 bytes from 192.168.1.3: seq=0 ttl=128 time=1.118 ms
64 bytes from 192.168.1.3: seq=1 ttl=128 time=0.505 ms
64 bytes from 192.168.1.3: seq=2 ttl=128 time=0.544 ms
64 bytes from 192.168.1.3: seq=3 ttl=128 time=0.529 ms
64 bytes from 192.168.1.3: seq=4 ttl=128 time=0.541 ms
--- 192.168.1.3 ping statistics ---
5 packets transmitted, 5 packets received, 0% packet loss
round-trip min/avg/max = 0.505/0.647/1.118 ms
root at ltqcpe:~# lttng stop
[ 202.270000] CPU 0 Unable to handle kernel paging request at virtual address ffff979c, epc == 871a979c, ra == 871a7fec
[ 202.270000] Oops[#1]:
[ 202.270000] Cpu 0
[ 202.270000] $ 0 : 00000000 77881e48 00000001 00000001
[ 202.270000] $ 4 : 871ad500 87211e60 80455e48 00000000
[ 202.270000] $ 8 : 80455e4c 00005f1c 00000000 00000004
[ 202.270000] $12 : 77881d40 00001000 00000000 00407948
[ 202.270000] $16 : 86511000 00000000 00000000 00001000
[ 202.270000] $20 : 00001000 00000010 80455e48 81104e6c
[ 202.270000] $24 : 00000000 871a979c
[ 202.270000] $28 : 87210000 87211d50 80500000 871a7fec
[ 202.270000] Hi : 0000024d
[ 202.270000] Lo : 0001e678
[ 202.270000] epc : 871a979c cleanup_module+0xfbc/0x18 [lttng_lib_ring_buffer]
[ 202.270000] Tainted: G O
[ 202.270000] ra : 871a7fec lib_ring_buffer_ioctl+0x530/0x560 [lttng_lib_ring_buffer]
[ 202.270000] Status: 1100fc03 KERNEL EXL IE
[ 202.270000] Cause : 00800008
[ 202.270000] BadVA : ffff979c
[ 202.270000] PrId : 00019556 (MIPS 34Kc)
[ 202.270000] Modules linked in: lttng_probe_workqueue(O) lttng_probe_udp(O) lttng_probe_timer(O) lttng_probe_statedump(O) lttng_probe_sock(O) lttng_probe_skb(O) lttng_probe_signal(O) lttng_probe_scsi(O) lttng_probe_sched(O) lttng_probe_rcu(O) lttng_probe_random(O) lttng_probe_printk(O) lttng_probe_power(O) lttng_probe_net(O) lttng_probe_napi(O) lttng_probe_module(O) lttng_probe_kmem(O) lttng_probe_jbd2(O) lttng_probe_irq(O) lttng_probe_gpio(O) lttng_probe_ext4(O) lttng_probe_compaction(O) lttng_probe_block(O) lttng_types(O) lttng_ring_buffer_metadata_mmap_client(O) lttng_ring_buffer_client_mmap_overwrite(O) lttng_ring_buffer_client_mmap_discard(O) lttng_ring_buffer_metadata_client(O) lttng_ring_buffer_client_overwrite(O) lttng_ring_buffer_client_discard(O) lttng_tracer(O) lttng_lib_ring_buffer(O) lttng_statedump(O)
[ 202.270000] Process lttng-consumerd (pid: 1965, threadinfo=87210000, task=8720b1d8, tls=77889970)
[ 202.270000] Stack : 00000000 00000000 00000000 871e377c 00000000 00001000 87137968 00000029
870d3080 8720b1d8 00000001 800b2704 8780e590 00000000 871ad400 8709b418
871e377c 00000029 77d19044 00000029 87137968 77d19044 00000029 8001ea88
51ed8173 32a9f880 00000004 00000000 00000003 00000017 00030001 00000016
00030001 00000003 00030000 00000001 00000001 879472c0 8757def4 871ad430
...
[ 202.270000] Call Trace:
[ 202.270000] [<800b2704>] handle_mm_fault+0xb0/0xd0
[ 202.270000] [<8001ea88>] do_page_fault+0x2f4/0x4dc
[ 202.270000] [<800c2ff4>] do_sync_read+0x94/0xe8
[ 202.270000] [<80177094>] security_file_permission+0xa4/0xcc
[ 202.270000] [<871a7de0>] lib_ring_buffer_ioctl+0x324/0x560 [lttng_lib_ring_buffer]
[ 202.270000] [<871a8094>] lib_ring_buffer_splice_read+0x78/0x104 [lttng_lib_ring_buffer]
[ 202.270000] [<800edaf8>] do_splice_to+0x4c/0xcc
[ 202.270000] [<800ef7fc>] sys_splice+0x554/0x5a4
[ 202.270000] [<800d49f4>] sys_ioctl+0x74/0xa4
[ 202.270000] [<800d675c>] sys_poll+0x94/0xf8
[ 202.270000] [<800041b0>] stack_done+0x20/0x44
[ 202.270000] [<8003f748>] sys_getcpu+0x0/0x70
[ 202.270000]
[ 202.270000]
Code: 00000000 87076a80 871af580 <871a979c> 871a979c 87165198 00000000 81102880 00000000
[ 202.550000] ---[ end trace e11574cecbc320a0 ]---
[ 202.560000] CPU 0 Unable to handle kernel paging request at virtual address ffff979c, epc == 871a979c, ra == 871a7fec
[ 202.570000] Oops[#2]:
[ 202.570000] Cpu 0
[ 202.570000] $ 0 : 00000000 77a81ef0 00000001 00000000
[ 202.570000] $ 4 : 871ad700 8720fe60 80455e48 00000000
[ 202.570000] $ 8 : 80455e4c 00005f1e 00000000 00000004
[ 202.570000] $12 : 77a81de8 00001000 00000000 00000002
[ 202.570000] $16 : 86622000 00000000 00000000 00001000
[ 202.570000] $20 : 00001000 00000001 80455e48 87b72394
[ 202.570000] $24 : 00000000 871a979c
[ 202.570000] $28 : 8720e000 8720fd50 80500000 871a7fec
[ 202.570000] Hi : 0000002f
[ 202.570000] Lo : 29845000
[ 202.570000] epc : 871a979c cleanup_module+0xfbc/0x18 [lttng_lib_ring_buffer]
[ 202.570000] Tainted: G D O
[ 202.570000] ra : 871a7fec lib_ring_buffer_ioctl+0x530/0x560 [lttng_lib_ring_buffer]
[ 202.570000] Status: 1100fc03 KERNEL EXL IE
[ 202.570000] Cause : 00800008
[ 202.570000] BadVA : ffff979c
[ 202.570000] PrId : 00019556 (MIPS 34Kc)
[ 202.570000] Modules linked in: lttng_probe_workqueue(O) lttng_probe_udp(O) lttng_probe_timer(O) lttng_probe_statedump(O) lttng_probe_sock(O) lttng_probe_skb(O) lttng_probe_signal(O) lttng_probe_scsi(O) lttng_probe_sched(O) lttng_probe_rcu(O) lttng_probe_random(O) lttng_probe_printk(O) lttng_probe_power(O) lttng_probe_net(O) lttng_probe_napi(O) lttng_probe_module(O) lttng_probe_kmem(O) lttng_probe_jbd2(O) lttng_probe_irq(O) lttng_probe_gpio(O) lttng_probe_ext4(O) lttng_probe_compaction(O) lttng_probe_block(O) lttng_types(O) lttng_ring_buffer_metadata_mmap_client(O) lttng_ring_buffer_client_mmap_overwrite(O) lttng_ring_buffer_client_mmap_discard(O) lttng_ring_buffer_metadata_client(O) lttng_ring_buffer_client_overwrite(O) lttng_ring_buffer_client_discard(O) lttng_tracer(O) lttng_lib_ring_buffer(O) lttng_statedump(O)
[ 202.570000] Process lttng-consumerd (pid: 1964, threadinfo=8720e000, task=8720b608, tls=77a89970)
[ 202.570000] Stack : 00000000 8320fd54 870d30b8 871e3778 00000000 00001000 8718bee8 00000029
870d3080 8720b608 00000001 800b2704 87126400 80002420 871ad600 871fee00
871e3778 00000029 77a825b4 00000029 8718bee8 77a825b4 00000029 8001ea88
0000001b 00000000 009d6000 871e2f0c 8720ffe0 0000fc00 00000000 00000001
00000025 00000002 00000000 00000002 871e2f0c 8720fe98 00000000 009d5ff8
...
[ 202.570000] Call Trace:
[ 202.570000] [<800b2704>] handle_mm_fault+0xb0/0xd0
[ 202.570000] [<80002420>] ret_from_exception+0x0/0x10
[ 202.570000] [<8001ea88>] do_page_fault+0x2f4/0x4dc
[ 202.570000] [<8005965c>] dequeue_task_fair+0x0/0x12c
[ 202.570000] [<801016ac>] ep_send_events_proc+0x94/0x16c
[ 202.570000] [<80177094>] security_file_permission+0xa4/0xcc
[ 202.570000] [<871a7de0>] lib_ring_buffer_ioctl+0x324/0x560 [lttng_lib_ring_buffer]
[ 202.570000] [<871a8094>] lib_ring_buffer_splice_read+0x78/0x104 [lttng_lib_ring_buffer]
[ 202.570000] [<800edaf8>] do_splice_to+0x4c/0xcc
[ 202.570000] [<80103070>] sys_epoll_wait+0x30c/0x3ac
[ 202.570000] [<80102d10>] sys_epoll_ctl+0x82c/0x880
[ 202.570000] [<800ef7fc>] sys_splice+0x554/0x5a4
[ 202.570000] [<80056d0c>] default_wake_function+0x0/0x8
[ 202.570000] [<800d49f4>] sys_ioctl+0x74/0xa4
[ 202.570000] [<800041b0>] stack_done+0x20/0x44
[ 202.570000]
[ 202.570000]
Code: 00000000 87076a80 871af580 <871a979c> 871a979c 87165198 00000000 81102880 00000000
[ 202.860000] ---[ end trace e11574cecbc320a1 ]---
More information about the lttng-dev
mailing list