[lttng-dev] make a trace_event in a module (driver)

Mon Dec 2 15:56:54 EST 2013

On Tue, Nov 26, 2013 at 12:32 PM, Klaus Dannecker
<klaus.dannecker at gmx.de> wrote:
>
> Am 25.11.2013 20:22, schrieb Thibault, Daniel:
>
>>> Date: Mon, 25 Nov 2013 12:00:14 -0500
>>> From: J?r?mie Galarneau <jeremie.galarneau at efficios.com>
>>>>
>>>>     Aha!  There is one crucial mistake in the ibm.com document: he
>>>> installs the packages in the wrong order.  lttng-tools must be installed
>>>> AFTER lttng-modules and lttng-ust.  lttng-modules can be installed before,
>>>> during or after lttng-ust, but userspace-rcu must be installed before
>>>> lttng-ust.
>>>>     The problem is that the configure of lttng-tools detects the
>>>> presence or absence of lttng-modules and also detects the presence or
>>>> absence of lttng-ust, and adjusts to both.  By installing lttng-tools before
>>>> lttng-modules, you've built an lttng-tools set that CANNOT be used to trace
>>>> the kernel.
>>>>
>>>>     So, try again from scratch, making sure to install lttng-tools last.
>>>
>>> lttng-tools checks for kernel modules at run time, not at configure time.
>>> You can safely install lttng-modules after lttng-tools and still use kernel
>>> tracing.
>>>
>>> Regards,
>>> Jérémie
>>
>>     Dang, you're right.  The build of lttng-tools reacts to the presence
>> or absence of lttng-ust, but is indifferent to the presence or absence of
>> lttng-modules.  (Only liblttng-ctl.a is different, probably some internal
>> timestamps or some such)
>>
>>> klaus at ubuntu:~$ sudo lttng -vvv start
>>> DEBUG2 [2854/2854]: Config file path found: /home/klaus (in
>>> get_session_name() at utils.c:57)
>>> DEBUG1 [2854/2854]: Session name found: auto-20131124-091639 (in
>>> get_session_name() at utils.c:58)
>>> DEBUG1 [2854/2854]: Starting tracing for session auto-20131124-091639 (in
>>> start_tracing() at commands/start.c:81)
>>> DEBUG1 [2854/2854]: LSM cmd type : 16 (in send_session_msg() at
>>> lttng-ctl.c:131)
>>> 'ctrl c'
>>> klaus at ubuntu:~$
>>
>>     Let's try to identify the module responsible.  First, make sure
>> lttng-sessiond is NOT running.  Then, do this in one shell:
>>
>> $ sudo -H lttng-sessiond -vvv
>>
>>     It should fail after loading one of the modules.
>>
>>     You can also try:
>>
>> $ sudo -H lttng-sessiond -vvv --no-kernel
>>
>>     In which case you should be able to do any lttng command except those
>> involving the kernel.  For example, 'lttng list -u'.
>
> here the output:
> klaus at ubuntu:~$ sudo -H lttng-sessiond -vvv
> [sudo] password for klaus:
> DEBUG3 [2643/2643]: Creating LTTng run directory: /var/run/lttng (in
> create_lttng_rundir() at main.c:4267)
> DEBUG2 [2643/2643]: Kernel consumer err path:
> /var/run/lttng/kconsumerd/error (in main() at main.c:4708)
> DEBUG2 [2643/2643]: Kernel consumer cmd path:
> /var/run/lttng/kconsumerd/command (in main() at main.c:4710)
> DEBUG1 [2643/2643]: Client socket path /var/run/lttng/client-lttng-sessiond
> (in main() at main.c:4763)
> DEBUG1 [2643/2643]: Application socket path /var/run/lttng/lttng-ust-sock-5
> (in main() at main.c:4764)
> DEBUG1 [2643/2643]: Application wait path /lttng-ust-wait-5 (in main() at
> main.c:4765)
> DEBUG1 [2643/2643]: LTTng run directory path: /var/run/lttng (in main() at
> main.c:4766)
> DEBUG2 [2643/2643]: UST consumer 32 bits err path:
> /var/run/lttng/ustconsumerd32/error (in main() at main.c:4775)
> DEBUG2 [2643/2643]: UST consumer 32 bits cmd path:
> /var/run/lttng/ustconsumerd32/command (in main() at main.c:4777)
> DEBUG2 [2643/2643]: UST consumer 64 bits err path:
> /var/run/lttng/ustconsumerd64/error (in main() at main.c:4786)
> DEBUG2 [2643/2643]: UST consumer 64 bits cmd path:
> /var/run/lttng/ustconsumerd64/command (in main() at main.c:4788)
> DEBUG3 [2643/2643]: Created hashtable size 4 at 0x9355080 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG3 [2643/2643]: Created hashtable size 4 at 0x9355270 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG3 [2643/2643]: Created hashtable size 4 at 0x9355498 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG3 [2643/2643]: Created hashtable size 4 at 0x93556c0 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG2 [2643/2643]: Creating consumer directory: /var/run/lttng/kconsumerd
> (in set_consumer_sockets() at main.c:4309)
> Warning: No tracing group detected
> DEBUG1 [2643/2643]: Modprobe successfully lttng-tracer (in
> modprobe_lttng_control() at modprobe.c:192)
> DEBUG2 [2643/2643]: Kernel tracer version validated (major version 2) (in
> kernel_validate_version() at kernel.c:700)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-ftrace (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-kprobes (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-kretprobes (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-lib-ring-buffer (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-ring-buffer-client-discard
> (in modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-ring-buffer-client-overwrite
> (in modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-ring-buffer-metadata-client
> (in modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully
> lttng-ring-buffer-client-mmap-discard (in modprobe_lttng_data() at
> modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully
> lttng-ring-buffer-client-mmap-overwrite (in modprobe_lttng_data() at
> modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully
> lttng-ring-buffer-metadata-mmap-client (in modprobe_lttng_data() at
> modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-types (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-asoc (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-block (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-btrfs (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-compaction (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-ext3 (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-ext4 (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-gpio (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-irq (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-jbd (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-jbd2 (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-kmem (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-kvm (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-kvm-x86 (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-kvm-x86-mmu (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-lock (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-module (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-napi (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-net (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-power (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-printk (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-random (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-rcu (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-regmap (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-regulator (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-rpm (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-sched (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-scsi (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-signal (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-skb (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-sock (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-statedump (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-sunrpc (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-timer (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-udp (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-vmscan (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-workqueue (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Modprobe successfully lttng-probe-writeback (in
> modprobe_lttng_data() at modprobe.c:228)
> DEBUG1 [2643/2643]: Kernel tracer fd 6 (in init_kernel_tracer() at
> main.c:2364)
> DEBUG2 [2643/2643]: Creating consumer directory:
> /var/run/lttng/ustconsumerd64 (in set_consumer_sockets() at main.c:4309)
> DEBUG2 [2643/2643]: Creating consumer directory:
> /var/run/lttng/ustconsumerd32 (in set_consumer_sockets() at main.c:4309)
> DEBUG3 [2643/2643]: Session daemon client socket 9 and application socket 10
> created (in init_daemon_socket() at main.c:4175)
> DEBUG1 [2643/2643]: All permissions are set (in set_permissions() at
> main.c:4255)
> DEBUG3 [2643/2643]: Created hashtable size 4 at 0x9357148 of type 2 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG3 [2643/2643]: Global buffer per UID registry initialized (in
> buffer_reg_init_uid_registry() at buffer-registry.c:99)
> DEBUG3 [2643/2643]: Created hashtable size 4 at 0x9357370 of type 2 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG3 [2643/2643]: Global buffer per PID registry initialized (in
> buffer_reg_init_pid_registry() at buffer-registry.c:220)
> DEBUG1 [2643/2643]: epoll set max size is 327869 (in
> compat_epoll_set_max_size() at compat-epoll.c:280)
> DEBUG1 [2643/2643]: Command subsystem initialized (in cmd_init() at
> cmd.c:3056)
> DEBUG1 [2643/2643]: Pid 2643 written in file
> /var/run/lttng/lttng-sessiond.pid (in utils_create_pid_file() at
> utils.c:437)
> DEBUG1 [2643/2643]: Pid 5345 written in file /var/run/lttng/jul.port (in
> utils_create_pid_file() at utils.c:437)
> DEBUG1 [2643/2643]: TCP inet operation timeout set to 216 sec (in
> lttcomm_inet_init() at inet.c:529)
> DEBUG1 [2643/2643]: Health check time delta in seconds set to 236 (in
> health_init() at health.c:73)
> DEBUG1 [2643/2743]: [thread] Manage health check started (in
> thread_manage_health() at main.c:3511)
> DEBUG1 [2643/2744]: [thread] Manage client started (in
> thread_manage_clients() at main.c:3695)
> DEBUG1 [2643/2745]: [thread] Dispatch UST command started (in
> thread_dispatch_ust_registration() at main.c:1543)
> DEBUG1 [2643/2747]: [thread] Manage application started (in
> thread_manage_apps() at main.c:1256)
> DEBUG1 [2643/2746]: [thread] Manage application registration started (in
> thread_registration_apps() at main.c:1766)
> DEBUG1 [2643/2742]: [ht-thread] startup. (in thread_ht_cleanup() at
> ht-cleanup.c:35)
> DEBUG3 [2643/2742]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at
> ht-cleanup.c:59)
> DEBUG1 [2643/2746]: Notifying applications of session daemon state: 1 (in
> notify_ust_apps() at main.c:593)
> DEBUG1 [2643/2746]: Got the wait shm fd 24 (in get_wait_shm() at shm.c:115)
> DEBUG1 [2643/2746]: Futex wait update active 1 (in futex_wait_update() at
> futex.c:63)
> DEBUG1 [2643/2744]: Accepting client command ... (in thread_manage_clients()
> at main.c:3747)
> DEBUG1 [2643/2743]: Health check ready (in thread_manage_health() at
> main.c:3574)
> DEBUG1 [2643/2746]: Accepting application registration (in
> thread_registration_apps() at main.c:1803)
> DEBUG1 [2643/2749]: [jul-thread] Manage JUL application registration. (in
> jul_thread_manage_registration() at jul-thread.c:250)
> DEBUG3 [2643/2749]: URI string: tcp://localhost (in uri_parse() at
> uri.c:291)
> DEBUG1 [2643/2748]: [ust-thread] Manage application notify command (in
> ust_thread_manage_notify() at ust-thread.c:38)
> DEBUG3 [2643/2748]: [ust-thread] Manage notify polling on 2 fds (in
> ust_thread_manage_notify() at ust-thread.c:63)
> DEBUG2 [2643/2749]: IP address resolved to 127.0.0.1 (in set_ip_address() at
> uri.c:132)
> DEBUG1 [2643/2745]: Futex n to 1 prepare done (in futex_nto1_prepare() at
> futex.c:75)
> DEBUG1 [2643/2745]: Woken up but nothing in the UST command queue (in
> thread_dispatch_ust_registration() at main.c:1566)
> DEBUG1 [2643/2747]: Apps thread polling on 2 fds (in thread_manage_apps() at
> main.c:1286)
> DEBUG1 [2643/2750]: [thread] Thread manage kernel started (in
> thread_manage_kernel() at main.c:794)
> DEBUG1 [2643/2750]: Updating kernel poll set (in update_kernel_poll() at
> main.c:654)
> DEBUG1 [2643/2750]: Thread kernel polling on 2 fds (in
> thread_manage_kernel() at main.c:839)
> DEBUG3 [2643/2749]: URI dtype: 1, proto: 1, host: localhost, subdir: , ctrl:
> 0, data: 0 (in uri_parse() at uri.c:505)
> DEBUG1 [2643/2749]: [jul-thread] Listening on TCP port 5345 and socket 28
> (in init_tcp_socket() at jul-thread.c:153)
> DEBUG3 [2643/2749]: [jul-thread] Manage JUL polling on 2 fds (in
> jul_thread_manage_registration() at jul-thread.c:278)
>
> ---Terminal 2
> klaus at ubuntu:~$ sudo lttng create
> [sudo] password for klaus:
> Session auto-20131126-090721 created.
> Traces will be written in /home/klaus/lttng-traces/auto-20131126-090721
> ---
>
>
> DEBUG1 [2643/2744]: Wait for client response (in thread_manage_clients() at
> main.c:3789)
> DEBUG1 [2643/2744]: Receiving data from client ... (in
> thread_manage_clients() at main.c:3834)
> DEBUG1 [2643/2744]: Nothing recv() from client... continuing (in
> thread_manage_clients() at main.c:3838)
> DEBUG1 [2643/2744]: Clean command context structure (in clean_command_ctx()
> at main.c:573)
> DEBUG1 [2643/2744]: Accepting client command ... (in thread_manage_clients()
> at main.c:3747)
> DEBUG1 [2643/2744]: Wait for client response (in thread_manage_clients() at
> main.c:3789)
> DEBUG1 [2643/2744]: Receiving data from client ... (in
> thread_manage_clients() at main.c:3834)
> DEBUG1 [2643/2744]: Processing client command 8 (in process_client_msg() at
> main.c:2603)
> DEBUG1 [2643/2744]: Waiting for 1 URIs from client ... (in
> process_client_msg() at main.c:3167)
> DEBUG2 [2643/2744]: Trying to find session by name auto-20131126-090721 (in
> session_find_by_name() at session.c:133)
> DEBUG3 [2643/2744]: Created hashtable size 4 at 0xb3305a28 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG1 [2643/2744]: Tracing session auto-20131126-090721 created with ID 0
> by UID 0 GID 0 (in session_create() at session.c:234)
> DEBUG2 [2643/2744]: Trying to find session by name auto-20131126-090721 (in
> session_find_by_name() at session.c:133)
> DEBUG3 [2643/2744]: Created hashtable size 4 at 0xb330aca0 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG2 [2643/2744]: Setting trace directory path from URI to
> /home/klaus/lttng-traces/auto-20131126-090721 (in add_uri_to_consumer() at
> cmd.c:481)
> DEBUG1 [2643/2744]: Sending response (size: 16, retcode: Success) (in
> thread_manage_clients() at main.c:3883)
> DEBUG1 [2643/2744]: Clean command context structure (in clean_command_ctx()
> at main.c:573)
> DEBUG1 [2643/2744]: Accepting client command ... (in thread_manage_clients()
> at main.c:3747)
>
> ---Terminal 2
> klaus at ubuntu:~$ sudo lttng enable-event -k -a
> All Kernel events are enabled in channel channel0
> ---
>
>
> DEBUG1 [2643/2744]: Wait for client response (in thread_manage_clients() at
> main.c:3789)
> DEBUG1 [2643/2744]: Receiving data from client ... (in
> thread_manage_clients() at main.c:3834)
> DEBUG1 [2643/2744]: Nothing recv() from client... continuing (in
> thread_manage_clients() at main.c:3838)
> DEBUG1 [2643/2744]: Clean command context structure (in clean_command_ctx()
> at main.c:573)
> DEBUG1 [2643/2744]: Accepting client command ... (in thread_manage_clients()
> at main.c:3747)
> DEBUG1 [2643/2744]: Wait for client response (in thread_manage_clients() at
> main.c:3789)
> DEBUG1 [2643/2744]: Receiving data from client ... (in
> thread_manage_clients() at main.c:3834)
> DEBUG1 [2643/2744]: Processing client command 6 (in process_client_msg() at
> main.c:2603)
> DEBUG1 [2643/2744]: Getting session auto-20131126-090721 by name (in
> process_client_msg() at main.c:2682)
> DEBUG2 [2643/2744]: Trying to find session by name auto-20131126-090721 (in
> session_find_by_name() at session.c:133)
> DEBUG1 [2643/2744]: Creating kernel session (in create_kernel_session() at
> main.c:2519)
> DEBUG3 [2643/2744]: Created hashtable size 4 at 0xb33038b0 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG1 [2643/2744]: Kernel session created (fd: 30) (in
> kernel_create_session() at kernel.c:109)
> DEBUG3 [2643/2744]: Copying tracing session consumer output in kernel
> session (in copy_session_consumer() at main.c:2414)
> DEBUG3 [2643/2744]: Created hashtable size 4 at 0xb3303ad8 of type 1 (in
> lttng_ht_new() at hashtable.c:127)
> DEBUG3 [2643/2744]: Copy session consumer subdir /kernel (in
> copy_session_consumer() at main.c:2450)
> DEBUG3 [2643/2744]: mkdir() recursive
> /home/klaus/lttng-traces/auto-20131126-090721 with mode 504 for uid 0 and
> gid 0 (in run_as_mkdir_recursive() at runas.c:294)
> DEBUG1 [2643/2744]: Using run_as_clone (in run_as() at runas.c:277)
> DEBUG3 [2643/2742]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at
> ht-cleanup.c:59)
> DEBUG1 [2643/2744]: Spawning consumerd (in spawn_consumerd() at main.c:2120)
> DEBUG2 [2643/2744]: Consumer pid 2866 (in start_consumerd() at main.c:2306)
> DEBUG2 [2643/2744]: Spawning consumer control thread (in start_consumerd()
> at main.c:2309)
> DEBUG1 [2643/2867]: [thread] Manage consumer started (in
> thread_manage_consumer() at main.c:959)
> DEBUG3 [2866/2866]: Looking for a kernel consumer at these locations: (in
> spawn_consumerd() at main.c:2139)
> DEBUG3 [2866/2866]:     1)  (in spawn_consumerd() at main.c:2140)
> DEBUG3 [2866/2866]:     2) /usr/local/lib/lttng/libexec/lttng-consumerd (in
> spawn_consumerd() at main.c:2141)
> DEBUG3 [2866/2866]:     3) /usr/local/lib/lttng/libexec/lttng-consumerd (in
> spawn_consumerd() at main.c:2142)
> DEBUG3 [2866/2866]: Found location #2 (in spawn_consumerd() at main.c:2147)
> DEBUG1 [2866/2866]: Using kernel consumer at:
> /usr/local/lib/lttng/libexec/lttng-consumerd (in spawn_consumerd() at
> main.c:2156)
> DEBUG2 [2643/2867]: Receiving code from consumer err_sock (in
> thread_manage_consumer() at main.c:1044)
> DEBUG1 [2643/2867]: Consumer command socket ready (fd: 33 (in
> thread_manage_consumer() at main.c:1079)
> DEBUG1 [2643/2867]: Consumer metadata socket ready (fd: 34) (in
> thread_manage_consumer() at main.c:1081)
> DEBUG3 [2643/2744]: Consumer socket created (fd: 33) and added to output (in
> consumer_create_socket() at consumer.c:299)
> DEBUG1 [2643/2744]: Setting relayd for session auto-20131126-090721 (in
> cmd_setup_relayd() at cmd.c:722)
> DEBUG1 [2643/2744]: Trying to find channel channel0 (in
> trace_kernel_get_channel_by_name() at trace-kernel.c:48)
> DEBUG1 [2643/2744]: Enabling channel  for session auto-20131126-090721 (in
> cmd_enable_channel() at cmd.c:910)
> DEBUG1 [2643/2744]: Trying to find channel channel0 (in
> trace_kernel_get_channel_by_name() at trace-kernel.c:48)
> DEBUG3 [2643/2744]: Kernel create channel  with attr: 0, 262144, 4, 0,
> 200000, 0, 0 (in kernel_create_channel() at kernel.c:143)
> Warning: No tracing group detected
> DEBUG1 [2643/2744]: Kernel channel channel0 created (fd: 35) (in
> kernel_create_channel() at kernel.c:165)
> DEBUG1 [2643/2744]: Kernel quiescent wait on 6 (in kernel_wait_quiescent()
> at kernel.c:429)
> DEBUG1 [2643/2750]: Updating kernel poll set (in update_kernel_poll() at
> main.c:654)
> DEBUG1 [2643/2744]: Trying to find channel channel0 (in
> trace_kernel_get_channel_by_name() at trace-kernel.c:48)
> DEBUG1 [2643/2744]: Found channel by name channel0 (in
> trace_kernel_get_channel_by_name() at trace-kernel.c:52)
> DEBUG1 [2643/2744]: Event  created (fd: 36) (in kernel_create_event() at
> kernel.c:236)
> DEBUG1 [2643/2744]: Kernel quiescent wait on 6 (in kernel_wait_quiescent()
> at kernel.c:429)
> DEBUG1 [2643/2744]: Sending response (size: 16, retcode: Success) (in
> thread_manage_clients() at main.c:3883)
> DEBUG1 [2643/2744]: Clean command context structure (in clean_command_ctx()
> at main.c:573)
> DEBUG1 [2643/2744]: Accepting client command ... (in thread_manage_clients()
> at main.c:3747)
> DEBUG1 [2643/2750]: Channel fd 35 added to kernel set (in
> update_kernel_poll() at main.c:672)
> DEBUG1 [2643/2750]: Thread kernel polling on 3 fds (in
> thread_manage_kernel() at main.c:839)
> DEBUG1 [2643/2750]: Updating kernel streams for channel fd 35 (in
> update_kernel_stream() at main.c:698)
> DEBUG1 [2643/2750]: Channel found, updating kernel streams (in
> update_kernel_stream() at main.c:711)
> DEBUG1 [2643/2750]: Kernel stream channel0_0 created (fd: 29, state: 0) (in
> kernel_open_channel_stream() at kernel.c:562)
> DEBUG1 [2643/2750]: Kernel stream channel0_1 created (fd: 37, state: 0) (in
> kernel_open_channel_stream() at kernel.c:562)
> DEBUG1 [2643/2750]: Thread kernel polling on 3 fds (in
> thread_manage_kernel() at main.c:839)
>
> ---Terminal 2
> klaus at ubuntu:~$ sudo lttng start
> now Terminal 2 hangs
> ----
>
> DEBUG1 [2643/2744]: Wait for client response (in thread_manage_clients() at
> main.c:3789)
> DEBUG1 [2643/2744]: Receiving data from client ... (in
> thread_manage_clients() at main.c:3834)
> DEBUG1 [2643/2744]: Nothing recv() from client... continuing (in
> thread_manage_clients() at main.c:3838)
> DEBUG1 [2643/2744]: Clean command context structure (in clean_command_ctx()
> at main.c:573)
> DEBUG1 [2643/2744]: Accepting client command ... (in thread_manage_clients()
> at main.c:3747)
> DEBUG1 [2643/2744]: Wait for client response (in thread_manage_clients() at
> main.c:3789)
> DEBUG1 [2643/2744]: Receiving data from client ... (in
> thread_manage_clients() at main.c:3834)
> DEBUG1 [2643/2744]: Processing client command 16 (in process_client_msg() at
> main.c:2603)
> DEBUG1 [2643/2744]: Getting session auto-20131126-090721 by name (in
> process_client_msg() at main.c:2682)
> DEBUG2 [2643/2744]: Trying to find session by name auto-20131126-090721 (in
> session_find_by_name() at session.c:133)
> DEBUG1 [2643/2744]: Kernel metadata opened (fd: 39) (in
> kernel_open_metadata() at kernel.c:389)
> DEBUG1 [2643/2744]: Kernel metadata stream created (fd: 40) (in
> kernel_open_metadata_stream() at kernel.c:586)
> DEBUG1 [2643/2744]: Sending session stream to kernel consumer (in
> kernel_consumer_send_session() at kernel-consumer.c:338)
> DEBUG1 [2643/2744]: Sending metadata 40 to kernel consumer (in
> kernel_consumer_add_metadata() at kernel-consumer.c:158)
> DEBUG3 [2643/2744]: mkdir() recursive
> /home/klaus/lttng-traces/auto-20131126-090721/kernel with mode 504 for uid 0
> and gid 0 (in run_as_mkdir_recursive() at runas.c:294)
> DEBUG1 [2643/2744]: Using run_as_clone (in run_as() at runas.c:277)
> DEBUG3 [2643/2744]: Kernel local consumer tracefile path:
> /home/klaus/lttng-traces/auto-20131126-090721/kernel (in
> create_channel_path() at kernel-consumer.c:60)
> DEBUG1 [2643/2744]: Sending streams of channel channel0 to kernel consumer
> (in kernel_consumer_send_channel_stream() at kernel-consumer.c:288)
> DEBUG1 [2643/2744]: Kernel consumer adding channel channel0 to kernel
> consumer (in kernel_consumer_add_channel() at kernel-consumer.c:98)
> DEBUG3 [2643/2744]: mkdir() recursive
> /home/klaus/lttng-traces/auto-20131126-090721/kernel with mode 504 for uid 0
> and gid 0 (in run_as_mkdir_recursive() at runas.c:294)
> DEBUG1 [2643/2744]: Using run_as_clone (in run_as() at runas.c:277)
> DEBUG3 [2643/2744]: Kernel local consumer tracefile path:
> /home/klaus/lttng-traces/auto-20131126-090721/kernel (in
> create_channel_path() at kernel-consumer.c:60)
> DEBUG1 [2643/2744]: Sending stream 37 of channel channel0 to kernel consumer
> (in kernel_consumer_add_stream() at kernel-consumer.c:239)
> DEBUG1 [2643/2744]: Sending stream 29 of channel channel0 to kernel consumer
> (in kernel_consumer_add_stream() at kernel-consumer.c:239)
> DEBUG1 [2643/2744]: Kernel consumer FDs of metadata and channel streams sent
> (in kernel_consumer_send_session() at kernel-consumer.c:359)
>
> --Terminal 2
> strg C
> klaus at ubuntu:~$
> --
>
> --Terminal 1
> no more message
> strg C
> DEBUG1 [2643/2643]: SIGINT caught (in sighandler() at main.c:4374)
> DEBUG1 [2643/2643]: Terminating all threads (in stop_threads() at
> main.c:370)
> DEBUG1 [2643/2643]: Futex n to 1 wake done (in futex_nto1_wake() at
> futex.c:104)
> DEBUG1 [2643/2750]: Kernel thread dying (in thread_manage_kernel() at
> main.c:921)
> DEBUG1 [2643/2748]: Application notify communication apps thread cleanup
> complete (in ust_thread_manage_notify() at ust-thread.c:175)
> DEBUG1 [2643/2747]: Application communication apps thread cleanup complete
> (in thread_manage_apps() at main.c:1394)
> DEBUG3 [2643/2749]: [jul-thread] 1 fd ready (in
> jul_thread_manage_registration() at jul-thread.c:293)
> DEBUG3 [2643/2749]: [jul-thread] Destroy TCP socket on port 5345 (in
> destroy_tcp_socket() at jul-thread.c:171)
> DEBUG1 [2643/2749]: [jul-thread] is cleaning up and stopping. (in
> jul_thread_manage_registration() at jul-thread.c:356)
> DEBUG3 [2643/2749]: [jul-thread] Cleaning JUL apps ht (in
> clean_jul_apps_ht() at jul-thread.c:100)
> DEBUG1 [2643/2867]: consumer thread cleanup completed (in
> thread_manage_consumer() at main.c:1241)
> DEBUG1 [2643/2742]: [ust-thread] cleanup complete. (in thread_ht_cleanup()
> at ht-cleanup.c:130)
> DEBUG1 [2643/2746]: Notifying applications of session daemon state: 0 (in
> notify_ust_apps() at main.c:593)
> DEBUG1 [2643/2743]: Health check thread dying (in thread_manage_health() at
> main.c:3668)
> DEBUG1 [2643/2746]: Got the wait shm fd 5 (in get_wait_shm() at shm.c:115)
> DEBUG1 [2643/2746]: Futex wait update active 0 (in futex_wait_update() at
> futex.c:63)
> DEBUG1 [2643/2745]: Futex n to 1 wait done (in futex_nto1_wait() at
> futex.c:90)
> DEBUG1 [2643/2745]: Dispatch thread dying (in
> thread_dispatch_ust_registration() at main.c:1743)
> DEBUG1 [2643/2643]: SIGINT caught (in sighandler() at main.c:4374)
> DEBUG1 [2643/2643]: Terminating all threads (in stop_threads() at
> main.c:370)
> DEBUG1 [2643/2643]: Futex n to 1 wake done (in futex_nto1_wake() at
> futex.c:104)
> DEBUG1 [2643/2746]: UST Registration thread cleanup complete (in
> thread_registration_apps() at main.c:1959)
> DEBUG1 [2643/2643]: Cleaning up (in cleanup() at main.c:435)
> DEBUG1 [2643/2643]: Removing sessiond and consumerd content of directory
> /var/run/lttng (in cleanup() at main.c:454)
> DEBUG1 [2643/2643]: Removing /var/run/lttng/lttng-sessiond.pid (in cleanup()
> at main.c:460)
> DEBUG1 [2643/2643]: Removing /var/run/lttng/jul.port (in cleanup() at
> main.c:465)
> DEBUG1 [2643/2643]: Removing /var/run/lttng/kconsumerd/error (in cleanup()
> at main.c:472)
> DEBUG1 [2643/2643]: Removing directory /var/run/lttng/kconsumerd (in
> cleanup() at main.c:478)
> DEBUG1 [2643/2643]: Removing /var/run/lttng/ustconsumerd32/error (in
> cleanup() at main.c:485)
> DEBUG1 [2643/2643]: Removing directory /var/run/lttng/ustconsumerd32 (in
> cleanup() at main.c:491)
> DEBUG1 [2643/2643]: Removing /var/run/lttng/ustconsumerd64/error (in
> cleanup() at main.c:498)
> DEBUG1 [2643/2643]: Removing directory /var/run/lttng/ustconsumerd64 (in
> cleanup() at main.c:504)
> DEBUG1 [2643/2643]: Cleaning up all sessions (in cleanup() at main.c:515)
> DEBUG1 [2643/2643]: Tearing down kernel session (in kernel_destroy_session()
> at kernel.c:755)
> DEBUG1 [2643/2643]: [trace] Closing session fd 30 (in
> trace_kernel_destroy_session() at trace-kernel.c:450)
> DEBUG1 [2643/2643]: [trace] Closing metadata stream fd 40 (in
> trace_kernel_destroy_session() at trace-kernel.c:460)
> DEBUG1 [2643/2643]: [trace] Closing metadata fd 39 (in
> trace_kernel_destroy_metadata() at trace-kernel.c:423)
>
> Terminal 1 hangs now !!
> in other terminal now no lttng call are work!
>

I can't reproduce this on a fresh Ubuntu 12.04 Server 64-bit install.
Are you sure you don't have files from prior versions of LTTng already
installed or that you are not skipping steps from the IBM guide?

The guide shows how to add your user to the "tracing" group. This
makes it unnecessary to invoke lttng as root. In your case, only the
session daemon needs to be started as root.

Jérémie

> when i repeat the comand in other terminal:
> klaus at ubuntu:~$ sudo -H lttng-sessiond -vvv
> [sudo] password for klaus:
> DEBUG3 [3012/3012]: Creating LTTng run directory: /var/run/lttng (in
> create_lttng_rundir() at main.c:4267)
> DEBUG2 [3012/3012]: Kernel consumer err path:
> /var/run/lttng/kconsumerd/error (in main() at main.c:4708)
> DEBUG2 [3012/3012]: Kernel consumer cmd path:
> /var/run/lttng/kconsumerd/command (in main() at main.c:4710)
> DEBUG1 [3012/3012]: Client socket path /var/run/lttng/client-lttng-sessiond
> (in main() at main.c:4763)
> DEBUG1 [3012/3012]: Application socket path /var/run/lttng/lttng-ust-sock-5
> (in main() at main.c:4764)
> DEBUG1 [3012/3012]: Application wait path /lttng-ust-wait-5 (in main() at
> main.c:4765)
> DEBUG1 [3012/3012]: LTTng run directory path: /var/run/lttng (in main() at
> main.c:4766)
> DEBUG2 [3012/3012]: UST consumer 32 bits err path:
> /var/run/lttng/ustconsumerd32/error (in main() at main.c:4775)
> DEBUG2 [3012/3012]: UST consumer 32 bits cmd path:
> /var/run/lttng/ustconsumerd32/command (in main() at main.c:4777)
> DEBUG2 [3012/3012]: UST consumer 64 bits err path:
> /var/run/lttng/ustconsumerd64/error (in main() at main.c:4786)
> DEBUG2 [3012/3012]: UST consumer 64 bits cmd path:
> /var/run/lttng/ustconsumerd64/command (in main() at main.c:4788)
> Error: Already running daemon.
>
> before i use the command sudo lttng start
> all other lttng command's are work's!
>
> Regards,
> Klaus
>
>
>
>
>> Daniel U. Thibault
>> Protection des systèmes et contremesures (PSC) | Systems Protection &
>> Countermeasures (SPC)
>> Cyber sécurité pour les missions essentielles (CME) | Mission Critical
>> Cyber Security (MCCS)
>> R & D pour la défense Canada - Valcartier (RDDC Valcartier) | Defence R&D
>> Canada - Valcartier (DRDC Valcartier)
>> 2459 route de la Bravoure
>> Québec QC  G3J 1X5
>> CANADA
>> Vox : (418) 844-4000 x4245
>> Fax : (418) 844-4538
>> NAC : 918V QSDJ <http://www.travelgis.com/map.asp?addr=918V%20QSDJ>
>> Gouvernement du Canada | Government of Canada
>> <http://www.valcartier.drdc-rddc.gc.ca/>
>>
>> _______________________________________________
>> lttng-dev mailing list
>> lttng-dev at lists.lttng.org
>> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
>
>
>
> _______________________________________________
> lttng-dev mailing list
> lttng-dev at lists.lttng.org
> http://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
>

-- 
Jérémie Galarneau
EfficiOS Inc.
http://www.efficios.com