<div dir="ltr"><div>Hi Kienan, </div><div><br></div>I just figured out what I did wrong. After I rebuilt the system the day before and installed lttng-modules-dkms from Ubuntu officially, the building of kernel modules failed (I can send you the crash and make.log for you to look at). I then added Ubuntu: LTTng Stable 2.13 PPA, and installation passed. With that, what installed are mix/mismatch of kms and binary of the partially installed kms from Ubuntu official and from stable 2.13 ppa. That caused the problem. I now removed everything and reinstalled everything from stable 2.13 ppa, everything works.<br><div><br></div><div>Thank you for helping me through this. </div><div><br>Best,</div><div>Yonghong</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jan 12, 2024 at 10:04 PM Yonghong Yan <<a href="mailto:yanyh15@gmail.com">yanyh15@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">Hi Kienan, <div><br></div><div>Thank you. I tried and unfortunately, there is no debuginfo in the <a href="https://debuginfod.ubuntu.com" target="_blank">https://debuginfod.ubuntu.com</a> repo. I tried <a href="https://debuginfod.debian.net/" target="_blank">https://debuginfod.debian.net/</a> as well. No debug info. If you have a debug info file and can send to me, I can use it in gdb to see the backtrace. </div><div><br></div><div>Best,</div><div>Yonghong</div><div><br></div><div>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)"><b>yyan7@CCI13SZWP3LWS</b></span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)"><b>/var/lib/apport/coredump</b></span><span style="font-variant-ligatures:no-common-ligatures">$ export DEBUGINFOD_URLS="<a href="https://debuginfod.ubuntu.com" target="_blank">https://debuginfod.ubuntu.com</a>"</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)"><b>yyan7@CCI13SZWP3LWS</b></span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)"><b>/var/lib/apport/coredump</b></span><span style="font-variant-ligatures:no-common-ligatures">$ gdb /usr/bin/lttng-sessiond core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109<span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(200,20,201)"><span style="font-variant-ligatures:no-common-ligatures"><b>GNU gdb (Ubuntu 12.1-0ubuntu1~22.04) 12.1</b></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Copyright (C) 2022 Free Software Foundation, Inc.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">License GPLv3+: GNU GPL version 3 or later <<a href="http://gnu.org/licenses/gpl.html" target="_blank">http://gnu.org/licenses/gpl.html</a>></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">This is free software: you are free to change and redistribute it.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">There is NO WARRANTY, to the extent permitted by law.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Type "show copying" and "show warranty" for details.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">This GDB was configured as "x86_64-linux-gnu".</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Type "show configuration" for configuration details.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">For bug reporting instructions, please see:</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><<a href="https://www.gnu.org/software/gdb/bugs/" target="_blank">https://www.gnu.org/software/gdb/bugs/</a>>.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Find the GDB manual and other documentation resources online at:</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span><<a href="http://www.gnu.org/software/gdb/documentation/" target="_blank">http://www.gnu.org/software/gdb/documentation/</a>>.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0);min-height:20px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">For help, type "help".</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Type "apropos word" to search for commands related to "word"...</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Reading symbols from </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/usr/bin/lttng-sessiond</span><span style="font-variant-ligatures:no-common-ligatures">...</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0);min-height:20px"><span style="font-variant-ligatures:no-common-ligatures"></span><br></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">This GDB supports auto-downloading debuginfo from the following URLs:</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><a href="https://debuginfod.ubuntu.com" target="_blank">https://debuginfod.ubuntu.com</a></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Enable debuginfod for this session? (y or [n]) y</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Debuginfod has been enabled.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">To make this setting permanent, add 'set debuginfod enabled on' to .gdbinit.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">(No debugging symbols found in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/usr/bin/lttng-sessiond</span><span style="font-variant-ligatures:no-common-ligatures">)</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10479]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10470]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10476]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10475]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10472]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10478]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10480]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10473]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10477]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10482]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10542]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10533]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10484]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10474]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10481]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[New LWP 10483]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.19 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libkmod.so.2</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.89 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/liblttng-ctl.so.0</span><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.05 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/liburcu.so.8</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">Downloading 0.01 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures">/home/yyan7/.cache/debuginfod_client/55485e3e07dd2ab7e3510c9f90e8e8607f07d0c2/debuginfo</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.03 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/liburcu-common.so.8</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.07 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/liburcu-cds.so.8</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 2.45 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libxml2.so.2</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 1.73 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libzstd.so.1</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.30 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/liblzma.so.5</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 4.95 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libcrypto.so.3</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 3.06 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libicuuc.so.70</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">Downloading 0.08 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures">/home/yyan7/.cache/debuginfod_client/bef3ff1d70aadd68aab07d858a759360c8b919ae/debuginfo</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"><span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.07 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libnuma.so.1</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.00 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libicudata.so.70</span><span style="font-variant-ligatures:no-common-ligatures"> <span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 5.99 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libstdc++.so.6</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.18 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">/lib/x86_64-linux-gnu/libgcc_s.so.1</span><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Downloading 0.03 MB separate debug info for </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">system-supplied DSO at 0x7ffdabeee000</span><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[Thread debugging using libthread_db enabled]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">Using host libthread_db library "</span><span style="font-variant-ligatures:no-common-ligatures">/lib/x86_64-linux-gnu/libthread_db.so.1</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">".</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">--Type <RET> for more, q to quit, c to continue without paging--</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Core was generated by `lttng-sessiond -vvv --verbose-consumer -b'.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Program terminated with signal SIGABRT, Aborted.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#0<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__pthread_kill_implementation</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">no_tid</span><span style="font-variant-ligatures:no-common-ligatures">=0, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo</span><span style="font-variant-ligatures:no-common-ligatures">=6, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:44</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">Download failed: Invalid argument.<span> </span>Continuing without source file </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">44<span style="white-space:pre-wrap"> </span>./nptl/pthread_kill.c: No such file or directory.</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">[Current thread is 1 (Thread 0x7fe36affd600 (LWP 10479))]</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">(gdb) bt</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#0<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__pthread_kill_implementation</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">no_tid</span><span style="font-variant-ligatures:no-common-ligatures">=0, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo</span><span style="font-variant-ligatures:no-common-ligatures">=6, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:44</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#1<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__pthread_kill_internal</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo</span><span style="font-variant-ligatures:no-common-ligatures">=6, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:78</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#2<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI___pthread_kill</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo=signo@entry</span><span style="font-variant-ligatures:no-common-ligatures">=6) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:89</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#3<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d842476</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI_raise</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">sig=sig@entry</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">=6) at </span><span style="font-variant-ligatures:no-common-ligatures">../sysdeps/posix/raise.c</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">:26</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#4<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d8287f3</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI_abort</span><span style="font-variant-ligatures:no-common-ligatures"> () at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./stdlib/abort.c</span><span style="font-variant-ligatures:no-common-ligatures">:79</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#5<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d82871b</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__assert_fail_base</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">fmt</span><span style="font-variant-ligatures:no-common-ligatures">=0x7fe37d9dd130 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n",<span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">assertion</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cd9a9ab "buf", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">file</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cda20e7 "unix.c", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">line</span><span style="font-variant-ligatures:no-common-ligatures">=185, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">function</span><span style="font-variant-ligatures:no-common-ligatures">=<optimized out>) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./assert/assert.c</span><span style="font-variant-ligatures:no-common-ligatures">:92</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#6<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d839e96</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI___assert_fail</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">assertion</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cd9a9ab "buf", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">file</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cda20e7 "unix.c", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">line</span><span style="font-variant-ligatures:no-common-ligatures">=185,<span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">function</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cdc8830 "lttcomm_recv_unix_sock") at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./assert/assert.c</span><span style="font-variant-ligatures:no-common-ligatures">:101</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#7<span> </span></span><span style="font-variant-ligatures:no-common-ligatures">0x000056371cd561be</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#8<span> </span></span><span style="font-variant-ligatures:no-common-ligatures">0x000056371ccea96f</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#9<span> </span></span><span style="font-variant-ligatures:no-common-ligatures">0x000056371ccef7eb</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#10 </span><span style="font-variant-ligatures:no-common-ligatures">0x000056371ccf3b4c</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#11 </span><span style="font-variant-ligatures:no-common-ligatures">0x000056371cce0ab7</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#12 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d894ac3</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">start_thread</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">arg</span><span style="font-variant-ligatures:no-common-ligatures">=<optimized out>) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_create.c</span><span style="font-variant-ligatures:no-common-ligatures">:442</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#13 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d926850</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">clone3</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> () at </span><span style="font-variant-ligatures:no-common-ligatures">../sysdeps/unix/sysv/linux/x86_64/clone3.S</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">:81</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">(gdb)<span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#0<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__pthread_kill_implementation</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">no_tid</span><span style="font-variant-ligatures:no-common-ligatures">=0, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo</span><span style="font-variant-ligatures:no-common-ligatures">=6, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:44</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#1<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__pthread_kill_internal</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo</span><span style="font-variant-ligatures:no-common-ligatures">=6, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:78</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#2<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI___pthread_kill</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">threadid</span><span style="font-variant-ligatures:no-common-ligatures">=140614729455104, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">signo=signo@entry</span><span style="font-variant-ligatures:no-common-ligatures">=6) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_kill.c</span><span style="font-variant-ligatures:no-common-ligatures">:89</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#3<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d842476</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI_raise</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">sig=sig@entry</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">=6) at </span><span style="font-variant-ligatures:no-common-ligatures">../sysdeps/posix/raise.c</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">:26</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#4<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d8287f3</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI_abort</span><span style="font-variant-ligatures:no-common-ligatures"> () at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./stdlib/abort.c</span><span style="font-variant-ligatures:no-common-ligatures">:79</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#5<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d82871b</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__assert_fail_base</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">fmt</span><span style="font-variant-ligatures:no-common-ligatures">=0x7fe37d9dd130 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n",<span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">assertion</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cd9a9ab "buf", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">file</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cda20e7 "unix.c", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">line</span><span style="font-variant-ligatures:no-common-ligatures">=185, </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">function</span><span style="font-variant-ligatures:no-common-ligatures">=<optimized out>) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./assert/assert.c</span><span style="font-variant-ligatures:no-common-ligatures">:92</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#6<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d839e96</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">__GI___assert_fail</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">assertion</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cd9a9ab "buf", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">file</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cda20e7 "unix.c", </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">line</span><span style="font-variant-ligatures:no-common-ligatures">=185,<span> </span></span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">function</span><span style="font-variant-ligatures:no-common-ligatures">=0x56371cdc8830 "lttcomm_recv_unix_sock") at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./assert/assert.c</span><span style="font-variant-ligatures:no-common-ligatures">:101</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#7<span> </span></span><span style="font-variant-ligatures:no-common-ligatures">0x000056371cd561be</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#8<span> </span></span><span style="font-variant-ligatures:no-common-ligatures">0x000056371ccea96f</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#9<span> </span></span><span style="font-variant-ligatures:no-common-ligatures">0x000056371ccef7eb</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#10 </span><span style="font-variant-ligatures:no-common-ligatures">0x000056371ccf3b4c</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(64,11,217)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#11 </span><span style="font-variant-ligatures:no-common-ligatures">0x000056371cce0ab7</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">??</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> ()</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="font-variant-ligatures:no-common-ligatures">#12 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d894ac3</span><span style="font-variant-ligatures:no-common-ligatures"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">start_thread</span><span style="font-variant-ligatures:no-common-ligatures"> (</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">arg</span><span style="font-variant-ligatures:no-common-ligatures">=<optimized out>) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">./nptl/pthread_create.c</span><span style="font-variant-ligatures:no-common-ligatures">:442</span></p>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:17px;line-height:normal;font-family:Menlo;color:rgb(47,180,29)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">#13 </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(64,11,217)">0x00007fe37d926850</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> in </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">clone3</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)"> () at </span><span style="font-variant-ligatures:no-common-ligatures">../sysdeps/unix/sysv/linux/x86_64/clone3.S</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(0,0,0)">:81</span></p></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jan 12, 2024 at 3:58 PM Kienan Stewart <<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Yonghong,<br>
<br>
thanks for the extra info. As you say without the symbol resolution the <br>
backtrace isn't super useful.<br>
<br>
Based on the build-id in the file info for lttng-sessiond, it looks like <br>
you might be using the lttng/stable-2.13 ppa.<br>
<br>
In that case, you could try using debuginfod with gdb to automatically <br>
download the symbols. See <br>
<a href="https://ubuntu.com/server/docs/service-debuginfod" rel="noreferrer" target="_blank">https://ubuntu.com/server/docs/service-debuginfod</a> for the instructions <br>
enabling the symbol download from Ubuntu's debuginfod server.<br>
<br>
thanks,<br>
kienan<br>
<br>
On 1/12/24 15:38, Yonghong Yan wrote:<br>
> Coredump is about 124MB and I am copying the backtrace of the coredump, <br>
> see below. Unfortunately, the sessiond is stripped and no debugging <br>
> info, so not able to see the the call stack that lead to the dump. guess <br>
> I need to build the lttng with debugging info and to get the symbol and <br>
> informed backtrace.<br>
> <br>
> From the log itself, it is asserted aat > > DBG1 - <br>
> 00:24:25.241138386 [Client management]: Setting relayd for<br>
>> > session auto-20240112-002417 (in cmd_setup_relayd() at cmd.c:1004)<br>
>> ><br>
>> > lttng-sessiond: unix.c:185: lttcomm_recv_unix_sock: Assertion<br>
>> `buf' failed.<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/log*$ tail apport.log<br>
> <br>
> <br>
> ERROR: apport (pid 3787) Fri Jan 12 10:52:37 2024: debug: session gdbus <br>
> call:<br>
> <br>
> ERROR: apport (pid 3787) Fri Jan 12 10:52:37 2024: this executable <br>
> already crashed 2 times, ignoring<br>
> <br>
> ERROR: apport (pid 10543) Fri Jan 12 15:18:07 2024: called for pid <br>
> 10470, signal 6, core limit 18446744073709551615, dump mode 1<br>
> <br>
> ERROR: apport (pid 10543) Fri Jan 12 15:18:07 2024: ignoring implausibly <br>
> big core limit, treating as unlimited<br>
> <br>
> ERROR: apport (pid 10543) Fri Jan 12 15:18:07 2024: executable: <br>
> /usr/bin/lttng-sessiond (command line "lttng-sessiond -vvv <br>
> --verbose-consumer -b")<br>
> <br>
> ERROR: apport (pid 10543) Fri Jan 12 15:18:08 2024: debug: session gdbus <br>
> call: (true,)<br>
> <br>
> <br>
> ERROR: apport (pid 10543) Fri Jan 12 15:18:08 2024: writing core dump to <br>
> core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109 (limit: -1)<br>
> <br>
> ERROR: apport (pid 10543) Fri Jan 12 15:18:08 2024: this executable <br>
> already crashed 2 times, ignoring<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/log*$ cd /var/lib/apport/coredump<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/lib/apport/coredump*$ ls<br>
> <br>
> core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/lib/apport/coredump*$ file <br>
> core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109<br>
> <br>
> core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'lttng-sessiond -vvv --verbose-consumer -b', real uid: 1000, effective uid: 1000, real gid: 1000, effective gid: 1000, execfn: '/usr/bin/lttng-sessiond', platform: 'x86_64'<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/lib/apport/coredump*$ du -h <br>
> core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109<br>
> <br>
> 124Mcore._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/lib/apport/coredump*$ gdb <br>
> /usr/bin/lttng-sessiond <br>
> core._usr_bin_lttng-sessiond.1000.8f22faa6-512c-49ca-9089-8b3f0801da8d.10470.2023109<br>
> <br>
> *GNU gdb (Ubuntu 12.1-0ubuntu1~22.04) 12.1*<br>
> <br>
> Copyright (C) 2022 Free Software Foundation, Inc.<br>
> <br>
> License GPLv3+: GNU GPL version 3 or later <br>
> <<a href="http://gnu.org/licenses/gpl.html" rel="noreferrer" target="_blank">http://gnu.org/licenses/gpl.html</a> <<a href="http://gnu.org/licenses/gpl.html" rel="noreferrer" target="_blank">http://gnu.org/licenses/gpl.html</a>>><br>
> <br>
> This is free software: you are free to change and redistribute it.<br>
> <br>
> There is NO WARRANTY, to the extent permitted by law.<br>
> <br>
> Type "show copying" and "show warranty" for details.<br>
> <br>
> This GDB was configured as "x86_64-linux-gnu".<br>
> <br>
> Type "show configuration" for configuration details.<br>
> <br>
> For bug reporting instructions, please see:<br>
> <br>
> <<a href="https://www.gnu.org/software/gdb/bugs/" rel="noreferrer" target="_blank">https://www.gnu.org/software/gdb/bugs/</a> <br>
> <<a href="https://www.gnu.org/software/gdb/bugs/" rel="noreferrer" target="_blank">https://www.gnu.org/software/gdb/bugs/</a>>>.<br>
> <br>
> Find the GDB manual and other documentation resources online at:<br>
> <br>
> <<a href="http://www.gnu.org/software/gdb/documentation/" rel="noreferrer" target="_blank">http://www.gnu.org/software/gdb/documentation/</a> <br>
> <<a href="http://www.gnu.org/software/gdb/documentation/" rel="noreferrer" target="_blank">http://www.gnu.org/software/gdb/documentation/</a>>>.<br>
> <br>
> <br>
> For help, type "help".<br>
> <br>
> Type "apropos word" to search for commands related to "word"...<br>
> <br>
> Reading symbols from /usr/bin/lttng-sessiond...<br>
> <br>
> (No debugging symbols found in /usr/bin/lttng-sessiond)<br>
> <br>
> [New LWP 10479]<br>
> <br>
> [New LWP 10470]<br>
> <br>
> [New LWP 10476]<br>
> <br>
> [New LWP 10475]<br>
> <br>
> [New LWP 10472]<br>
> <br>
> [New LWP 10478]<br>
> <br>
> [New LWP 10480]<br>
> <br>
> [New LWP 10473]<br>
> <br>
> [New LWP 10477]<br>
> <br>
> [New LWP 10482]<br>
> <br>
> [New LWP 10542]<br>
> <br>
> [New LWP 10533]<br>
> <br>
> [New LWP 10484]<br>
> <br>
> [New LWP 10474]<br>
> <br>
> [New LWP 10481]<br>
> <br>
> [New LWP 10483]<br>
> <br>
> [Thread debugging using libthread_db enabled]<br>
> <br>
> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".<br>
> <br>
> --Type <RET> for more, q to quit, c to continue without paging--<br>
> <br>
> Core was generated by `lttng-sessiond -vvv --verbose-consumer -b'.<br>
> <br>
> Program terminated with signal SIGABRT, Aborted.<br>
> <br>
> #0__pthread_kill_implementation(no_tid=0, signo=6, <br>
> threadid=140614729455104) at ./nptl/pthread_kill.c:44<br>
> <br>
> 44./nptl/pthread_kill.c: No such file or directory.<br>
> <br>
> [Current thread is 1 (Thread 0x7fe36affd600 (LWP 10479))]<br>
> <br>
> (gdb) bt<br>
> <br>
> #0__pthread_kill_implementation(no_tid=0, signo=6, <br>
> threadid=140614729455104) at ./nptl/pthread_kill.c:44<br>
> <br>
> #1__pthread_kill_internal(signo=6, threadid=140614729455104) at <br>
> ./nptl/pthread_kill.c:78<br>
> <br>
> #2__GI___pthread_kill(threadid=140614729455104, signo=signo@entry=6) at <br>
> ./nptl/pthread_kill.c:89<br>
> <br>
> #30x00007fe37d842476in __GI_raise(sig=sig@entry=6) at <br>
> ../sysdeps/posix/raise.c:26<br>
> <br>
> #40x00007fe37d8287f3in __GI_abort() at ./stdlib/abort.c:79<br>
> <br>
> #50x00007fe37d82871bin __assert_fail_base(fmt=0x7fe37d9dd130 "%s%s%s:%u: <br>
> %s%sAssertion `%s' failed.\n%n",<br>
> <br>
> assertion=0x56371cd9a9ab "buf", file=0x56371cda20e7 "unix.c", line=185, <br>
> function=<optimized out>) at ./assert/assert.c:92<br>
> <br>
> #60x00007fe37d839e96in __GI___assert_fail(assertion=0x56371cd9a9ab <br>
> "buf", file=0x56371cda20e7 "unix.c", line=185,<br>
> <br>
> function=0x56371cdc8830 "lttcomm_recv_unix_sock") at ./assert/assert.c:101<br>
> <br>
> #70x000056371cd561bein ??()<br>
> <br>
> #80x000056371ccea96fin ??()<br>
> <br>
> #90x000056371ccef7ebin ??()<br>
> <br>
> #10 0x000056371ccf3b4cin ??()<br>
> <br>
> #11 0x000056371cce0ab7in ??()<br>
> <br>
> #12 0x00007fe37d894ac3in start_thread(arg=<optimized out>) at <br>
> ./nptl/pthread_create.c:442<br>
> <br>
> #13 0x00007fe37d926850in clone3() at <br>
> ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81<br>
> <br>
> (gdb) quit<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/lib/apport/coredump*$ file <br>
> /usr/bin/lttng-sessiond<br>
> <br>
> /usr/bin/lttng-sessiond: ELF 64-bit LSB pie executable, x86-64, version <br>
> 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, <br>
> BuildID[sha1]=71b82210085b068b86d1252ed4f7403917af7cea, for GNU/Linux <br>
> 3.2.0, stripped<br>
> <br>
> *yyan7@CCI13SZWP3LWS*:*/var/lib/apport/coredump*$<br>
> <br>
> <br>
> On Fri, Jan 12, 2024 at 2:31 PM Kienan Stewart <<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a> <br>
> <mailto:<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a>>> wrote:<br>
> <br>
> Hi Yonghong,<br>
> <br>
> thanks for the additional information. Would you be willing and able to<br>
> share a coredump and/or backtrace of the crash?<br>
> <br>
> I was still unable to reproduce the issue using the commands you<br>
> provided, but am interested in understanding what is happening here.<br>
> <br>
> Are there any configuration options other than LTTNG_UST_DEBUG=1 set in<br>
> your environment?<br>
> <br>
> Are you using urcu/lttng from packages (if so, which repo), or built<br>
> from source?<br>
> <br>
> The test case I am using now:<br>
> <br>
> ```<br>
> # As root<br>
> $ lttng-sessiond -b<br>
> <br>
> # As a non-root user which is not a member of the tracing group<br>
> $ export LTTNG_UST_DEBUG=1<br>
> $ lttng-relayd -v -b<br>
> $ lttng-sessiond -vvv --verbose-consumer -b<br>
> $ lttng create<br>
> $ lttng enable-event -u -a<br>
> ```<br>
> <br>
> thanks,<br>
> kienan<br>
> <br>
> P.S. In the future, could you keep the lttng-dev in CC? thanks!<br>
> <br>
> On 1/12/24 10:36, Yonghong Yan wrote:<br>
> > Hi Kienan,<br>
> ><br>
> > Thank you for checking. It might be just my setting problem. I will<br>
> > just send it to you before we are sure it is an issue of lttng<br>
> ><br>
> > Below is the output and steps I followed the guideline. Since I<br>
> started<br>
> > the relayd and sessiond in the same terminal, the verbose msg are<br>
> mixed<br>
> > together. I can regenerate it using two separate terminals. It is<br>
> a Dell<br>
> > Precision Tower box and it worked well yesterday. But I rebuilt the<br>
> > system yesterday (because of NVIDIA GPU driver issue), and it<br>
> then have<br>
> > this issue.<br>
> ><br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ uname -a<br>
> ><br>
> > Linux CCI13SZWP3LWS 6.5.0-14-generic #14~22.04.1-Ubuntu SMP<br>
> > PREEMPT_DYNAMIC Mon Nov 20 18:15:30 UTC 2 x86_64 x86_64 x86_64<br>
> GNU/Linux<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ cat /etc/lsb-release<br>
> ><br>
> > DISTRIB_ID=Ubuntu<br>
> ><br>
> > DISTRIB_RELEASE=22.04<br>
> ><br>
> > DISTRIB_CODENAME=jammy<br>
> ><br>
> > DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lttng --version<br>
> ><br>
> > lttng (LTTng Trace Control) 2.13.10 - Nordicité<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lsmod | grep lttng<br>
> ><br>
> > *lttng*_probe_writeback614400<br>
> ><br>
> > *lttng*_probe_workqueue204800<br>
> ><br>
> > *lttng*_probe_vmscan 450560<br>
> ><br>
> > *lttng*_probe_udp122880<br>
> ><br>
> > *lttng*_probe_timer327680<br>
> ><br>
> > *lttng*_probe_sunrpc 204800<br>
> ><br>
> > *lttng*_probe_statedump573440<br>
> ><br>
> > *lttng*_probe_sock 163840<br>
> ><br>
> > *lttng*_probe_skb163840<br>
> ><br>
> > *lttng*_probe_signal 163840<br>
> ><br>
> > *lttng*_probe_scsi 204800<br>
> ><br>
> > *lttng*_probe_sched450560<br>
> ><br>
> > *lttng*_probe_regulator204800<br>
> ><br>
> > *lttng*_probe_rcu122880<br>
> ><br>
> > *lttng*_probe_printk 122880<br>
> ><br>
> > *lttng*_probe_power204800<br>
> ><br>
> > *lttng*_probe_net327680<br>
> ><br>
> > *lttng*_probe_napi 122880<br>
> ><br>
> > *lttng*_probe_module 204800<br>
> ><br>
> > *lttng*_probe_kvm368640<br>
> ><br>
> > *lttng*_probe_jbd2 327680<br>
> ><br>
> > *lttng*_probe_irq163840<br>
> ><br>
> > *lttng*_probe_gpio 122880<br>
> ><br>
> > *lttng*_probe_block409600<br>
> ><br>
> > *lttng*_probe_asoc 368640<br>
> ><br>
> > *lttng*_counter_client_percpu_32_modular122880<br>
> ><br>
> > *lttng*_counter_client_percpu_64_modular122881<br>
> ><br>
> > *lttng*_counter163842<br>
> ><br>
> *lttng*_counter_client_percpu_64_modular,*lttng*_counter_client_percpu_32_modular<br>
> ><br>
> > *lttng*_ring_buffer_event_notifier_client204802<br>
> ><br>
> > *lttng*_ring_buffer_metadata_mmap_client204800<br>
> ><br>
> > *lttng*_ring_buffer_client_mmap_overwrite245760<br>
> ><br>
> > *lttng*_ring_buffer_client_mmap_discard245760<br>
> ><br>
> > *lttng*_ring_buffer_metadata_client204800<br>
> ><br>
> > *lttng*_ring_buffer_client_overwrite245760<br>
> ><br>
> > *lttng*_ring_buffer_client_discard245760<br>
> ><br>
> > *lttng*_tracer 303513637<br>
> ><br>
> *lttng*_probe_udp,*lttng*_probe_scsi,*lttng*_probe_sched,*lttng*_probe_net,*lttng*_probe_vmscan,*lttng*_probe_writeback,*lttng*_probe_power,*lttng*_probe_rcu,*lttng*_probe_module,*lttng*_ring_buffer_client_mmap_overwrite,*lttng*_probe_statedump,*lttng*_ring_buffer_client_discard,*lttng*_probe_printk,*lttng*_probe_sock,*lttng*_probe_asoc,*lttng*_counter_client_percpu_64_modular,*lttng*_probe_irq,*lttng*_ring_buffer_client_mmap_discard,*lttng*_probe_kvm,*lttng*_probe_timer,*lttng*_ring_buffer_event_notifier_client,*lttng*_counter_client_percpu_32_modular,*lttng*_probe_workqueue,*lttng*_probe_jbd2,*lttng*_probe_signal,*lttng*_probe_skb,*lttng*_probe_block,*lttng*_probe_napi,*lttng*_ring_buffer_metadata_client,*lttng*_ring_buffer_metadata_mmap_client,*lttng*_probe_gpio,*lttng*_ring_buffer_client_overwrite,*lttng*_probe_regulator,*lttng*_probe_sunrpc<br>
> ><br>
> > *lttng*_statedump 7536641 *lttng*_tracer<br>
> ><br>
> > *lttng*_wrapper163847<br>
> ><br>
> *lttng*_statedump,*lttng*_probe_writeback,*lttng*_ring_buffer_client_mmap_overwrite,*lttng*_ring_buffer_client_discard,*lttng*_tracer,*lttng*_ring_buffer_client_mmap_discard,*lttng*_ring_buffer_client_overwrite<br>
> ><br>
> > *lttng*_uprobes163841 *lttng*_tracer<br>
> ><br>
> > *lttng*_clock122885<br>
> ><br>
> *lttng*_ring_buffer_client_mmap_overwrite,*lttng*_ring_buffer_client_discard,*lttng*_tracer,*lttng*_ring_buffer_client_mmap_discard,*lttng*_ring_buffer_client_overwrite<br>
> ><br>
> > *lttng*_kprobes163841 *lttng*_tracer<br>
> ><br>
> > *lttng*_lib_ring_buffer942088<br>
> ><br>
> *lttng*_ring_buffer_client_mmap_overwrite,*lttng*_ring_buffer_client_discard,*lttng*_tracer,*lttng*_ring_buffer_client_mmap_discard,*lttng*_ring_buffer_event_notifier_client,*lttng*_ring_buffer_metadata_client,*lttng*_ring_buffer_metadata_mmap_client,*lttng*_ring_buffer_client_overwrite<br>
> ><br>
> > *lttng*_kretprobes 163841 *lttng*_tracer<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ export LTTNG_UST_DEBUG=1<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lttng-relayd -v -b<br>
> ><br>
> > DBG1 - 10:24:56.244818657 [3495/3495]: File descriptor count<br>
> limits are<br>
> > 1024 (soft) and 1048576 (hard) (in set_fd_pool_size() at main.c:481)<br>
> ><br>
> > DBG1 - 10:24:56.244870031 [3495/3495]: Signal handler set for<br>
> SIGTERM,<br>
> > SIGUSR1, SIGPIPE and SIGINT (in set_signal_handler() at main.c:872)<br>
> ><br>
> > DBG1 - 10:24:56.244877662 [3495/3495]: LTTng-relayd 2.13.10 -<br>
> Nordicité<br>
> > (in relayd_config_log() at main.c:206)<br>
> ><br>
> > DBG1 - 10:24:56.244885255 [3495/3495]: Clear command allowed (in<br>
> main()<br>
> > at main.c:4294)<br>
> ><br>
> > DBG1 - 10:24:56.245867168 [3496/3496]: Unlinked file pool created<br>
> at:<br>
> > /home/yyan7/lttng-traces//.unlinked (in<br>
> > lttng_unlinked_file_pool_create() at inode.c:268)<br>
> ><br>
> > DBG1 - 10:24:56.245903674 [3496/3496]: File descriptor tracker<br>
> created<br>
> > with a limit of 1014 simultaneously-opened FDs (in<br>
> fd_tracker_create()<br>
> > at fd-tracker.c:400)<br>
> ><br>
> > DBG1 - 10:24:56.245925508 [3496/3496]: Health check time delta in<br>
> > seconds set to 20 (in health_init() at health.c:62)<br>
> ><br>
> > DBG1 - 10:24:56.245998123 [3496/3496]: TCP inet operation timeout<br>
> set to<br>
> > 216 sec (in lttcomm_inet_init() at inet.c:545)<br>
> ><br>
> > DBG1 - 10:24:56.246177304 [3496/3498]: [thread] Manage health check<br>
> > started (in thread_manage_health() at health-relayd.c:273)<br>
> ><br>
> > DBG1 - 10:24:56.246222966 [3496/3499]: [thread] Relay dispatcher<br>
> started<br>
> > (in relay_thread_dispatcher() at main.c:1291)<br>
> ><br>
> > DBG1 - 10:24:56.246259512 [3496/3499]: Futex n to 1 prepare done (in<br>
> > futex_nto1_prepare() at futex.c:67)<br>
> ><br>
> > DBG1 - 10:24:56.246266232 [3496/3496]: epoll set max size is<br>
> 7225299 (in<br>
> > compat_epoll_set_max_size() at poll.c:350)<br>
> ><br>
> > DBG1 - 10:24:56.246272226 [3496/3499]: Woken up but nothing in<br>
> the relay<br>
> > command queue (in relay_thread_dispatcher() at main.c:1318)<br>
> ><br>
> > DBG1 - 10:24:56.246224883 [3496/3500]: [thread] Relay worker<br>
> started (in<br>
> > relay_thread_worker() at main.c:3913)<br>
> ><br>
> > DBG1 - 10:24:56.246332173 [3496/3501]: [thread] Relay listener<br>
> started<br>
> > (in relay_thread_listener() at main.c:1089)<br>
> ><br>
> > DBG1 - 10:24:56.246489021 [3496/3498]: Health check ready (in<br>
> > thread_manage_health() at health-relayd.c:364)<br>
> ><br>
> > DBG1 - 10:24:56.246530206 [3496/3501]: Listening on Control listener<br>
> > socket 13 (in relay_socket_create() at main.c:1033)<br>
> ><br>
> > DBG1 - 10:24:56.246595589 [3496/3501]: Listening on Data listener<br>
> socket<br>
> > 14 (in relay_socket_create() at main.c:1033)<br>
> ><br>
> > DBG1 - 10:24:56.246623642 [3496/3501]: Listener accepting<br>
> connections<br>
> > (in relay_thread_listener() at main.c:1136)<br>
> ><br>
> > DBG1 - 10:24:56.246619116 [3496/3502]: [thread] Live viewer relay<br>
> > dispatcher started (in thread_dispatcher() at live.c:849)<br>
> ><br>
> > DBG1 - 10:24:56.246652489 [3496/3502]: Futex n to 1 prepare done (in<br>
> > futex_nto1_prepare() at futex.c:67)<br>
> ><br>
> > DBG1 - 10:24:56.246662832 [3496/3502]: Woken up but nothing in the<br>
> > live-viewer relay command queue (in thread_dispatcher() at<br>
> live.c:876)<br>
> ><br>
> > DBG1 - 10:24:56.246681238 [3496/3503]: [thread] Live viewer relay<br>
> worker<br>
> > started (in thread_worker() at live.c:2451)<br>
> ><br>
> > DBG1 - 10:24:56.246694646 [3496/3504]: [thread] Relay live listener<br>
> > started (in thread_listener() at live.c:686)<br>
> ><br>
> > DBG1 - 10:24:56.246845536 [3496/3504]: Listening on Live listener<br>
> socket<br>
> > 16 (in init_socket() at live.c:650)<br>
> ><br>
> > DBG1 - 10:24:56.246891901 [3496/3504]: Listener accepting live<br>
> viewers<br>
> > connections (in thread_listener() at live.c:720)<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lttng-sessiond -vvv --verbose-consumer -b<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-metadata-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_metadata_client_init() at<br>
> > ../../src/common/ringbuffer-clients/metadata-template.h:364)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-rt-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_rt_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-discard-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-discard-rt-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_rt_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > DBG1 - 10:25:05.693401139 [Main]: [sessiond configuration]<br>
> ><br>
> > DBG1 - 10:25:05.693458872 [Main]: version2.13.10<br>
> ><br>
> > DBG1 - 10:25:05.693469176 [Main]: verbose: 3<br>
> ><br>
> > DBG1 - 10:25:05.693476719 [Main]: verbose consumer:1<br>
> ><br>
> > DBG1 - 10:25:05.693486867 [Main]: quiet mode:False<br>
> ><br>
> > DBG1 - 10:25:05.693493268 [Main]: agent_tcp_port:[5345, 5354]<br>
> ><br>
> > DBG1 - 10:25:05.693501264 [Main]: application socket timeout:5<br>
> ><br>
> > DBG1 - 10:25:05.693506511 [Main]: no-kernel: False<br>
> ><br>
> > DBG1 - 10:25:05.693511705 [Main]: background:True<br>
> ><br>
> > DBG1 - 10:25:05.693517223 [Main]: daemonize: False<br>
> ><br>
> > DBG1 - 10:25:05.693522427 [Main]: signal parent on start:False<br>
> ><br>
> > DBG1 - 10:25:05.693527446 [Main]: tracing group name:tracing<br>
> ><br>
> > DBG1 - 10:25:05.693535560 [Main]: kmod_probe_list: None<br>
> ><br>
> > DBG1 - 10:25:05.693545390 [Main]: kmod_extra_probe_list: None<br>
> ><br>
> > DBG1 - 10:25:05.693550476 [Main]: rundir:/home/yyan7/.lttng<br>
> ><br>
> > DBG1 - 10:25:05.693558977 [Main]: application socket path:<br>
> > /home/yyan7/.lttng/lttng-ust-sock-8<br>
> ><br>
> > DBG1 - 10:25:05.693564632 [Main]: client socket<br>
> > path:/home/yyan7/.lttng/client-lttng-sessiond<br>
> ><br>
> > DBG1 - 10:25:05.693573771 [Main]: wait shm path:<br>
> /lttng-ust-wait-8-1000<br>
> ><br>
> > DBG1 - 10:25:05.693581196 [Main]: health socket<br>
> > path:/home/yyan7/.lttng/sessiond-health<br>
> ><br>
> > DBG1 - 10:25:05.693592417 [Main]: LTTNG_UST_CLOCK_PLUGIN:None<br>
> ><br>
> > DBG1 - 10:25:05.693599715 [Main]: pid file path:<br>
> > /home/yyan7/.lttng/lttng-sessiond.pid<br>
> ><br>
> > DBG1 - 10:25:05.693611177 [Main]: lock file<br>
> > path:/home/yyan7/.lttng/lttng-sessiond.lck<br>
> ><br>
> > DBG1 - 10:25:05.693618666 [Main]: session load path: None<br>
> ><br>
> > DBG1 - 10:25:05.693625291 [Main]: agent port file<br>
> > path:/home/yyan7/.lttng/agent.port<br>
> ><br>
> > DBG1 - 10:25:05.693632721 [Main]: consumerd32<br>
> > path:/home/yyan7/.lttng/ustconsumerd32<br>
> ><br>
> > DBG1 - 10:25:05.693640982 [Main]: consumerd32 bin path:Unknown<br>
> ><br>
> > DBG1 - 10:25:05.693648470 [Main]: consumerd32 lib dir: Unknown<br>
> ><br>
> > DBG1 - 10:25:05.693653601 [Main]: consumerd32 err unix sock<br>
> > path:/home/yyan7/.lttng/ustconsumerd32/error<br>
> ><br>
> > DBG1 - 10:25:05.693660355 [Main]: consumerd32 cmd unix sock<br>
> > path:/home/yyan7/.lttng/ustconsumerd32/command<br>
> ><br>
> > DBG1 - 10:25:05.693668191 [Main]: consumerd64<br>
> > path:/home/yyan7/.lttng/ustconsumerd64<br>
> ><br>
> > DBG1 - 10:25:05.693673539 [Main]: consumerd64 bin<br>
> > path:/usr/lib/x86_64-linux-gnu/lttng/libexec/lttng-consumerd<br>
> ><br>
> > DBG1 - 10:25:05.693682080 [Main]: consumerd64 lib dir:<br>
> > /usr/lib/x86_64-linux-gnu<br>
> ><br>
> > DBG1 - 10:25:05.693689246 [Main]: consumerd64 err unix sock<br>
> > path:/home/yyan7/.lttng/ustconsumerd64/error<br>
> ><br>
> > DBG1 - 10:25:05.693697419 [Main]: consumerd64 cmd unix sock<br>
> > path:/home/yyan7/.lttng/ustconsumerd64/command<br>
> ><br>
> > DBG1 - 10:25:05.693706980 [Main]: kconsumerd path:<br>
> > /home/yyan7/.lttng/kconsumerd<br>
> ><br>
> > DBG1 - 10:25:05.693714339 [Main]: kconsumerd err unix sock path:<br>
> > /home/yyan7/.lttng/kconsumerd/error<br>
> ><br>
> > DBG1 - 10:25:05.693724836 [Main]: kconsumerd cmd unix sock path:<br>
> > /home/yyan7/.lttng/kconsumerd/command<br>
> ><br>
> > DBG1 - 10:25:05.693736058 [Main]: Starting lttng-sessiond<br>
> > {0e76c943-cc93-414c-81d5-259bf7e8d0e4} (in sessiond_uuid_log() at<br>
> > main.c:1437)<br>
> ><br>
> > DBG3 - 10:25:05.693744764 [Main]: Creating LTTng run directory:<br>
> > /home/yyan7/.lttng (in create_lttng_rundir() at main.c:1069)<br>
> ><br>
> > DBG1 - 10:25:05.696358185 [Main]: Resetting run_as worker signal<br>
> > handlers to default (in reset_sighandler() at runas.c:1377)<br>
> ><br>
> > DBG1 - 10:25:05.696480798 [Main]: run_as signal handler set for<br>
> SIGTERM<br>
> > and SIGINT (in set_worker_sighandlers() at runas.c:1438)<br>
> ><br>
> > DBG1 - 10:25:05.697495897 [Main]: Health check time delta in<br>
> seconds set<br>
> > to 20 (in health_init() at health.c:62)<br>
> ><br>
> > DBG1 - 10:25:05.697824357 [HT cleanup]: Entering thread entry<br>
> point (in<br>
> > launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.697915191 [HT cleanup]: startup. (in<br>
> thread_ht_cleanup()<br>
> > at ht-cleanup.c:98)<br>
> ><br>
> > DBG1 - 10:25:05.697964263 [HT cleanup]: epoll set max size is<br>
> 7225299<br>
> > (in compat_epoll_set_max_size() at poll.c:350)<br>
> ><br>
> > DBG3 - 10:25:05.698012958 [Main]: Created hashtable size 4 at<br>
> > 0x5627de049140 of type ULONG (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698041846 [Main]: Created hashtable size 4 at<br>
> > 0x5627de049470 of type ULONG (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698056225 [Main]: Created hashtable size 4 at<br>
> > 0x5627de04bcd0 of type ULONG (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698065318 [HT cleanup]: Polling. (in<br>
> thread_ht_cleanup()<br>
> > at ht-cleanup.c:122)<br>
> ><br>
> > DBG3 - 10:25:05.698087629 [Main]: Created hashtable size 16 at<br>
> > 0x5627de04cf80 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698104568 [Main]: Created hashtable size 16 at<br>
> > 0x5627de04e230 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698117477 [Main]: Created hashtable size 16 at<br>
> > 0x5627de04f630 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698127087 [Main]: Created hashtable size 4 at<br>
> > 0x5627de050a50 of type ULONG (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698142843 [Main]: Created hashtable size 4 at<br>
> > 0x5627de051d90 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG2 - 10:25:05.698158685 [Main]: Creating consumer directory:<br>
> > /home/yyan7/.lttng/ustconsumerd64 (in set_consumer_sockets() at<br>
> main.c:1111)<br>
> ><br>
> > DBG2 - 10:25:05.698296819 [Main]: Creating consumer directory:<br>
> > /home/yyan7/.lttng/ustconsumerd32 (in set_consumer_sockets() at<br>
> main.c:1111)<br>
> ><br>
> > DBG3 - 10:25:05.698395187 [Main]: Created hashtable size 4 at<br>
> > 0x5627de0530d0 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698404718 [Main]: Global buffer per UID registry<br>
> > initialized (in buffer_reg_init_uid_registry() at<br>
> buffer-registry.c:90)<br>
> ><br>
> > DBG3 - 10:25:05.698427501 [Main]: Created hashtable size 4 at<br>
> > 0x5627de054410 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:25:05.698435763 [Main]: Global buffer per PID registry<br>
> > initialized (in buffer_reg_init_pid_registry() at<br>
> buffer-registry.c:219)<br>
> ><br>
> > DBG1 - 10:25:05.698444533 [Main]: Command subsystem initialized (in<br>
> > cmd_init() at cmd.c:6090)<br>
> ><br>
> > DBG1 - 10:25:05.698503908 [Main]: '3506' written in file<br>
> > /home/yyan7/.lttng/lttng-sessiond.pid (in utils_create_pid_file() at<br>
> > utils.c:257)<br>
> ><br>
> > DBG1 - 10:25:05.698588286 [Main]: TCP inet operation timeout set<br>
> to 216<br>
> > sec (in lttcomm_inet_init() at inet.c:545)<br>
> ><br>
> > DBG1 - 10:25:05.698688270 [Main]: Waiting for health management<br>
> thread<br>
> > to be ready (in wait_until_thread_is_ready() at health.c:35)<br>
> ><br>
> > DBG1 - 10:25:05.698771494 [Health management]: Entering thread entry<br>
> > point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.698803482 [Health management]: [thread] Manage<br>
> health<br>
> > check started (in thread_manage_health() at health.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.698964797 [Health management]: Marking health<br>
> management<br>
> > thread as ready (in mark_thread_as_ready() at health.c:28)<br>
> ><br>
> > DBG1 - 10:25:05.698981598 [Health management]: Health check ready<br>
> (in<br>
> > thread_manage_health() at health.c:136)<br>
> ><br>
> > DBG1 - 10:25:05.698991179 [Main]: Health management thread is<br>
> ready (in<br>
> > wait_until_thread_is_ready() at health.c:37)<br>
> ><br>
> > DBG1 - 10:25:05.699062770 [Main]: Waiting for notification thread<br>
> to be<br>
> > ready (in wait_until_thread_is_ready() at notification-thread.c:414)<br>
> ><br>
> > DBG1 - 10:25:05.699151645 [Notification]: Entering thread entry<br>
> point<br>
> > (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.699184431 [Notification]: Started notification<br>
> thread<br>
> > (in thread_notification() at notification-thread.c:642)<br>
> ><br>
> > DBG1 - 10:25:05.699255526 [Notification]: Creating notification<br>
> channel<br>
> > UNIX socket at /home/yyan7/.lttng/sessiond-notification (in<br>
> > notification_channel_socket_create() at notification-thread.c:223)<br>
> ><br>
> > DBG1 - 10:25:05.699357295 [Notification]: Notification channel UNIX<br>
> > socket created (fd = 29) (in notification_channel_socket_create() at<br>
> > notification-thread.c:258)<br>
> ><br>
> > DBG1 - 10:25:05.699387109 [Notification]: Listening on notification<br>
> > channel socket (in init_thread_state() at notification-thread.c:442)<br>
> ><br>
> > DBG1 - 10:25:05.699561257 [Notification]: Marking notification<br>
> thread as<br>
> > ready (in mark_thread_as_ready() at notification-thread.c:407)<br>
> ><br>
> > DBG1 - 10:25:05.699576135 [Notification]: Entering poll wait (in<br>
> > thread_notification() at notification-thread.c:668)<br>
> ><br>
> > DBG1 - 10:25:05.699592002 [Main]: Notification thread is ready (in<br>
> > wait_until_thread_is_ready() at notification-thread.c:416)<br>
> ><br>
> > DBG1 - 10:25:05.699600050 [Action Executor]: Entering thread<br>
> entry point<br>
> > (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.699632561 [Action Executor]: Entering work execution<br>
> > loop (in action_executor_thread() at action-executor.c:761)<br>
> ><br>
> > DBG1 - 10:25:05.699643395 [Action Executor]: No work items enqueued,<br>
> > entering wait (in action_executor_thread() at action-executor.c:770)<br>
> ><br>
> > DBG1 - 10:25:05.699750672 [Timer]: Entering thread entry point (in<br>
> > launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.699770466 [Rotation]: Entering thread entry point<br>
> (in<br>
> > launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.699793428 [Main]: Created client socket (fd = 35)<br>
> (in<br>
> > create_client_sock() at client.c:2435)<br>
> ><br>
> > DBG1 - 10:25:05.699796906 [Rotation]: Started rotation thread (in<br>
> > thread_rotation() at rotation-thread.c:840)<br>
> ><br>
> > DBG1 - 10:25:05.699868561 [Main]: Waiting for client thread to be<br>
> ready<br>
> > (in wait_thread_status() at client.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.699906378 [Client management]: Entering thread entry<br>
> > point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.699943442 [Client management]: [thread] Manage<br>
> client<br>
> > started (in thread_manage_clients() at client.c:2468)<br>
> ><br>
> > DBG1 - 10:25:05.700053570 [Client management]: Marking client<br>
> thread's<br>
> > state as running (in set_thread_status() at client.c:58)<br>
> ><br>
> > DBG1 - 10:25:05.700067760 [Client management]: Accepting client<br>
> command<br>
> > ... (in thread_manage_clients() at client.c:2534)<br>
> ><br>
> > DBG1 - 10:25:05.700076510 [Main]: Client thread is ready (in<br>
> > wait_thread_status() at client.c:68)<br>
> ><br>
> > DBG1 - 10:25:05.700180769 [UST registration dispatch]: Entering<br>
> thread<br>
> > entry point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG3 - 10:25:05.700197002 [Main]: Session daemon application socket<br>
> > created (fd = 41)(in create_application_socket() at register.c:71)<br>
> ><br>
> > DBG1 - 10:25:05.700203416 [UST registration dispatch]: [thread]<br>
> Dispatch<br>
> > UST command started (in thread_dispatch_ust_registration() at<br>
> > dispatch.c:250)<br>
> ><br>
> > DBG1 - 10:25:05.700205198 [Notification]: Poll wait returned (1) (in<br>
> > thread_notification() at notification-thread.c:670)<br>
> ><br>
> > DBG1 - 10:25:05.700255843 [Notification]: Handling fd (29)<br>
> activity (1)<br>
> > (in thread_notification() at notification-thread.c:694)<br>
> ><br>
> > DBG1 - 10:25:05.700269799 [Notification]: Handling new notification<br>
> > channel client connection (in<br>
> > handle_notification_thread_client_connect() at<br>
> > notification-thread-events.c:3351)<br>
> ><br>
> > DBG1 - 10:25:05.700262016 [Main]: Waiting for application<br>
> registration<br>
> > thread to be ready (in wait_thread_status() at register.c:131)<br>
> ><br>
> > DBG1 - 10:25:05.700236776 [UST registration dispatch]: Futex n to 1<br>
> > prepare done (in futex_nto1_prepare() at futex.c:67)<br>
> ><br>
> > DBG1 - 10:25:05.700308063 [Notification]: Client socket (fd = 42)<br>
> set as<br>
> > non-blocking (in socket_set_non_blocking() at<br>
> > notification-thread-events.c:3319)<br>
> ><br>
> > DBG1 - 10:25:05.700319396 [UST registration dispatch]: Woken up but<br>
> > nothing in the UST command queue (in<br>
> thread_dispatch_ust_registration()<br>
> > at dispatch.c:279)<br>
> ><br>
> > DBG1 - 10:25:05.700326116 [Notification]: Added new notification<br>
> channel<br>
> > client socket (42) to poll set (in<br>
> > handle_notification_thread_client_connect() at<br>
> > notification-thread-events.c:3404)<br>
> ><br>
> > DBG1 - 10:25:05.700372936 [Notification]: Entering poll wait (in<br>
> > thread_notification() at notification-thread.c:668)<br>
> ><br>
> > DBG1 - 10:25:05.700383798 [Notification]: Poll wait returned (1) (in<br>
> > thread_notification() at notification-thread.c:670)<br>
> ><br>
> > DBG1 - 10:25:05.700391774 [Notification]: Handling fd (42)<br>
> activity (1)<br>
> > (in thread_notification() at notification-thread.c:694)<br>
> ><br>
> > DBG1 - 10:25:05.700405519 [Notification]: Entering poll wait (in<br>
> > thread_notification() at notification-thread.c:668)<br>
> ><br>
> > DBG1 - 10:25:05.700416164 [Notification]: Poll wait returned (1) (in<br>
> > thread_notification() at notification-thread.c:670)<br>
> ><br>
> > DBG1 - 10:25:05.700424451 [Notification]: Handling fd (42)<br>
> activity (1)<br>
> > (in thread_notification() at notification-thread.c:694)<br>
> ><br>
> > DBG1 - 10:25:05.700439076 [Notification]: Received handshake from<br>
> > client: uid = 1000, gid = 1000, protocol version = 1.1, client is<br>
> > sessiond = true (in client_handle_message_handshake() at<br>
> > notification-thread-events.c:3879)<br>
> ><br>
> > DBG1 - 10:25:05.700450858 [Notification]: Send command reply (0) (in<br>
> > client_send_command_reply() at notification-thread-events.c:3755)<br>
> ><br>
> > DBG1 - 10:25:05.700460524 [Notification]: Flushing client (socket<br>
> fd =<br>
> > 42) outgoing queue (in client_flush_outgoing_queue() at<br>
> > notification-thread-events.c:3644)<br>
> ><br>
> > DBG1 - 10:25:05.700475786 [Notification]: Entering poll wait (in<br>
> > thread_notification() at notification-thread.c:668)<br>
> ><br>
> > DBG1 - 10:25:05.700505488 [Rotation]: Entering poll wait (in<br>
> > thread_rotation() at rotation-thread.c:864)<br>
> ><br>
> > DBG1 - 10:25:05.700506992 [UST application registration]: Entering<br>
> > thread entry point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.700529647 [UST application registration]: [thread]<br>
> > Manage application registration started (in<br>
> > thread_application_registration() at register.c:168)<br>
> ><br>
> > DBG1 - 10:25:05.700597995 [UST application registration]: Marking<br>
> > application registration thread's state as running (in<br>
> > set_thread_status() at register.c:124)<br>
> ><br>
> > DBG1 - 10:25:05.700609984 [UST application registration]: Accepting<br>
> > application registration (in thread_application_registration() at<br>
> > register.c:207)<br>
> ><br>
> > DBG1 - 10:25:05.700616363 [Main]: Application registration thread is<br>
> > ready (in wait_thread_status() at register.c:134)<br>
> ><br>
> > DBG1 - 10:25:05.700627641 [Main]: Notifying applications of session<br>
> > daemon state: 1 (in notify_ust_apps() at register.c:91)<br>
> ><br>
> > DBG1 - 10:25:05.700659113 [Main]: Wait shared memory file descriptor<br>
> > created successfully: path = '/lttng-ust-wait-8-1000', mmap_size<br>
> = 4096,<br>
> > global = false, fd = 45 (in get_wait_shm() at shm.c:133)<br>
> ><br>
> > DBG1 - 10:25:05.700688620 [Main]: Futex wait update active 1 (in<br>
> > futex_wait_update() at futex.c:55)<br>
> ><br>
> > DBG1 - 10:25:05.700795964 [UST application management]: Entering<br>
> thread<br>
> > entry point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.700824549 [UST application management]: [thread]<br>
> Manage<br>
> > application started (in thread_application_management() at<br>
> manage-apps.c:52)<br>
> ><br>
> > DBG1 - 10:25:05.700848435 [Application notification]: Entering<br>
> thread<br>
> > entry point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:25:05.700866212 [Application notification]: [ust-thread]<br>
> > Manage application notify command (in<br>
> thread_application_notification()<br>
> > at notify-apps.c:39)<br>
> ><br>
> > DBG1 - 10:25:05.700913055 [Main]: Waiting for agent management<br>
> thread to<br>
> > be ready (in wait_until_thread_is_ready() at agent-thread.c:348)<br>
> ><br>
> > DBG1 - 10:25:05.700936679 [Agent management]: Entering thread entry<br>
> > point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG3 - 10:25:05.700952021 [Application notification]: [ust-thread]<br>
> > Manage notify polling (in thread_application_notification() at<br>
> > notify-apps.c:74)<br>
> ><br>
> > DBG1 - 10:25:05.700964639 [UST application management]: Apps thread<br>
> > polling (in thread_application_management() at manage-apps.c:88)<br>
> ><br>
> > DBG1 - 10:25:05.700955328 [Agent management]: Manage agent<br>
> application<br>
> > registration. (in thread_agent_management() at agent-thread.c:366)<br>
> ><br>
> > DBG3 - 10:25:05.701062072 [Agent management]: URI string:<br>
> > tcp://localhost (in uri_parse() at uri.c:298)<br>
> ><br>
> > DBG2 - 10:25:05.701282226 [Agent management]: IP address resolved to<br>
> > 127.0.0.1 (in set_ip_address() at uri.c:155)<br>
> ><br>
> > DBG3 - 10:25:05.701292578 [Agent management]: URI dtype: 1,<br>
> proto: 1,<br>
> > host: localhost, subdir: , ctrl: 0, data: 0 (in uri_parse() at<br>
> uri.c:510)<br>
> ><br>
> > DBG3 - 10:25:05.701314205 [Agent management]: Trying to bind on port<br>
> > 5345 (in init_tcp_socket() at agent-thread.c:140)<br>
> ><br>
> > DBG1 - 10:25:05.701330622 [Agent management]: Failed to bind to port<br>
> > 5345 since it is already in use (in init_tcp_socket() at<br>
> agent-thread.c:148)<br>
> ><br>
> > DBG3 - 10:25:05.701338804 [Agent management]: Trying to bind on port<br>
> > 5346 (in init_tcp_socket() at agent-thread.c:140)<br>
> ><br>
> > DBG1 - 10:25:05.701351367 [Agent management]: Listening on TCP<br>
> port 5346<br>
> > and socket 54 (in init_tcp_socket() at agent-thread.c:177)<br>
> ><br>
> > DBG1 - 10:25:05.701413970 [Agent management]: '5346' written in file<br>
> > /home/yyan7/.lttng/agent.port (in utils_create_pid_file() at<br>
> utils.c:257)<br>
> ><br>
> > DBG1 - 10:25:05.701452432 [Agent management]: Marking agent<br>
> management<br>
> > thread as ready (in mark_thread_as_ready() at agent-thread.c:341)<br>
> ><br>
> > DBG3 - 10:25:05.701466232 [Agent management]: Manage agent<br>
> polling (in<br>
> > thread_agent_management() at agent-thread.c:421)<br>
> ><br>
> > DBG1 - 10:25:05.701544565 [Main]: Agent management thread is<br>
> ready (in<br>
> > wait_until_thread_is_ready() at agent-thread.c:350)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-discard-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-discard-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3505/3505]: LTT : ltt ring buffer client<br>
> > "relay-metadata-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_metadata_client_exit() at<br>
> > ../../src/common/ringbuffer-clients/metadata-template.h:371)<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ ps -ef | grep lttng<br>
> ><br>
> > root 760 10 09:40 ?00:00:00 /usr/bin/*lttng*-sessiond<br>
> ><br>
> > root 808 7600 09:40 ?00:00:00 /usr/bin/*lttng*-sessiond<br>
> ><br>
> > yyan7 3496 10 10:24 ?00:00:00 *lttng*-relayd -v -b<br>
> ><br>
> > yyan7 3506 10 10:25 ?00:00:00 *lttng*-sessiond -vvv<br>
> --verbose-consumer -b<br>
> ><br>
> > yyan7 350735060 10:25 ?00:00:00 *lttng*-sessiond -vvv<br>
> --verbose-consumer -b<br>
> ><br>
> > yyan7 352229970 10:25 pts/000:00:00 grep --color=auto *lttng*<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lttng create<br>
> ><br>
> > DBG1 - 10:25:35.436359096 [Client management]: Wait for client<br>
> response<br>
> > (in thread_manage_clients() at client.c:2576)<br>
> ><br>
> > DBG1 - 10:25:35.436403534 [Client management]: Receiving data from<br>
> > client ... (in thread_manage_clients() at client.c:2604)<br>
> ><br>
> > DBG1 - 10:25:35.436419086 [Client management]: Incomplete recv()<br>
> from<br>
> > client... continuing (in thread_manage_clients() at client.c:2608)<br>
> ><br>
> > DBG1 - 10:25:35.436438855 [Client management]: Accepting client<br>
> command<br>
> > ... (in thread_manage_clients() at client.c:2534)<br>
> ><br>
> > DBG1 - 10:25:35.436458714 [Client management]: Wait for client<br>
> response<br>
> > (in thread_manage_clients() at client.c:2576)<br>
> ><br>
> > DBG1 - 10:25:35.436480694 [Client management]: Receiving data from<br>
> > client ... (in thread_manage_clients() at client.c:2604)<br>
> ><br>
> > DBG1 - 10:25:35.436493760 [Client management]: Incomplete recv()<br>
> from<br>
> > client... continuing (in thread_manage_clients() at client.c:2608)<br>
> ><br>
> > DBG1 - 10:25:35.436514391 [Client management]: Accepting client<br>
> command<br>
> > ... (in thread_manage_clients() at client.c:2534)<br>
> ><br>
> > DBG1 - 10:25:35.436522846 [Client management]: Wait for client<br>
> response<br>
> > (in thread_manage_clients() at client.c:2576)<br>
> ><br>
> > DBG1 - 10:25:35.436539198 [Client management]: Receiving data from<br>
> > client ... (in thread_manage_clients() at client.c:2604)<br>
> ><br>
> > DBG1 - 10:25:35.436561992 [Client management]: Processing client<br>
> command<br>
> > 'LTTNG_CREATE_SESSION_EXT' (49) (in process_client_msg() at<br>
> client.c:1016)<br>
> ><br>
> > DBG3 - 10:25:35.436644534 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c0090b0 of type ULONG (in lttng_ht_new() at<br>
> hashtable.c:152)<br>
> ><br>
> > DBG2 - 10:25:35.436670494 [Client management]: Trying to find<br>
> session by<br>
> > name auto-20240112-102535 (in session_find_by_name() at<br>
> session.c:1143)<br>
> ><br>
> > DBG1 - 10:25:35.436679003 [Client management]: Generated session<br>
> name<br>
> > "auto-20240112-102535" (in session_create() at session.c:1300)<br>
> ><br>
> > DBG3 - 10:25:35.436693861 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c00a3f0 of type ULONG (in lttng_ht_new() at<br>
> hashtable.c:152)<br>
> ><br>
> > DBG1 - 10:25:35.436702475 [Client management]: Allocating<br>
> > ltt_sessions_ht_by_id (in ltt_sessions_ht_alloc() at session.c:306)<br>
> ><br>
> > DBG3 - 10:25:35.436719034 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c00b730 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG1 - 10:25:35.436727024 [Client management]: Allocating<br>
> > ltt_sessions_ht_by_name (in ltt_sessions_ht_alloc() at session.c:314)<br>
> ><br>
> > DBG3 - 10:25:35.436739320 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c00ca70 of type STRING (in lttng_ht_new() at<br>
> hashtable.c:152)<br>
> ><br>
> > DBG1 - 10:25:35.436750021 [Client management]: Tracing session<br>
> > auto-20240112-102535 created with ID 0 by uid = 1000, gid = 1000 (in<br>
> > session_create() at session.c:1348)<br>
> ><br>
> > DBG3 - 10:25:35.436761891 [Client management]: URI string:<br>
> > file:///home/yyan7/lttng-traces/auto-20240112-102535 (in<br>
> uri_parse() at<br>
> > uri.c:298)<br>
> ><br>
> > DBG3 - 10:25:35.436786010 [Client management]: URI file destination:<br>
> > /home/yyan7/lttng-traces/auto-20240112-102535 (in uri_parse() at<br>
> uri.c:335)<br>
> ><br>
> > DBG3 - 10:25:35.436794369 [Client management]: URI dtype: 3,<br>
> proto: 0,<br>
> > host: , subdir: , ctrl: 0, data: 0 (in uri_parse() at uri.c:510)<br>
> ><br>
> > DBG2 - 10:25:35.436815787 [Client management]: Setting trace<br>
> directory<br>
> > path from URI to /home/yyan7/lttng-traces/auto-20240112-102535 (in<br>
> > add_uri_to_consumer() at cmd.c:719)<br>
> ><br>
> > DBG1 - 10:25:35.436861339 [Client management]: Sending response<br>
> (size:<br>
> > 8262, retcode: Success (10)) (in thread_manage_clients() at<br>
> client.c:2683)<br>
> ><br>
> > DBG1 - 10:25:35.436885647 [Client management]: Accepting client<br>
> command<br>
> > ... (in thread_manage_clients() at client.c:2534)<br>
> ><br>
> > DBG1 - 10:25:35.437011410 [Client management]: Wait for client<br>
> response<br>
> > (in thread_manage_clients() at client.c:2576)<br>
> ><br>
> > DBG1 - 10:25:35.437037211 [Client management]: Receiving data from<br>
> > client ... (in thread_manage_clients() at client.c:2604)<br>
> ><br>
> > DBG1 - 10:25:35.437050433 [Client management]: Incomplete recv()<br>
> from<br>
> > client... continuing (in thread_manage_clients() at client.c:2608)<br>
> ><br>
> > DBG1 - 10:25:35.437065744 [Client management]: Accepting client<br>
> command<br>
> > ... (in thread_manage_clients() at client.c:2534)<br>
> ><br>
> > DBG1 - 10:25:35.437074955 [Client management]: Wait for client<br>
> response<br>
> > (in thread_manage_clients() at client.c:2576)<br>
> ><br>
> > DBG1 - 10:25:35.437088320 [Client management]: Receiving data from<br>
> > client ... (in thread_manage_clients() at client.c:2604)<br>
> ><br>
> > DBG1 - 10:25:35.437107173 [Client management]: Processing client<br>
> command<br>
> > 'LTTNG_LIST_SESSIONS' (13) (in process_client_msg() at client.c:1016)<br>
> ><br>
> > DBG1 - 10:25:35.437120952 [Client management]: Counting number of<br>
> > available session for UID 1000 (in lttng_sessions_count() at<br>
> client.c:596)<br>
> ><br>
> > DBG1 - 10:25:35.437130882 [Client management]: Getting all available<br>
> > session for UID 1000 GID 1000 (in cmd_list_lttng_sessions() at<br>
> cmd.c:3947)<br>
> ><br>
> > DBG1 - 10:25:35.437141977 [Client management]: Sending response<br>
> (size:<br>
> > 4409, retcode: Success (10)) (in thread_manage_clients() at<br>
> client.c:2683)<br>
> ><br>
> > DBG1 - 10:25:35.437163179 [Client management]: Accepting client<br>
> command<br>
> > ... (in thread_manage_clients() at client.c:2534)<br>
> ><br>
> > Session auto-20240112-102535 created.<br>
> ><br>
> > Traces will be output to<br>
> /home/yyan7/lttng-traces/auto-20240112-102535<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lttng enable-event -u -all<br>
> ><br>
> > Error: Only one domain must be specified.<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ lttng enable-event -u -a<br>
> ><br>
> > DBG1 - 10:26:09.048651842 [Client management]: Wait for client<br>
> response<br>
> > (in thread_manage_clients() at client.c:2576)<br>
> ><br>
> > DBG1 - 10:26:09.048698882 [Client management]: Receiving data from<br>
> > client ... (in thread_manage_clients() at client.c:2604)<br>
> ><br>
> > DBG1 - 10:26:09.048730037 [Client management]: Processing client<br>
> command<br>
> > 'LTTNG_ENABLE_EVENT' (6) (in process_client_msg() at client.c:1016)<br>
> ><br>
> > DBG1 - 10:26:09.048742929 [Client management]: Getting session<br>
> > auto-20240112-102535 by name (in process_client_msg() at<br>
> client.c:1133)<br>
> ><br>
> > DBG2 - 10:26:09.048752328 [Client management]: Trying to find<br>
> session by<br>
> > name auto-20240112-102535 (in session_find_by_name() at<br>
> session.c:1143)<br>
> ><br>
> > DBG1 - 10:26:09.048762009 [Client management]: Creating UST<br>
> session (in<br>
> > create_ust_session() at client.c:510)<br>
> ><br>
> > DBG3 - 10:26:09.048777715 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c00ffd0 of type STRING (in lttng_ht_new() at<br>
> hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.048801459 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c011310 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.048877638 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c020120 of type ULONG (in lttng_ht_new() at<br>
> hashtable.c:152)<br>
> ><br>
> > DBG2 - 10:26:09.048886268 [Client management]: UST trace session<br>
> create<br>
> > successful (in trace_ust_create_session() at trace-ust.c:324)<br>
> ><br>
> > DBG3 - 10:26:09.048894968 [Client management]: Copying tracing<br>
> session<br>
> > consumer output in UST session (in copy_session_consumer() at<br>
> client.c:454)<br>
> ><br>
> > DBG3 - 10:26:09.048930287 [Client management]: Created hashtable<br>
> size 4<br>
> > at 0x7fd67c0213d0 of type ULONG (in lttng_ht_new() at<br>
> hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.048944965 [Client management]: Copy session consumer<br>
> > subdir ust (in copy_session_consumer() at client.c:476)<br>
> ><br>
> > DBG1 - 10:26:09.048955915 [Client management]: Spawning consumerd<br>
> (in<br>
> > spawn_consumerd() at client.c:204)<br>
> ><br>
> > DBG3 - 10:26:09.048988740 [HT cleanup]: Returning from poll on 2<br>
> fds.<br>
> > (in thread_ht_cleanup() at ht-cleanup.c:125)<br>
> ><br>
> > DBG2 - 10:26:09.049819491 [Client management]: Consumer pid 3526 (in<br>
> > start_consumerd() at client.c:390)<br>
> ><br>
> > DBG2 - 10:26:09.049855514 [Client management]: Spawning consumer<br>
> control<br>
> > thread (in start_consumerd() at client.c:393)<br>
> ><br>
> > DBG1 - 10:26:09.049986094 [Client management]: Waiting for consumer<br>
> > management thread to be ready (in wait_until_thread_is_ready() at<br>
> > manage-consumer.c:46)<br>
> ><br>
> > DBG1 - 10:26:09.050081839 [Consumer management]: Entering thread<br>
> entry<br>
> > point (in launch_thread() at thread.c:65)<br>
> ><br>
> > DBG1 - 10:26:09.050074834 [Client management]: Using 64-bit UST<br>
> consumer<br>
> > at: /usr/lib/x86_64-linux-gnu/lttng/libexec/lttng-consumerd (in<br>
> > spawn_consumerd() at client.c:284)<br>
> ><br>
> > DBG1 - 10:26:09.050117556 [Consumer management]: [thread] Manage<br>
> > consumer started (in thread_consumer_management() at<br>
> manage-consumer.c:65)<br>
> ><br>
> > DBG3 - 10:26:09.050103089 [HT cleanup]: Polling. (in<br>
> thread_ht_cleanup()<br>
> > at ht-cleanup.c:122)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-metadata-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_metadata_client_init() at<br>
> > ../../src/common/ringbuffer-clients/metadata-template.h:364)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-rt-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_rt_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-discard-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-discard-rt-mmap" init<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_rt_init() at<br>
> > ../../src/common/ringbuffer-clients/template.h:826)<br>
> ><br>
> > DBG1 - 10:26:09.054724418 [3526/3526]: Health check time delta in<br>
> > seconds set to 20 (in health_init() at health.c:62)<br>
> ><br>
> > DBG3 - 10:26:09.054993129 [3526/3526]: Created hashtable size 4 at<br>
> > 0x561838919540 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.055012947 [3526/3526]: Created hashtable size 4 at<br>
> > 0x561838919870 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.055026387 [3526/3526]: Created hashtable size 4 at<br>
> > 0x561838919ba0 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.055038707 [3526/3526]: Created hashtable size 4 at<br>
> > 0x561838919ed0 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.055052418 [3526/3526]: Created hashtable size 4 at<br>
> > 0x56183891eb00 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.055070118 [3526/3526]: Created hashtable size 4 at<br>
> > 0x56183891fe40 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG3 - 10:26:09.055079438 [3526/3526]: Created hashtable size 4 at<br>
> > 0x561838921180 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG1 - 10:26:09.055131986 [3526/3526]: TCP inet operation timeout<br>
> set to<br>
> > 216 sec (in lttcomm_inet_init() at inet.c:545)<br>
> ><br>
> > DBG1 - 10:26:09.055169397 [3526/3526]: Connecting to error socket<br>
> > /home/yyan7/.lttng/ustconsumerd64/error (in main() at<br>
> lttng-consumerd.c:477)<br>
> ><br>
> > DBG2 - 10:26:09.055307314 [Consumer management]: Receiving code from<br>
> > consumer err_sock (in thread_consumer_management() at<br>
> manage-consumer.c:162)<br>
> ><br>
> > DBG1 - 10:26:09.055374257 [3526/3530]: [thread] Manage health check<br>
> > started (in thread_manage_health() at health-consumerd.c:157)<br>
> ><br>
> > DBG1 - 10:26:09.055528236 [3526/3530]: epoll set max size is<br>
> 7225299 (in<br>
> > compat_epoll_set_max_size() at poll.c:350)<br>
> ><br>
> > DBG1 - 10:26:09.055617358 [3526/3530]: Health check ready (in<br>
> > thread_manage_health() at health-consumerd.c:237)<br>
> ><br>
> > DBG1 - 10:26:09.155778508 [3526/3533]: Thread metadata poll<br>
> started (in<br>
> > consumer_thread_metadata_poll() at consumer.c:2344)<br>
> ><br>
> > DBG3 - 10:26:09.155827680 [3526/3532]: Created hashtable size 4 at<br>
> > 0x7fb838000b90 of type U64 (in lttng_ht_new() at hashtable.c:152)<br>
> ><br>
> > DBG1 - 10:26:09.155854441 [3526/3532]: Thread channel poll<br>
> started (in<br>
> > consumer_thread_channel_poll() at consumer.c:2938)<br>
> ><br>
> > DBG1 - 10:26:09.155873849 [3526/3532]: Channel main loop started (in<br>
> > consumer_thread_channel_poll() at consumer.c:2953)<br>
> ><br>
> > DBG1 - 10:26:09.155884744 [3526/3532]: Channel poll wait (in<br>
> > consumer_thread_channel_poll() at consumer.c:2958)<br>
> ><br>
> > DBG1 - 10:26:09.155910091 [3526/3533]: Metadata main loop started<br>
> (in<br>
> > consumer_thread_metadata_poll() at consumer.c:2360)<br>
> ><br>
> > DBG1 - 10:26:09.155915209 [3526/3535]: Creating command socket<br>
> > /home/yyan7/.lttng/ustconsumerd64/command (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3201)<br>
> ><br>
> > DBG1 - 10:26:09.155927055 [3526/3533]: Metadata poll wait (in<br>
> > consumer_thread_metadata_poll() at consumer.c:2366)<br>
> ><br>
> > DBG1 - 10:26:09.155902292 [3526/3534]: Updating poll fd array (in<br>
> > update_poll_array() at consumer.c:1176)<br>
> ><br>
> > DBG1 - 10:26:09.155992208 [3526/3534]: polling on 2 fd (in<br>
> > consumer_thread_data_poll() at consumer.c:2627)<br>
> ><br>
> > DBG1 - 10:26:09.156028520 [3526/3535]: Sending ready command to<br>
> > lttng-sessiond (in consumer_thread_sessiond_poll() at<br>
> consumer.c:3214)<br>
> ><br>
> > DBG1 - 10:26:09.156117370 [3526/3535]: Connection on<br>
> client_socket (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3236)<br>
> ><br>
> > DBG1 - 10:26:09.156118051 [Consumer management]: Consumer command<br>
> socket<br>
> > ready (fd: 61) (in thread_consumer_management() at<br>
> manage-consumer.c:204)<br>
> ><br>
> > DBG1 - 10:26:09.156134055 [Consumer management]: Consumer metadata<br>
> > socket ready (fd: 62) (in thread_consumer_management() at<br>
> > manage-consumer.c:205)<br>
> ><br>
> > DBG1 - 10:26:09.156140605 [3526/3535]: Metadata connection on<br>
> > client_socket (in set_metadata_socket() at consumer.c:3162)<br>
> ><br>
> > DBG1 - 10:26:09.156159591 [Consumer management]: Sending consumer<br>
> > initialization command (in consumer_init() at consumer.c:1791)<br>
> ><br>
> > DBG1 - 10:26:09.156197563 [3526/3535]: Incoming command on sock (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3282)<br>
> ><br>
> > DBG1 - 10:26:09.156239708 [3526/3535]: Received session daemon UUID:<br>
> > 0e76c943-cc93-414c-81d5-259bf7e8d0e4 (in<br>
> lttng_consumer_init_command()<br>
> > at consumer.c:4711)<br>
> ><br>
> > DBG1 - 10:26:09.156260388 [3526/3535]: Received command on sock (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3298)<br>
> ><br>
> > DBG3 - 10:26:09.156271768 [Consumer management]: Sending<br>
> > SET_CHANNEL_MONITOR_PIPE command to consumer (in<br>
> consumer_send_pipe() at<br>
> > consumer.c:1230)<br>
> ><br>
> > DBG1 - 10:26:09.156298833 [3526/3535]: Incoming command on sock (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3282)<br>
> ><br>
> > DBG3 - 10:26:09.156339394 [Consumer management]: Sending channel<br>
> monitor<br>
> > pipe 16 to consumer on socket 61 (in consumer_send_pipe() at<br>
> > consumer.c:1236)<br>
> ><br>
> > DBG1 - 10:26:09.156373728 [3526/3535]: Received channel monitor pipe<br>
> > (27) (in lttng_ustconsumer_recv_cmd() at ust-consumer.c:2017)<br>
> ><br>
> > DBG1 - 10:26:09.156385429 [3526/3535]: Channel monitor pipe set as<br>
> > non-blocking (in lttng_ustconsumer_recv_cmd() at ust-consumer.c:2040)<br>
> ><br>
> > DBG1 - 10:26:09.156398125 [3526/3535]: Received command on sock (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3298)<br>
> ><br>
> > DBG2 - 10:26:09.156408026 [Consumer management]: channel monitor<br>
> pipe<br>
> > successfully sent (in consumer_send_pipe() at consumer.c:1244)<br>
> ><br>
> > DBG1 - 10:26:09.156521209 [Consumer management]: Marking consumer<br>
> > management thread as ready (in mark_thread_as_ready() at<br>
> > manage-consumer.c:31)<br>
> ><br>
> > DBG1 - 10:26:09.156618144 [Client management]: Consumer management<br>
> > thread is ready (in wait_until_thread_is_ready() at<br>
> manage-consumer.c:48)<br>
> ><br>
> > DBG3 - 10:26:09.156649336 [Client management]: Consumer socket<br>
> created<br>
> > (fd: 61) and added to output (in consumer_create_socket() at<br>
> consumer.c:351)<br>
> ><br>
> > *DBG1 - 10:26:09.156661610 [Client management]: Setting relayd for<br>
> > session auto-20240112-102535 (in cmd_setup_relayd() at cmd.c:1004)*<br>
> ><br>
> > *lttng-sessiond: unix.c:185: lttcomm_recv_unix_sock: Assertion `buf'<br>
> > failed.*<br>
> ><br>
> > DBG1 - 10:26:10.269878943 [3526/3535]: Incoming command on sock (in<br>
> > consumer_thread_sessiond_poll() at consumer.c:3282)<br>
> ><br>
> > DBG1 - 10:26:10.269909824 [3526/3535]: Consumer received unexpected<br>
> > message size 0 (expects 12690) (in lttng_ustconsumer_recv_cmd() at<br>
> > ust-consumer.c:1401)<br>
> ><br>
> > DBG1 - 10:26:10.269918771 [3526/3535]: Communication interrupted on<br>
> > command socket (in consumer_thread_sessiond_poll() at<br>
> consumer.c:3289)<br>
> ><br>
> > DBG1 - 10:26:10.269924634 [3526/3535]: Consumer thread sessiond poll<br>
> > exiting (in consumer_thread_sessiond_poll() at consumer.c:3304)<br>
> ><br>
> > Error: Events: No session daemon is available (channel channel0,<br>
> session<br>
> > auto-20240112-102535)<br>
> ><br>
> > DBG1 - 10:26:10.269945294 [3526/3535]: UST consumer closing all<br>
> metadata<br>
> > streams (in lttng_ustconsumer_close_all_metadata() at<br>
> ust-consumer.c:3278)<br>
> ><br>
> > DBG1 - 10:26:10.270034860 [3526/3534]: poll num_rdy : 1 (in<br>
> > consumer_thread_data_poll() at consumer.c:2634)<br>
> ><br>
> > DBG1 - 10:26:10.270051195 [3526/3532]: Channel poll return from wait<br>
> > with 1 fd(s) (in consumer_thread_channel_poll() at consumer.c:2961)<br>
> ><br>
> > DBG1 - 10:26:10.270085710 [3526/3532]: Channel event caught in<br>
> thread<br>
> > (in consumer_thread_channel_poll() at consumer.c:2964)<br>
> ><br>
> > DBG1 - 10:26:10.270066746 [3526/3534]: consumer_data_pipe wake up<br>
> (in<br>
> > consumer_thread_data_poll() at consumer.c:2664)<br>
> ><br>
> > DBG1 - 10:26:10.270051357 [3526/3530]: Health check thread dying (in<br>
> > thread_manage_health() at health-consumerd.c:334)<br>
> ><br>
> > DBG1 - 10:26:10.270114085 [3526/3532]: Channel poll wait (in<br>
> > consumer_thread_channel_poll() at consumer.c:2958)<br>
> ><br>
> > DBG1 - 10:26:10.270151938 [3526/3532]: Channel poll return from wait<br>
> > with 0 fd(s) (in consumer_thread_channel_poll() at consumer.c:2961)<br>
> ><br>
> > DBG1 - 10:26:10.270163529 [3526/3532]: Channel event caught in<br>
> thread<br>
> > (in consumer_thread_channel_poll() at consumer.c:2964)<br>
> ><br>
> > DBG1 - 10:26:10.270115093 [3526/3534]: Consumer delete flagged data<br>
> > stream (in validate_endpoint_status_data_stream() at consumer.c:2274)<br>
> ><br>
> > DBG1 - 10:26:10.270187345 [3526/3534]: polling thread exiting (in<br>
> > consumer_thread_data_poll() at consumer.c:2806)<br>
> ><br>
> > DBG1 - 10:26:10.270226737 [3526/3533]: Metadata poll return from<br>
> wait<br>
> > with 1 fd(s) (in consumer_thread_metadata_poll() at consumer.c:2368)<br>
> ><br>
> > DBG1 - 10:26:10.270255651 [3526/3533]: Metadata event caught in<br>
> thread<br>
> > (in consumer_thread_metadata_poll() at consumer.c:2371)<br>
> ><br>
> > DBG1 - 10:26:10.270264901 [3526/3533]: Metadata thread pipe hung<br>
> up (in<br>
> > consumer_thread_metadata_poll() at consumer.c:2426)<br>
> ><br>
> > DBG1 - 10:26:10.270270628 [3526/3532]: Channel poll thread<br>
> exiting (in<br>
> > consumer_thread_channel_poll() at consumer.c:3140)<br>
> ><br>
> > DBG1 - 10:26:10.270284048 [3526/3533]: Metadata poll wait (in<br>
> > consumer_thread_metadata_poll() at consumer.c:2366)<br>
> ><br>
> > DBG1 - 10:26:10.270292833 [3526/3533]: Metadata poll return from<br>
> wait<br>
> > with 0 fd(s) (in consumer_thread_metadata_poll() at consumer.c:2368)<br>
> ><br>
> > DBG1 - 10:26:10.270300375 [3526/3533]: Metadata event caught in<br>
> thread<br>
> > (in consumer_thread_metadata_poll() at consumer.c:2371)<br>
> ><br>
> > DBG1 - 10:26:10.270310033 [3526/3533]: Metadata poll thread<br>
> exiting (in<br>
> > consumer_thread_metadata_poll() at consumer.c:2521)<br>
> ><br>
> > DBG1 - 10:26:10.270463392 [3526/3526]: Releasing trace chunk<br>
> registry to<br>
> > all trace chunks (in lttng_trace_chunk_registry_put_each_chunk() at<br>
> > trace-chunk.c:2221)<br>
> ><br>
> > DBG1 - 10:26:10.270476593 [3526/3526]: Released reference to 0 trace<br>
> > chunks in lttng_trace_chunk_registry_put_each_chunk() (in<br>
> > lttng_trace_chunk_registry_put_each_chunk() at trace-chunk.c:2254)<br>
> ><br>
> > DBG1 - 10:26:10.270667263 [3526/3526]: Consumer destroying it.<br>
> Closing<br>
> > everything. (in lttng_consumer_destroy() at consumer.c:1546)<br>
> ><br>
> > DBG1 - 10:26:10.270812838 [3526/3526]: Destroying run_as worker (in<br>
> > run_as_destroy_worker_no_lock() at runas.c:1576)<br>
> ><br>
> > DBG1 - 10:26:10.270818934 [3526/3526]: Closing run_as worker<br>
> socket (in<br>
> > run_as_destroy_worker_no_lock() at runas.c:1581)<br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$ libringbuffer-clients[3528/3528]: LTT<br>
> : ltt<br>
> > ring buffer client "relay-discard-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3528/3528]: LTT : ltt ring buffer client<br>
> > "relay-discard-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3528/3528]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3528/3528]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3528/3528]: LTT : ltt ring buffer client<br>
> > "relay-metadata-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_metadata_client_exit() at<br>
> > ../../src/common/ringbuffer-clients/metadata-template.h:371)<br>
> ><br>
> > DBG1 - 10:26:10.271345058 [3526/3526]: lttng-runas terminated with<br>
> > status code 0 (in run_as_destroy_worker_no_lock() at runas.c:1601)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-discard-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-discard-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3526/3526]: LTT : ltt ring buffer client<br>
> > "relay-metadata-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_metadata_client_exit() at<br>
> > ../../src/common/ringbuffer-clients/metadata-template.h:371)<br>
> ><br>
> > DBG1 - 10:26:10.271715039 [Run-as worker]: run_as worker exiting<br>
> (ret =<br>
> > 0) (in run_as_create_worker_no_lock() at runas.c:1526)<br>
> ><br>
> > libringbuffer-clients[3507/3507]: LTT : ltt ring buffer client<br>
> > "relay-discard-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3507/3507]: LTT : ltt ring buffer client<br>
> > "relay-discard-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_discard_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3507/3507]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-rt-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_rt_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3507/3507]: LTT : ltt ring buffer client<br>
> > "relay-overwrite-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_client_overwrite_exit() at<br>
> > ../../src/common/ringbuffer-clients/template.h:833)<br>
> ><br>
> > libringbuffer-clients[3507/3507]: LTT : ltt ring buffer client<br>
> > "relay-metadata-mmap" exit<br>
> ><br>
> > (in lttng_ring_buffer_metadata_client_exit() at<br>
> > ../../src/common/ringbuffer-clients/metadata-template.h:371)<br>
> ><br>
> ><br>
> > *yyan7@CCI13SZWP3LWS*:*~*$<br>
> ><br>
> ><br>
> ><br>
> > On Fri, Jan 12, 2024 at 10:01 AM Kienan Stewart<br>
> <<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a> <mailto:<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a>><br>
> > <mailto:<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a> <mailto:<a href="mailto:kstewart@efficios.com" target="_blank">kstewart@efficios.com</a>>>> wrote:<br>
> ><br>
> > Hi Yonghong,<br>
> ><br>
> > in a brief test I'm unable to reproduce the error you see by<br>
> running<br>
> > the<br>
> > following commands on an Ubuntu 22.04 installation with<br>
> lttng-tools<br>
> > 2.13.10, lttng-ust 2.13.6, urcu stable-0.12, and babeltrace<br>
> stable-2.0.<br>
> > ```<br>
> > $ uname -r -v<br>
> > 6.5.0-14-generic #14~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Mon<br>
> Nov 20<br>
> > 18:15:30 UTC 2<br>
> ><br>
> > $ lttng-relayd -v -b<br>
> > $ lttng-sessiond -v -b<br>
> > $ lttng create<br>
> > $ lttng enable-event -u --all<br>
> > ```<br>
> ><br>
> > Could you please review the bug reporting guidelines at<br>
> > <a href="https://lttng.org/community/" rel="noreferrer" target="_blank">https://lttng.org/community/</a> <<a href="https://lttng.org/community/" rel="noreferrer" target="_blank">https://lttng.org/community/</a>><br>
> <<a href="https://lttng.org/community/" rel="noreferrer" target="_blank">https://lttng.org/community/</a> <<a href="https://lttng.org/community/" rel="noreferrer" target="_blank">https://lttng.org/community/</a>>> and<br>
> > elaborate on the steps taken to<br>
> > reproduce the issue?<br>
> ><br>
> > thanks,<br>
> > kienan<br>
> ><br>
> > On 1/12/24 08:12, Yonghong Yan via lttng-dev wrote:<br>
> > > I am not sure whether this is my setting problem or a bug<br>
> with a<br>
> > > more recent kernel. lttng-sessiond was killed when I tried to<br>
> > "enable<br>
> > > event" after a session was created. See below part of the<br>
> verbose<br>
> > output<br>
> > > of the sessiond. It is observed on Ubuntu 22.04, kernel<br>
> > 6.5.0-14-generic<br>
> > > #14~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC, lttng (LTTng Trace<br>
> Control)<br>
> > > 2.13.10 - Nordicité.<br>
> > ><br>
> > ><br>
> > > The same version of LTTng works on another Ubuntu 22.04<br>
> machine, but<br>
> > > with kernel 6.2.0-33-generic. Any suggestion on what I<br>
> should try?<br>
> > ><br>
> > ><br>
> > > Thank you<br>
> > ><br>
> > > Yonghong<br>
> > ><br>
> > ><br>
> > ><br>
> > > c:1016)<br>
> > ><br>
> > > DBG1 - 00:24:25.134138433 [Client management]: Getting session<br>
> > > auto-20240112-002417 by name (in process_client_msg() at<br>
> > client.c:1133)<br>
> > ><br>
> > > DBG1 - 00:24:25.134148894 [Client management]: Creating UST<br>
> > session (in<br>
> > > create_ust_session() at client.c:510)<br>
> > ><br>
> > > DBG1 - 00:24:25.134267958 [Client management]: Spawning<br>
> consumerd<br>
> > (in<br>
> > > spawn_consumerd() at client.c:204)<br>
> > ><br>
> > > DBG1 - 00:24:25.135155823 [Client management]: Waiting for<br>
> consumer<br>
> > > management thread to be ready (in<br>
> wait_until_thread_is_ready() at<br>
> > > manage-consumer.c:46)<br>
> > ><br>
> > > DBG1 - 00:24:25.135247552 [Consumer management]: Entering<br>
> thread<br>
> > entry<br>
> > > point (in launch_thread() at thread.c:65)<br>
> > ><br>
> > > DBG1 - 00:24:25.135293542 [Consumer management]: [thread]<br>
> Manage<br>
> > > consumer started (in thread_consumer_management() at<br>
> > manage-consumer.c:65)<br>
> > ><br>
> > > DBG1 - 00:24:25.135335776 [Client management]: Using<br>
> 64-bit UST<br>
> > consumer<br>
> > > at:<br>
> /usr/lib/x86_64-linux-gnu/lttng/libexec/lttng-consumerd (in<br>
> > > spawn_consumerd() at client.c:284)<br>
> > ><br>
> > > DBG1 - 00:24:25.240725883 [Consumer management]: Consumer<br>
> command<br>
> > socket<br>
> > > ready (fd: 61) (in thread_consumer_management() at<br>
> > manage-consumer.c:204)<br>
> > ><br>
> > > DBG1 - 00:24:25.240746802 [Consumer management]: Consumer<br>
> metadata<br>
> > > socket ready (fd: 62) (in thread_consumer_management() at<br>
> > > manage-consumer.c:205)<br>
> > ><br>
> > > DBG1 - 00:24:25.240775318 [Consumer management]: Sending<br>
> consumer<br>
> > > initialization command (in consumer_init() at consumer.c:1791)<br>
> > ><br>
> > > DBG1 - 00:24:25.241066762 [Consumer management]: Marking<br>
> consumer<br>
> > > management thread as ready (in mark_thread_as_ready() at<br>
> > > manage-consumer.c:31)<br>
> > ><br>
> > > DBG1 - 00:24:25.241100481 [Client management]: Consumer<br>
> management<br>
> > > thread is ready (in wait_until_thread_is_ready() at<br>
> > manage-consumer.c:48)<br>
> > ><br>
> > > DBG1 - 00:24:25.241138386 [Client management]: Setting<br>
> relayd for<br>
> > > session auto-20240112-002417 (in cmd_setup_relayd() at<br>
> cmd.c:1004)<br>
> > ><br>
> > > lttng-sessiond: unix.c:185: lttcomm_recv_unix_sock: Assertion<br>
> > `buf' failed.<br>
> > ><br>
> > > Error: Events: No session daemon is available (channel<br>
> channel0,<br>
> > session<br>
> > > auto-20240112-002417)<br>
> > ><br>
> > > [1]+Aborted (core dumped) lttng-sessiond --verbose<br>
> > ><br>
> > > DBG1 - 00:24:26.357769106 [Run-as worker]: run_as worker<br>
> exiting<br>
> > (ret =<br>
> > > 0) (in run_as_create_worker_no_lock() at runas.c:1526)<br>
> > ><br>
> > ><br>
> > ><br>
> > > _______________________________________________<br>
> > > lttng-dev mailing list<br>
> > > <a href="mailto:lttng-dev@lists.lttng.org" target="_blank">lttng-dev@lists.lttng.org</a><br>
> <mailto:<a href="mailto:lttng-dev@lists.lttng.org" target="_blank">lttng-dev@lists.lttng.org</a>> <mailto:<a href="mailto:lttng-dev@lists.lttng.org" target="_blank">lttng-dev@lists.lttng.org</a><br>
> <mailto:<a href="mailto:lttng-dev@lists.lttng.org" target="_blank">lttng-dev@lists.lttng.org</a>>><br>
> > > <a href="https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev" rel="noreferrer" target="_blank">https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev</a><br>
> <<a href="https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev" rel="noreferrer" target="_blank">https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev</a>><br>
> > <<a href="https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev" rel="noreferrer" target="_blank">https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev</a><br>
> <<a href="https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev" rel="noreferrer" target="_blank">https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev</a>>><br>
> ><br>
> <br>
</blockquote></div></div>
</blockquote></div>