[lttng-dev] Allocation failures with babeltrace and TraceCompass - corrupt trace?

[Thomas McGuire]

Hi,

I have a recurring problem of tools like babeltrace and TraceCompass
exiting because of an allocation failure.

For example running babeltrace on a captured trace leads to babeltrace
processing some events, and then exiting with:
  GLib-ERROR **: gmem.c:168: failed to allocate 17179869184 bytes

This sounds like a corrupted trace file to me. Or maybe a version or
format mismatch?

In case it helps, babeltrace's backtrace at that point is attached to
the mail.

I'm using lttng-relayd 2.9.4 on the host, and lttng 2.9.4 on an i.MX25
device. Babeltrace is at version 1.5.1.
The same problem can be seen when not using lttng-relayd.

I've also seen other problems like "[error] Event id 3336003216 is
outside range."

lttng-sessiond shows no warnings or errors during recording, and neither
does lttng start or stop - not even lost events.

Any idea how the trace file got corrupted and how I can record traces
without corruption in the future?

Thanks,
Thomas
-- 
Thomas McGuire | thomas.mcguire at kdab.com | Senior Software Engineer
KDAB (Deutschland) GmbH&Co KG, a KDAB Group company
Tel: +49-30-521325470
KDAB - The Qt Experts
-------------- next part --------------
Program received signal SIGTRAP, Trace/breakpoint trap.
g_logv (log_domain=0x7ffff68daa0e "GLib", log_level=G_LOG_LEVEL_ERROR, format=<optimized out>, args=args at entry=0x7fffffffd028) at gmessages.c:1046
Missing separate debuginfos, use: zypper install libgmodule-2_0-0-debuginfo-2.44.1-2.3.x86_64 libpopt0-debuginfo-1.16-28.4.x86_64
(gdb) bt
#0  g_logv (log_domain=0x7ffff68daa0e "GLib", log_level=G_LOG_LEVEL_ERROR, format=<optimized out>, args=args at entry=0x7fffffffd028) at gmessages.c:1046
#1  0x00007ffff689cbf2 in g_log (log_domain=log_domain at entry=0x7ffff68daa0e "GLib", log_level=log_level at entry=G_LOG_LEVEL_ERROR, format=format at entry=0x7ffff68e3f30 "%s: failed to allocate %lu bytes") at gmessages.c:1079
#2  0x00007ffff689b57c in g_realloc (mem=<optimized out>, n_bytes=17179869184) at gmem.c:167
#3  0x00007ffff686a68a in g_ptr_array_maybe_expand (array=array at entry=0x60db60, len=<optimized out>) at garray.c:1118
#4  0x00007ffff686b5fc in g_ptr_array_set_size (array=0x60db60, length=length at entry=1685091444) at garray.c:1146
#5  0x00007ffff7bd6060 in bt_sequence_rw (pos=0x625780, definition=0x62b1a0) at /home/thomas/src/babeltrace-1.5.1/types/sequence.c:62
#6  0x00007ffff7bd669e in generic_rw (definition=<optimized out>, pos=0x625780) at /home/thomas/src/babeltrace-1.5.1/include/babeltrace/types.h:133
#7  bt_struct_rw (ppos=0x625780, definition=0x62ae10) at /home/thomas/src/babeltrace-1.5.1/types/struct.c:56
#8  0x00007ffff798ed8e in generic_rw (definition=<optimized out>, pos=0x625780) at /home/thomas/src/babeltrace-1.5.1/include/babeltrace/types.h:133
#9  ctf_read_event (ppos=0x625780, stream=<optimized out>) at /home/thomas/src/babeltrace-1.5.1/formats/ctf/ctf.c:585
#10 0x00007ffff7bd2844 in stream_read_event (sin=sin at entry=0x6246c0) at /home/thomas/src/babeltrace-1.5.1/lib/iterator.c:66
#11 0x00007ffff7bd374f in bt_iter_next (iter=0x60cb50) at /home/thomas/src/babeltrace-1.5.1/lib/iterator.c:832
#12 0x0000000000402e42 in convert_trace (ctx=0x60b9f0, td_write=0x8b8ac8) at /home/thomas/src/babeltrace-1.5.1/converter/babeltrace.c:691
#13 main (argc=<optimized out>, argv=<optimized out>) at /home/thomas/src/babeltrace-1.5.1/converter/babeltrace.c:823
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4000 bytes
Desc: S/MIME Cryptographic Signature
URL: <https://lists.lttng.org/pipermail/lttng-dev/attachments/20170614/4c1e4521/attachment.bin>