[lttng-dev] Processing large trace files

[Shehab Elsayed]

Hello All,

I was wondering if anyone had any suggestions on how to speedup trace
processing. Right now I am using babeltrace in python to read the traces
and process them. Some of the traces I am dealing with reach up to 10GB.

I read the trace, extract the info I need and write them to a csv gzipped
file (all in python). I fill up a list first with all extracted info for
each tracked event and then write once after the script has gone through
all events in the trace.

Thanks,
Shehab
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.lttng.org/pipermail/lttng-dev/attachments/20180709/f034f463/attachment.html>