[lttng-dev] Unable to import big LTTng traces

[Alexandre Montplaisir]

On 12-12-12 12:59 AM, Radhika Chowdary wrote:
> Hi
>
> I am using linuxtools plugins for importing LTTng traces. I have a trace
> folder of size 400MB and when I try to import it in the Traces folder it
> takes for ever to import it. At the bottom left corner I see Indexing...
> Events view gets populated soon but not others.

Hi,

It is expected that the indexing phase takes a while for very large
trace. It could probably be optimized a bit too, since we haven't spent
much time on performance improvements. Good news is that once indexed,
it will be faster to reopen the same trace later on.

We have not yet implemented a percentage progression monitor for the
indexing job. This is not trivial since it has to be implemented
differently depending on the trace type, but would definitely be nice to
have.

If you use the latest master branch, the timestamps for the start and
end of the histogram are now correctly formatted, so it is possible to
know roughly where the indexing is at, provided you know the end time of
your trace. I'd suggest trying that out to make sure it's not stopping
at some point, which would be a bug.

> Is there a limit on the size of traces that it can import?

There is no theoretical limit on the trace size that can be imported. It
is capped only by your patience ;)  and the amount of available disk
space, since the index files can be quite big too.


Cheers,
Alex