🚀 Motivation and context
We have saved multiple json tracing files, in total 200 GB. After putting these files into theanalyzer =TraceAnalysis(trace_files=, it takes memories up to 950GB according to htop.
Description
It would be really great if we can improve the efficiency of the tracing file loading.
Alternatives
We have to use a machine with huge RAM available.
Additional context
No response
🚀 Motivation and context
We have saved multiple json tracing files, in total 200 GB. After putting these files into the
analyzer =TraceAnalysis(trace_files=, it takes memories up to 950GB according tohtop.Description
It would be really great if we can improve the efficiency of the tracing file loading.
Alternatives
We have to use a machine with huge RAM available.
Additional context
No response