Dear all,
Due to memory limitations, often I have to partition large data files using something like
FieldConvert --part-only=100 config.xml fields/field_1.chk
, and postprocess them piece by piece:
FieldConvert -v -m meanstats config_xml/P000000"$p".xml fields/field_1.chk meanFields/meanField_1_p"$p".fld
In the case of meanmode module for example, the output is a collection of many small files associated with partitions, which can be analyzed piece by piece. I was wondering if there is a way to merge the outputs back into one piece again like
one piece fld file.
Any feedback is appreciated.