Strangely Large File Sizes for Small Amounts of Data in Example Sets
monore
New Altair Community Member
I have had several files with file sizes in Store outputs that seem very disproportionate - i.e. 125MB for a 233 row, 29 attribute file. Why is this and how do i fix this?
My only solution so far has been the cumbersome step of writing to an Excel (which has to be done locally). Then separately reading that Excel. For the file mentioned previously this brought the file in question from 125MB to 6.5MB.
Is there something with metadata or attribute types to make a change so drastic? Whats the easier way to get these file sizes under control?
My only solution so far has been the cumbersome step of writing to an Excel (which has to be done locally). Then separately reading that Excel. For the file mentioned previously this brought the file in question from 125MB to 6.5MB.
Is there something with metadata or attribute types to make a change so drastic? Whats the easier way to get these file sizes under control?
0
Answers
-
Hi,
can you try to use a Remove Unused Values operator before Store? This should do it.
Cheers,
Martin0
Altair Employee