i need help/tips
i have a huge amount of json data that needs to be merged, sorted and filtered. right now, they're separated into different folders. almost 2GB of json files.
what i'm doing right now is:
- reading all files inside each folders
- appending JSON parsed data to an
Array variableinside my script. - sorting the
Array variable - filtering.
- save it to one file
i'm rethinking that instead of appending parsed data to a variable, maybe i should store it inside a file ?.. what do you guys think ?
By the way, i'm experiencing a Javascript Heap out of memory
via Hitori
No comments:
Post a Comment