Node.js read 3.7GB JSON file

1 points by _xoxa ↗ HN
I'm currently reading/writing a 3.7GB-ish JSON file from disk into NodeJS, I'm using --max-old-space-size to accomodate the larger file and JSONStream and FS streaming to get around Node's Buffer size limit/string size limit. Is there a faster/more efficient way of reading large JSON files? I'm thinking I can optimise the write out by just using a traditional DB for that, but the read in still would be a pain.

0 comments

[ 2.7 ms ] story [ 7.2 ms ] thread

No comments yet.