Repository navigation
Is it possible to stream data through the json parser without storing everything in memory? #347
Description
Is it possible to stream data through the json parser without storing everything in memory?
Lets say I have a json file that is 10 GB, is it possible to stream that through the parser without storing it in memory?
Something like:
file stream >> json deserialze >> data stream
and the reverse:
data stream >> json serialize >> json string stream
Is that possible with this library?
Activity
nlohmann commentedon Oct 31, 2016
What exactly would the library do in this setting?
nlohmann commentedon Nov 2, 2016
You may want to have a look at the parser callback mechanism of the library:
It may not be 100% what you need, but maybe you can express your usecase in terms of such a callback function.
nlohmann commentedon Nov 11, 2016
@anden259 Can I close this ticket?
anden259 commentedon Nov 14, 2016
@nlohmann I had a look through the docs, examples and source code. The current library does not support what I need, so I decided to write my own. It'll get published once it's more complete than it is at the moment. Thank you for your help. Feel free to close the ticket.