Handling Large JSON Responses Efficiently in Delphi

[nolanmaris 0]

Hello

 

When working with REST APIs in Delphi; I often encounter large JSON responses that can slow down processing & even cause memory issues. Parsing such responses using TJSONObject or TJSONParser sometimes results in performance bottlenecks, especially when handling deeply nested structures or high-volume data from services like Amazon or Google APIs.😇

 

I’m looking for the best way to handle these large JSON responses efficiently. Would streaming the JSON instead of loading it all at once be a better approach? Are there lightweight libraries or techniques that help optimize performance while keeping memory usage low?  🤔Additionally, how can I extract only the needed data from a large JSON response without parsing the entire object?🤔

If anyone has experience dealing with similar issues, I’d love to hear about recommended practices.

 

 

 

Thank you !!🙂

[Die Holländer 90]

Some databases support JSON tables where you can insert JSON strings and query them with normal SQL and is VERY fast.

Google for example "MSSQL database JSON"

 

>>Additionally, how can I extract only the needed data from a large JSON response without parsing the entire object?

You can exactly do this with the database, because you have to create a kind of mapping to use the SQL and you can map only the fields that you need..

Edited February 25 by Die Holländer

[Zoran Bonuš 15]

In such situations I use JSONReader instead:

https://docwiki.embarcadero.com/CodeExamples/Sydney/en/RTL.JSONReader

It's less convenient, but much more efficient when "sequential" processing of the json is possible.

[Der schöne Günther 336]

Not a Delphi library, just a technical article, but still an interesting read, if you have some time:

 

Fast columnar JSON decoding with arrow-rs | Arroyo