JSON benchmarks

[pyscripter 749]

hydrobyte/TestJSON: A simple project to test JSON libraries with Delphi and C++Builder. presents JSON library benchmarks comparing a large number of alternatives.

 

One thing that strikes me, is that the System.JSON rtl library is doing relatively well compared to the competition, both in terms of performance and in terms of JSON validation.   With the exception of Find, is very competitive in all other areas.

 

I have seen many claims that System.JSON is very slow and that the xyz library is so many times faster.   Do these benchmarks suck (like most benchmarks)?   Or is it the case that System.JSON is not that bad?  What is your experience?

[Tommi Prami 146]

13 hours ago, pyscripter said:

hydrobyte/TestJSON: A simple project to test JSON libraries with Delphi and C++Builder. presents JSON library benchmarks comparing a large number of alternatives.

Way cool! 

Is there test/comparison is Objects and/or Record serialization supported and speed etc?? Did not check code, because bit busy...

I've used Grijjy in one of my hobby projects for serializing objects and/or records. Can't remember which they all are, poossibly both)

Edited 7 hours ago by Tommi Prami

[pyscripter 749]

1 hour ago, Tommi Prami said:

Is there test/comparison is Objects and/or Record serialization supported and speed etc??

No. Most of the alternatives do not support serialization.  Grizzy and Superobject do.   Delphi offers a couple of ways.   But serialization is not  necessarily dependent on JSON parsing.   For example NEON is using System.JSON.   

Edited 6 hours ago by pyscripter

[Stefan Glienke 2134]

The tests ignore some subtle differences in the implementations. While some implementations ensure that you don't create multiple pairs with the same name the System.JSON AddPair method simply ignores that.

 

You can test that by adding a fLib.Add(SKey, SVal); after the loop in TTestSpeedRun.DoSubTestGen - some libraries will report 50000 items, while some report 50001 - System.JSON for example.

The fact that JDO uses a linear search here is a bit disappointing and the reason it completely falls off the cliff on the generate test.

[Vincent Gsell 14]

16 hours ago, pyscripter said:

I have seen many claims that System.JSON is very slow and that the xyz library is so many times faster.   Do these benchmarks suck (like most benchmarks)?   Or is it the case that System.JSON is not that bad?  What is your experience?

Hi, 

For me, certains of the fastest JSON  libraries that I practiced is just not present (among others, Mormot, pasjson, etc.).
 

41 minutes ago, Stefan Glienke said:

The tests ignore some subtle differences in the implementations. While some implementations ensure that you don't create multiple pairs with the same name the System.JSON AddPair method simply ignores that.

Indeed ! And validation test could be usefull in this kind of bench ! 

 

It is astonishing that many libs does not pass certain basic "proper Json format" validation ! 

• An empty object can be represented by {}
• Arrays are encapsulated within opening and closing square brackets
• An empty array can be represented by []
• Each member should have a unique key within an object structure

[Der schöne Günther 336]

As far as I know, nowhere does it specify that keys must be unique.

[Stefan Glienke 2134]

5 minutes ago, Der schöne Günther said:

As far as I know, nowhere does it specify that keys must be unique.

No, but according to RFC 8259, they *should* be unique.

 

I just pointed out that by supporting that feature, there needs to be done more than simply adding pairs without any lookup.

In fact, it looks like some implementations don't even allow adding duplicate names.

Edited 4 hours ago by Stefan Glienke

[Lars Fosdal 1851]

IMO, if you need multiple values for a field, you should use a list element.

Duplicate key/value pairs in JSON just doesn't make sense.
https://JsonLint.com does not like them either.