Compare with

Comparison of DataNucleus with HSQLDB embedded vs EclipseLink with SQLite embedded

Each of the following tables focuses on a specific database operation, where the last table presents average results comparison.

Speed comparison of JPA database persistence operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test14.20.0744.80.909.50.49
Element Collection Test6.60.0612.10.654.30.36
Inheritance Test13.60.0834.60.829.10.45
Indexing Test24.60.1111.11.617.80.87
Graph (Binary Tree) Test6.80.244.50.915.70.57
Multithreading Test38.50.108.52.123.51.1
All Tests17.40.115.91.211.70.64

The results above show that in general DataNucleus with HSQLDB embedded is much more efficient than EclipseLink with SQLite embedded in persisting JPA entity objects to the database. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.64) to the normalized speed of DataNucleus with HSQLDB embedded database (11.7) reveals that in these tests, DataNucleus with HSQLDB embedded is 18.3 times faster than EclipseLink with SQLite embedded.

A huge performance gap has been detected when using multithreading with small transaction size. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.10) to the normalized speed of DataNucleus with HSQLDB embedded database (38.5) reveals that in that case, DataNucleus with HSQLDB embedded is 385 times faster than EclipseLink with SQLite embedded.

Speed comparison of JPA database retrieval operations (normalized score, higher is better)

Retrieval Size =>Few EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test6.6failed10.2failed8.4failed
Element Collection Test3.60.00078.1failed5.80.0007
Inheritance Test5.7failed8.8failed7.2failed
Indexing Test5.1failed9.5failed7.3failed
Graph (Binary Tree) Test7.2failed9.3failed8.3failed
Multithreading Test8.1failed9.5failed8.8failed
All Tests6.00.00079.2failed7.60.0007

EclipseLink with SQLite embedded has failed in 11 tests (see exceptions).

Speed comparison of JPA database query operations (normalized score, higher is better)

Retrieval Size =>Few EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test1.41.20.48failed0.951.2
Element Collection Test1.30.290.67failed1.00.29
Inheritance Test1.60.690.61failed1.10.69
Indexing Test0.00160.00080.63failed0.320.0008
Multithreading Test0.40failedfailedfailed0.40failed
All Tests0.960.550.60failed0.800.55

DataNucleus with HSQLDB embedded has failed in 1 tests (see exceptions). EclipseLink with SQLite embedded has failed in 6 tests (see exceptions).

Speed comparison of JPA database update operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test11.5failed2.7failed7.1failed
Element Collection Test6.90.00162.7failed4.80.0016
Inheritance Test10.3failed3.6failed6.9failed
Indexing Test11.4failed4.4failed7.9failed
Graph (Binary Tree) Test3.5failed1.5failed2.5failed
Multithreading Testfailedfailedfailedfailedfailedfailed
All Tests8.70.00163.0failed5.80.0016

DataNucleus with HSQLDB embedded has failed in 2 tests (see exceptions). EclipseLink with SQLite embedded has failed in 11 tests (see exceptions).

Speed comparison of JPA database removal operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test4.2failed1.3failed2.8failed
Element Collection Test4.90.00061.6failed3.20.0006
Inheritance Test4.0failed1.3failed2.7failed
Indexing Test7.5failed1.9failed4.7failed
Graph (Binary Tree) Test2.9failed2.0failed2.5failed
Multithreading Test40.1failed13.7failed26.9failed
All Tests10.60.00063.7failed7.10.0006

EclipseLink with SQLite embedded has failed in 11 tests (see exceptions).

Comparison of database storage efficiency (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test41.479.441.479.441.479.4
Element Collection Test23.474.523.474.523.474.5
Inheritance Test41.475.041.475.041.475.0
Indexing Test48.492.949.294.548.893.7
Graph (Binary Tree) Test12.560.69.448.410.954.5
Multithreading Test51.910010.310031.1100
All Tests36.580.429.278.632.979.5

The results above show that in general EclipseLink with SQLite embedded is more efficient than DataNucleus with HSQLDB embedded in using disk space. Comparing the normalized score of DataNucleus with HSQLDB embedded database (32.9) to the normalized score of EclipseLink with SQLite embedded database (79.5) reveals that in these tests, EclipseLink with SQLite embedded is 2.4 times more efficient than DataNucleus with HSQLDB embedded.

A large gap has been detected when using multithreading with large transaction size. Comparing the normalized score of DataNucleus with HSQLDB embedded database (10.3) to the normalized score of EclipseLink with SQLite embedded database (100) reveals that in that case, EclipseLink with SQLite embedded is 9.7 times more efficient than DataNucleus with HSQLDB embedded.

Comparison of JPA/Database speed - the averages (normalized score, higher is better)

Transaction/Retrieval SizeFew EntitiesMany EntitiesAverage Score
 DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
DataNucleus
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test7.60.663.90.905.70.74
Element Collection Test4.70.0703.00.653.80.17
Inheritance Test7.10.383.80.825.40.53
Indexing Test9.70.0585.51.67.60.58
Graph (Binary Tree) Test5.10.244.30.914.70.57
Multithreading Test21.80.1010.62.117.01.1
All Tests9.00.224.81.27.00.52

The results above show that in general DataNucleus with HSQLDB embedded is much more efficient than EclipseLink with SQLite embedded in performing JPA database operations. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.52) to the normalized speed of DataNucleus with HSQLDB embedded database (7.0) reveals that in these tests, DataNucleus with HSQLDB embedded is 13.5 times faster than EclipseLink with SQLite embedded.

A huge performance gap has been detected when using multithreading with small transaction/retrieval size. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.10) to the normalized speed of DataNucleus with HSQLDB embedded database (21.8) reveals that in that case, DataNucleus with HSQLDB embedded is 218 times faster than EclipseLink with SQLite embedded.

Other Head to Head DBMS/JPA Comparisons