Compare with

Comparison of EclipseLink with HSQLDB embedded vs EclipseLink with SQLite embedded

Each of the following tables focuses on a specific database operation, where the last table presents average results comparison.

Speed comparison of JPA database persistence operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test27.10.07417.20.9022.20.49
Element Collection Test17.20.0618.20.6512.70.36
Inheritance Test26.70.08311.90.8219.30.45
Indexing Test30.60.1118.61.624.60.87
Graph (Binary Tree) Test20.00.2415.90.9118.00.57
Multithreading Test32.50.1011.42.122.01.1
All Tests25.70.1113.91.219.80.64

The results above show that in general EclipseLink with HSQLDB embedded is much more efficient than EclipseLink with SQLite embedded in persisting JPA entity objects to the database. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.64) to the normalized speed of EclipseLink with HSQLDB embedded database (19.8) reveals that in these tests, EclipseLink with HSQLDB embedded is 30.9 times faster than EclipseLink with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction size. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.074) to the normalized speed of EclipseLink with HSQLDB embedded database (27.1) reveals that in that case, EclipseLink with HSQLDB embedded is 366 times faster than EclipseLink with SQLite embedded.

Speed comparison of JPA database retrieval operations (normalized score, higher is better)

Retrieval Size =>Few EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test24.4failed36.0failed30.2failed
Element Collection Test14.90.000719.1failed17.00.0007
Inheritance Test22.8failed40.0failed31.4failed
Indexing Test20.7failed38.7failed29.7failed
Graph (Binary Tree) Test8.7failed14.2failed11.4failed
Multithreading Test24.2failed28.0failed26.1failed
All Tests19.30.000729.3failed24.30.0007

EclipseLink with SQLite embedded has failed in 11 tests (see exceptions).

Speed comparison of JPA database query operations (normalized score, higher is better)

Retrieval Size =>Few EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test2.91.20.88failed1.91.2
Element Collection Test3.20.291.4failed2.30.29
Inheritance Test2.60.691.1failed1.90.69
Indexing Test21.50.000833.3failed27.40.0008
Multithreading Test1.1failed0.52failed0.82failed
All Tests6.30.557.4failed6.90.55

EclipseLink with SQLite embedded has failed in 6 tests (see exceptions).

Speed comparison of JPA database update operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test17.9failed7.0failed12.5failed
Element Collection Test14.60.00168.3failed11.40.0016
Inheritance Test16.2failed9.7failed13.0failed
Indexing Test12.0failed6.8failed9.4failed
Graph (Binary Tree) Test4.7failed3.4failed4.0failed
Multithreading Test24.4failed4.4failed14.4failed
All Tests15.00.00166.6failed10.80.0016

EclipseLink with SQLite embedded has failed in 11 tests (see exceptions).

Speed comparison of JPA database removal operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test32.3failed20.3failed26.3failed
Element Collection Test14.30.00066.0failed10.20.0006
Inheritance Test29.2failed23.9failed26.6failed
Indexing Test55.3failed27.1failed41.2failed
Graph (Binary Tree) Test6.8failed14.1failed10.4failed
Multithreading Test52.9failed28.4failed40.6failed
All Tests31.80.000620.0failed25.90.0006

EclipseLink with SQLite embedded has failed in 11 tests (see exceptions).

Comparison of database storage efficiency (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test41.479.441.479.441.479.4
Element Collection Test46.974.546.974.546.974.5
Inheritance Test41.475.041.475.041.475.0
Indexing Test48.492.949.294.548.893.7
Graph (Binary Tree) Test28.560.621.448.425.054.5
Multithreading Test51.910010.310031.1100
All Tests43.180.435.178.639.179.5

The results above show that in general EclipseLink with SQLite embedded is more efficient than EclipseLink with HSQLDB embedded in using disk space. Comparing the normalized score of EclipseLink with HSQLDB embedded database (39.1) to the normalized score of EclipseLink with SQLite embedded database (79.5) reveals that in these tests, EclipseLink with SQLite embedded is 2.0 times more efficient than EclipseLink with HSQLDB embedded.

A large gap has been detected when using multithreading with large transaction size. Comparing the normalized score of EclipseLink with HSQLDB embedded database (10.3) to the normalized score of EclipseLink with SQLite embedded database (100) reveals that in that case, EclipseLink with SQLite embedded is 9.7 times more efficient than EclipseLink with HSQLDB embedded.

Comparison of JPA/Database speed - the averages (normalized score, higher is better)

Transaction/Retrieval SizeFew EntitiesMany EntitiesAverage Score
 EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
EclipseLink
HSQLDB embedded
EclipseLink
SQLite embedded
Basic Person Test20.90.6616.30.9018.60.74
Element Collection Test12.80.0708.60.6510.70.17
Inheritance Test19.50.3817.30.8218.40.53
Indexing Test28.00.05824.91.626.50.58
Graph (Binary Tree) Test10.00.2411.90.9111.00.57
Multithreading Test27.00.1014.62.120.81.1
All Tests20.10.2215.71.217.90.52

The results above show that in general EclipseLink with HSQLDB embedded is much more efficient than EclipseLink with SQLite embedded in performing JPA database operations. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.52) to the normalized speed of EclipseLink with HSQLDB embedded database (17.9) reveals that in these tests, EclipseLink with HSQLDB embedded is 34.4 times faster than EclipseLink with SQLite embedded.

A huge performance gap has been detected when using database indexes with small transaction/retrieval size. Comparing the normalized speed of EclipseLink with SQLite embedded database (0.058) to the normalized speed of EclipseLink with HSQLDB embedded database (28.0) reveals that in that case, EclipseLink with HSQLDB embedded is 483 times faster than EclipseLink with SQLite embedded.

Other Head to Head DBMS/JPA Comparisons