Comparison of OpenJPA with HSQLDB embedded vs ObjectDB embedded

Each of the following tables focuses on a specific database operation, where the last table presents average results comparison.

Speed comparison of JPA database persistence operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	13.3	100	6.9	100	10.1	100
Element Collection Test	8.6	100	5.3	100	7.0	100
Inheritance Test	12.2	100	5.8	100	9.0	100
Indexing Test	16.7	100	9.1	100	12.9	100
Graph (Binary Tree) Test	6.1	88.4	7.3	100	6.7	94.2
Multithreading Test	26.8	100	7.0	100	16.9	100
All Tests	13.9	98.1	6.9	100	10.4	99.0

The results above show that in general ObjectDB embedded is much more efficient than OpenJPA with HSQLDB embedded in persisting JPA entity objects to the database. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (10.4) to the normalized speed of ObjectDB embedded database (99.0) reveals that in these tests, ObjectDB embedded is 9.5 times faster than OpenJPA with HSQLDB embedded.

A huge performance gap has been detected when using JPA element collections with large transaction size. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (5.3) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 18.9 times faster than OpenJPA with HSQLDB embedded.

Speed comparison of JPA database retrieval operations (normalized score, higher is better)

Retrieval Size =>	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	21.8	100	30.1	100	25.9	100
Element Collection Test	0.0068	100	4.5	100	2.2	100
Inheritance Test	0.0025	100	2.0	100	0.98	100
Indexing Test	22.1	100	43.6	100	32.9	100
Graph (Binary Tree) Test	2.1	100	2.1	100	2.1	100
Multithreading Test	20.9	100	23.5	100	22.2	100
All Tests	11.1	100	17.6	100	14.4	100

The results above show that in general ObjectDB embedded is much more efficient than OpenJPA with HSQLDB embedded in retrieving JPA entity objects from the database. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (14.4) to the normalized speed of ObjectDB embedded database (100) reveals that in these tests, ObjectDB embedded is 6.9 times faster than OpenJPA with HSQLDB embedded.

A huge performance gap has been detected when using class inheritance in the object model with small retrieval size. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (0.0025) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 40,000 times faster than OpenJPA with HSQLDB embedded.

Speed comparison of JPA database query operations (normalized score, higher is better)

Retrieval Size =>	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	2.8	100	0.91	100	1.9	100
Element Collection Test	1.4	100	0.95	100	1.2	100
Inheritance Test	2.4	100	1.3	100	1.8	100
Indexing Test	15.4	100	34.3	100	24.9	100
Multithreading Test	1.4	100	0.53	100	0.95	100
All Tests	4.7	100	7.6	100	6.1	100

The results above show that in general ObjectDB embedded is much more efficient than OpenJPA with HSQLDB embedded in executing the tested JPA queries. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (6.1) to the normalized speed of ObjectDB embedded database (100) reveals that in these tests, ObjectDB embedded is 16.4 times faster than OpenJPA with HSQLDB embedded.

A huge performance gap has been detected when using multithreading with large retrieval size. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (0.53) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 189 times faster than OpenJPA with HSQLDB embedded.

Speed comparison of JPA database update operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	12.0	100	5.3	100	8.6	100
Element Collection Test	0.017	100	3.7	100	1.8	100
Inheritance Test	0.0098	100	2.0	100	0.99	100
Indexing Test	9.3	100	5.5	100	7.4	100
Graph (Binary Tree) Test	2.5	100	1.6	100	2.1	100
Multithreading Test	20.0	100	3.7	100	11.8	100
All Tests	7.3	100	3.6	100	5.5	100

The results above show that in general ObjectDB embedded is much more efficient than OpenJPA with HSQLDB embedded in updating JPA entity objects in the database. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (5.5) to the normalized speed of ObjectDB embedded database (100) reveals that in these tests, ObjectDB embedded is 18.2 times faster than OpenJPA with HSQLDB embedded.

A huge performance gap has been detected when using class inheritance in the object model with small transaction size. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (0.0098) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 10,204 times faster than OpenJPA with HSQLDB embedded.

Speed comparison of JPA database removal operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	21.3	100	15.7	100	18.5	100
Element Collection Test	0.011	100	2.9	100	1.5	100
Inheritance Test	0.0070	100	3.5	100	1.8	100
Indexing Test	28.8	100	15.2	100	22.0	100
Graph (Binary Tree) Test	2.9	100	3.6	100	3.2	100
Multithreading Test	26.0	100	19.6	100	22.8	100
All Tests	13.2	100	10.1	100	11.6	100

The results above show that in general ObjectDB embedded is much more efficient than OpenJPA with HSQLDB embedded in deleting JPA entity objects from the database. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (11.6) to the normalized speed of ObjectDB embedded database (100) reveals that in these tests, ObjectDB embedded is 8.6 times faster than OpenJPA with HSQLDB embedded.

A huge performance gap has been detected when using class inheritance in the object model with small transaction size. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (0.0070) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 14,286 times faster than OpenJPA with HSQLDB embedded.

Comparison of database storage efficiency (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	41.4	100	41.4	100	41.4	100
Element Collection Test	46.9	100	46.9	100	46.9	100
Inheritance Test	41.4	100	41.4	100	41.4	100
Indexing Test	48.4	100	49.2	100	48.8	100
Graph (Binary Tree) Test	28.5	100	21.4	100	25.0	100
Multithreading Test	51.9	91.1	10.3	22.0	31.1	56.6
All Tests	43.1	98.5	35.1	87.0	39.1	92.8

The results above show that in general ObjectDB embedded is more efficient than OpenJPA with HSQLDB embedded in using disk space. Comparing the normalized score of OpenJPA with HSQLDB embedded database (39.1) to the normalized score of ObjectDB embedded database (92.8) reveals that in these tests, ObjectDB embedded is 2.4 times more efficient than OpenJPA with HSQLDB embedded.

A large gap has been detected when using graphs of objects with large transaction size. Comparing the normalized score of OpenJPA with HSQLDB embedded database (21.4) to the normalized score of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 4.7 times more efficient than OpenJPA with HSQLDB embedded.

Comparison of JPA/Database speed - the averages (normalized score, higher is better)

Transaction/Retrieval Size	Few Entities		Many Entities		Average Score
	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded	OpenJPA HSQLDB embedded	ObjectDB embedded
Basic Person Test	14.3	100	11.8	100	13.0	100
Element Collection Test	2.0	100	3.5	100	2.7	100
Inheritance Test	2.9	100	2.9	100	2.9	100
Indexing Test	18.5	100	21.6	100	20.0	100
Graph (Binary Tree) Test	3.4	97.1	3.7	100	3.5	98.5
Multithreading Test	19.0	100	10.9	100	14.9	100
All Tests	10.2	99.6	9.2	100	9.7	99.8

The results above show that in general ObjectDB embedded is much more efficient than OpenJPA with HSQLDB embedded in performing JPA database operations. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (9.7) to the normalized speed of ObjectDB embedded database (99.8) reveals that in these tests, ObjectDB embedded is 10.3 times faster than OpenJPA with HSQLDB embedded.

A huge performance gap has been detected when using JPA element collections with small transaction/retrieval size. Comparing the normalized speed of OpenJPA with HSQLDB embedded database (2.0) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 50.0 times faster than OpenJPA with HSQLDB embedded.

JPA Performance Benchmark (JPAB)