Comparison of DataNucleus with SQLite embedded vs ObjectDB server

Each of the following tables focuses on a specific database operation, where the last table presents average results comparison.

Speed comparison of JPA database persistence operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server
Basic Person Test		51.3		92.9		72.1
Element Collection Test		85.7		67.3		76.5
Inheritance Test		40.2		97.6		68.9
Indexing Test		56.6		95.2		75.9
Graph (Binary Tree) Test		85.0		79.0		82.0
Multithreading Test		100		0.0000		50.0
All Tests		69.8		72.0		70.9

Speed comparison of JPA database retrieval operations (normalized score, higher is better)

Retrieval Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server
Basic Person Test	0.43	8.8		33.0	0.43	20.9
Element Collection Test		11.1		34.7		22.9
Inheritance Test		12.7		41.9		27.3
Indexing Test		4.4		37.2		20.8
Graph (Binary Tree) Test		8.7		15.3		12.0
Multithreading Test		12.0		22.8		17.4
All Tests	0.43	9.6		30.8	0.43	20.2

The results above show that in general ObjectDB server is much more efficient than DataNucleus with SQLite embedded in retrieving JPA entity objects from the database. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.43) to the normalized speed of ObjectDB database server (20.2) reveals that in these tests, ObjectDB server is 47.0 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small retrieval size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.43) to the normalized speed of ObjectDB database server (8.8) reveals that in that case, ObjectDB server is 20.5 times faster than DataNucleus with SQLite embedded.

Speed comparison of JPA database query operations (normalized score, higher is better)

Retrieval Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server
Basic Person Test	failed	2.3		19.7	failed	11.0
Element Collection Test		4.8		19.3		12.0
Inheritance Test		4.0		25.0		14.5
Indexing Test		5.1		14.0		9.5
Multithreading Test		11.8		22.9		17.3
All Tests	failed	5.6		20.2	failed	12.9

DataNucleus with SQLite embedded has failed in 1 tests (see exceptions).

Speed comparison of JPA database update operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server
Basic Person Test	0.025	9.5		30.4	0.025	20.0
Element Collection Test		24.7		37.8		31.3
Inheritance Test		13.6		39.7		26.6
Indexing Test		37.2		34.6		35.9
Graph (Binary Tree) Test		20.9		11.6		16.2
Multithreading Test		24.5		53.1		38.8
All Tests	0.025	21.7		34.5	0.025	28.1

The results above show that in general ObjectDB server is much more efficient than DataNucleus with SQLite embedded in updating JPA entity objects in the database. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.025) to the normalized speed of ObjectDB database server (28.1) reveals that in these tests, ObjectDB server is 1,124 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.025) to the normalized speed of ObjectDB database server (9.5) reveals that in that case, ObjectDB server is 380 times faster than DataNucleus with SQLite embedded.

Speed comparison of JPA database removal operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server
Basic Person Test	0.17	42.3		100	0.17	71.1
Element Collection Test		73.3		49.2		61.3
Inheritance Test		61.5		100		80.8
Indexing Test		51.7		77.3		64.5
Graph (Binary Tree) Test		100		77.3		88.6
Multithreading Test		39.1		0.0000		19.6
All Tests	0.17	61.3		67.3	0.17	64.3

The results above show that in general ObjectDB server is much more efficient than DataNucleus with SQLite embedded in deleting JPA entity objects from the database. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.17) to the normalized speed of ObjectDB database server (64.3) reveals that in these tests, ObjectDB server is 378 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.17) to the normalized speed of ObjectDB database server (42.3) reveals that in that case, ObjectDB server is 249 times faster than DataNucleus with SQLite embedded.

Comparison of JPA/Database speed - the averages (normalized score, higher is better)

Transaction/Retrieval Size	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server	DataNucleus SQLite embedded	ObjectDB server
Basic Person Test	0.21	22.8		55.2	0.21	39.0
Element Collection Test		39.9		41.7		40.8
Inheritance Test		26.4		60.8		43.6
Indexing Test		31.0		51.7		41.3
Graph (Binary Tree) Test		53.6		45.8		49.7
Multithreading Test		37.5		19.8		28.6
All Tests	0.21	34.6		45.8	0.21	40.2

The results above show that in general ObjectDB server is much more efficient than DataNucleus with SQLite embedded in performing JPA database operations. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.21) to the normalized speed of ObjectDB database server (40.2) reveals that in these tests, ObjectDB server is 191 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction/retrieval size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.21) to the normalized speed of ObjectDB database server (22.8) reveals that in that case, ObjectDB server is 109 times faster than DataNucleus with SQLite embedded.

JPA Performance Benchmark (JPAB)