Choose benchmark test, operation and batch mode:

When one or more of the All filters is selected - only average normalized results are displayed. Please read Running and Results for more details.

Speed comparison of JPA database removal operations per second (higher is better)

 Derby
embedded		H2
embedded		HSQLDB
embedded		SQLite
embedded		DB4O
embedded		ObjectDB
embedded		Derby
server		H2
server		MySQL
server		PostgreSQL
server		ObjectDB
server
DataNucleus2,35316,3048,484 failed 7724,3221,4201,111 
EclipseLink3,26235,72119,897failed  1,4924,2901,57047.6 
Hibernate2,16011,63015,829702  2,0262,8761,59033.8 
OpenJPA2,3335,3938,352   3842,1391,1861,552 
ObjectDB     291,737    56,318

Performance comparison chart - The Y-Axis represents normalized score in logarithmic scale - higher is better:
JPA performance benchmark comparision Hibernate, EclipseLink, OpenJPA, DataNucleus, ObjectDB

Performance comparison chart - The Y-Axis represents normalized score in linear scale - higher is better:
JPA performance benchmark comparision Hibernate, EclipseLink, OpenJPA, DataNucleus, ObjectDB

Best and Worst JPA/Database Performer in this comparison

The Most Efficient (the Fastest):

1. ObjectDB embedded100
2. ObjectDB server19.3
3. EclipseLink with H2 embedded12.2
4. EclipseLink with HSQLDB embedded6.8
5. DataNucleus with H2 embedded5.6
6. Hibernate with HSQLDB embedded5.4
7. Hibernate with H2 embedded4.0
8. DataNucleus with HSQLDB embedded2.9
9. OpenJPA with HSQLDB embedded2.9
10. OpenJPA with H2 embedded1.8
11. DataNucleus with H2 server1.5
12. EclipseLink with H2 server1.5
13. EclipseLink with Derby embedded1.1
14. Hibernate with H2 server0.99
15. DataNucleus with Derby embedded0.81
16. OpenJPA with Derby embedded0.80
17. Hibernate with Derby embedded0.74

The Least Efficient (the Slowest):

18. OpenJPA with H2 server0.73
19. Hibernate with Derby server0.69
20. Hibernate with MySQL server0.55
21. EclipseLink with MySQL server0.54
22. OpenJPA with PostgreSQL server0.53
23. EclipseLink with Derby server0.51
24. DataNucleus with MySQL server0.49
25. OpenJPA with MySQL server0.41
26. DataNucleus with PostgreSQL server0.38
27. DataNucleus with Derby server0.26
28. Hibernate with SQLite embedded0.24
29. OpenJPA with Derby server0.13
30. EclipseLink with PostgreSQL server0.016
31. Hibernate with PostgreSQL server0.012
32. DataNucleus with DB4O embedded0.0000
33. EclipseLink with SQLite embedded0.0000

Problems (Exceptions) in these tests

  • EclipseLink with SQLite embedded
    Local Exception Stack: 
Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.1.1.v20100817-r8050): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: java.sql.SQLException: no such function: MOD
Error Code: 0
Call: SELECT ID, CHANGECOUNT, CHILD2_ID, CHILD1_ID FROM NODE WHERE ((MOD(ID, ?) = ?) AND (ID >= ?))
	bind => [100, 1, 0]
Query: ReadAllQuery(referenceClass=Node sql="SELECT ID, CHANGECOUNT, CHILD2_ID, CHILD1_ID FROM NODE WHERE ((MOD(ID, ?) = ?) AND (ID >= ?))")
	at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:333)
	at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:683)
	at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.executeCall(DatabaseAccessor.java:526)
	at org.eclipse.persistence.sessions.server.ServerSession.executeCall(ServerSession.java:529)
	at org.eclipse.persistence.internal.sessions.IsolatedClientSession.executeCall(IsolatedClientSession.java:133)
	at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:206)
	at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:192)
	at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeSelectCall(DatasourceCallQueryMechanism.java:263)
	at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.selectAllRows(DatasourceCallQueryMechanism.java:644)
	at org.eclipse.persistence.internal.queries.ExpressionQueryMechanism.selectAllRowsFromTable(ExpressionQueryMechanism.java:2537)
	at org.eclipse.persistence.internal.queries.ExpressionQueryMechanism.selectAllRows(ExpressionQueryMechanism.java:2496)
	at org.eclipse.persistence.queries.ReadAllQuery.executeObjectLevelReadQuery(ReadAllQuery.java:407)
	at org.eclipse.persistence.queries.ObjectLevelReadQuery.executeDatabaseQuery(ObjectLevelReadQuery.java:1074)
	at org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java:736)
	at org.eclipse.persistence.queries.ObjectLevelReadQuery.execute(ObjectLevelReadQuery.java:1034)
	at org.eclipse.persistence.queries.ReadAllQuery.execute(ReadAllQuery.java:380)
	at org.eclipse.persistence.queries.ObjectLevelReadQuery.executeInUnitOfWork(ObjectLevelReadQuery.java:1112)
	at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecuteQuery(UnitOfWorkImpl.java:2909)
	at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1291)
	at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1273)
	at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1247)
	at org.eclipse.persistence.internal.jpa.EJBQueryImpl.executeReadQuery(EJBQueryImpl.java:479)
	at org.eclipse.persistence.internal.jpa.EJBQueryImpl.getResultList(EJBQueryImpl.java:714)
	at org.jpab.node.NodeTest.retireveEntities(NodeTest.java:130)
	at org.jpab.Test.doAction(Test.java:251)
	at org.jpab.Runner$RemoveAction.run0(Runner.java:587)
	at org.jpab.Runner$TestAction.run(Runner.java:517)
	at java.lang.Thread.run(Thread.java:662)
Caused by: java.sql.SQLException: no such function: MOD
	at org.sqlite.DB.throwex(DB.java:288)
	at org.sqlite.NestedDB.prepare(NestedDB.java:115)
	at org.sqlite.DB.prepare(DB.java:114)
	at org.sqlite.PrepStmt.(PrepStmt.java:37)
	at org.sqlite.Conn.prepareStatement(Conn.java:224)
	at org.sqlite.Conn.prepareStatement(Conn.java:217)
	at org.sqlite.Conn.prepareStatement(Conn.java:206)
	at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1401)
	at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1350)
	at org.eclipse.persistence.internal.databaseaccess.DatabaseCall.prepareStatement(DatabaseCall.java:652)
	at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:576)
	... 26 more
  • DataNucleus with DB4O embedded
    javax.persistence.PersistenceException: Object "org.jpab.node.Node@538eb7b8" being inserted has id "130003" yet an object with this id already exists in the datastore!
	at org.datanucleus.api.jpa.NucleusJPAHelper.getJPAExceptionForNucleusException(NucleusJPAHelper.java:302)
	at org.datanucleus.api.jpa.JPAEntityTransaction.commit(JPAEntityTransaction.java:122)
	at org.jpab.Test.persist(Test.java:217)
	at org.jpab.Test.persist(Test.java:200)
	at org.jpab.Runner$PersistAction.run0(Runner.java:538)
	at org.jpab.Runner$TestAction.run(Runner.java:517)
	at java.lang.Thread.run(Thread.java:662)
Caused by: org.datanucleus.exceptions.NucleusUserException: Object "org.jpab.node.Node@538eb7b8" being inserted has id "130003" yet an object with this id already exists in the datastore!
	at org.datanucleus.store.db4o.DB4OPersistenceHandler.insertObject(DB4OPersistenceHandler.java:140)
	at org.datanucleus.state.JDOStateManager.internalMakePersistent(JDOStateManager.java:2371)
	at org.datanucleus.state.JDOStateManager.flush(JDOStateManager.java:3803)
	at org.datanucleus.ObjectManagerImpl.flushInternalWithOrdering(ObjectManagerImpl.java:3854)
	at org.datanucleus.ObjectManagerImpl.flushInternal(ObjectManagerImpl.java:3755)
	at org.datanucleus.ObjectManagerImpl.flush(ObjectManagerImpl.java:3701)
	at org.datanucleus.ObjectManagerImpl.preCommit(ObjectManagerImpl.java:4084)
	at org.datanucleus.ObjectManagerImpl$2.transactionPreCommit(ObjectManagerImpl.java:398)
	at org.datanucleus.TransactionImpl.internalPreCommit(TransactionImpl.java:370)
	at org.datanucleus.TransactionImpl.commit(TransactionImpl.java:259)
	at org.datanucleus.api.jpa.JPAEntityTransaction.commit(JPAEntityTransaction.java:103)
	... 5 more