When one or more of the All filters is selected - only average normalized results are displayed. Please read Running and Results for more details.
Speed comparison of JPA database removal operations per second (higher is better)
| Derby embedded | H2 embedded | HSQLDB embedded | SQLite embedded | DB4O embedded | ObjectDB embedded | Derby server | H2 server | MySQL server | PostgreSQL server | ObjectDB server | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| DataNucleus | 2,666 | 2,667 | 2,667 | 2,708 | 567 | 1,161 | 677 | 660 | |||
| EclipseLink | 2,333 | 14,465 | 10,218 | failed | 929 | 2,230 | 869 | stopped | |||
| Hibernate | 2,567 | 7,594 | 8,750 | failed | 1,471 | 1,943 | 903 | stopped | |||
| OpenJPA | 2,716 | 4,876 | 4,968 | 2,408 | 1,495 | 1,096 | 4,704 | ||||
| ObjectDB | 169,550 | 97,642 |
Performance comparison chart - The Y-Axis represents normalized score in logarithmic scale - higher is better:
Performance comparison chart - The Y-Axis represents normalized score in linear scale - higher is better:
Best and Worst JPA/Database Performer in this comparison
The Most Efficient (the Fastest):
| 1. | ObjectDB embedded | 100 |
| 2. | ObjectDB server | 57.6 |
| 3. | EclipseLink with H2 embedded | 8.5 |
| 4. | EclipseLink with HSQLDB embedded | 6.0 |
| 5. | Hibernate with HSQLDB embedded | 5.2 |
| 6. | Hibernate with H2 embedded | 4.5 |
| 7. | OpenJPA with HSQLDB embedded | 2.9 |
| 8. | OpenJPA with H2 embedded | 2.9 |
| 9. | OpenJPA with PostgreSQL server | 2.8 |
| 10. | OpenJPA with Derby embedded | 1.6 |
| 11. | DataNucleus with DB4O embedded | 1.6 |
| 12. | DataNucleus with H2 embedded | 1.6 |
| 13. | DataNucleus with HSQLDB embedded | 1.6 |
| 14. | DataNucleus with Derby embedded | 1.6 |
| 15. | Hibernate with Derby embedded | 1.5 |
| 16. | OpenJPA with Derby server | 1.4 |
| 17. | EclipseLink with Derby embedded | 1.4 |
The Least Efficient (the Slowest):
| 18. | EclipseLink with H2 server | 1.3 |
| 19. | Hibernate with H2 server | 1.1 |
| 20. | OpenJPA with H2 server | 0.88 |
| 21. | Hibernate with Derby server | 0.87 |
| 22. | DataNucleus with H2 server | 0.68 |
| 23. | OpenJPA with MySQL server | 0.65 |
| 24. | EclipseLink with Derby server | 0.55 |
| 25. | Hibernate with MySQL server | 0.53 |
| 26. | EclipseLink with MySQL server | 0.51 |
| 27. | DataNucleus with MySQL server | 0.40 |
| 28. | DataNucleus with PostgreSQL server | 0.39 |
| 29. | DataNucleus with Derby server | 0.33 |
| 30. | EclipseLink with SQLite embedded | 0.0000 |
| 31. | EclipseLink with PostgreSQL server | 0.0000 |
| 32. | Hibernate with SQLite embedded | 0.0000 |
| 33. | Hibernate with PostgreSQL server | 0.0000 |
Problems (Exceptions) in these tests
- EclipseLink with SQLite embedded
Local Exception Stack: Exception [EclipseLink-3002] (Eclipse Persistence Services - 2.1.1.v20100817-r8050): org.eclipse.persistence.exceptions.ConversionException Exception Description: The object [-612,000,000], of class [class java.lang.Integer], from mapping [org.eclipse.persistence.mappings.DirectToFieldMapping[lastLoginDate-->COLLECTIONPERSON.LASTLOGINDATE]] with descriptor [RelationalDescriptor(org.jpab.col.CollectionPerson --> [DatabaseTable(COLLECTIONPERSON)])], could not be converted to [class java.util.Date]. at org.eclipse.persistence.exceptions.ConversionException.couldNotBeConverted(ConversionException.java:71) at org.eclipse.persistence.internal.helper.ConversionManager.convertObjectToUtilDate(ConversionManager.java:761) at org.eclipse.persistence.internal.helper.ConversionManager.convertObject(ConversionManager.java:101) at org.eclipse.persistence.internal.databaseaccess.DatasourcePlatform.convertObject(DatasourcePlatform.java:157) at org.eclipse.persistence.mappings.converters.TypeConversionConverter.convertDataValueToObjectValue(TypeConversionConverter.java:119) at org.eclipse.persistence.mappings.foundation.AbstractDirectMapping.getAttributeValue(AbstractDirectMapping.java:675) at org.eclipse.persistence.mappings.foundation.AbstractDirectMapping.valueFromRow(AbstractDirectMapping.java:1263) at org.eclipse.persistence.mappings.foundation.AbstractDirectMapping.buildCloneFromRow(AbstractDirectMapping.java:1234) at org.eclipse.persistence.internal.descriptors.ObjectBuilder.buildAttributesIntoWorkingCopyClone(ObjectBuilder.java:1338) at org.eclipse.persistence.internal.descriptors.ObjectBuilder.buildWorkingCopyCloneFromRow(ObjectBuilder.java:1466) at org.eclipse.persistence.internal.descriptors.ObjectBuilder.buildObjectInUnitOfWork(ObjectBuilder.java:558) at org.eclipse.persistence.internal.descriptors.ObjectBuilder.buildObject(ObjectBuilder.java:502) at org.eclipse.persistence.internal.descriptors.ObjectBuilder.buildObject(ObjectBuilder.java:454) at org.eclipse.persistence.queries.ObjectLevelReadQuery.buildObject(ObjectLevelReadQuery.java:721) at org.eclipse.persistence.queries.ReadAllQuery.registerResultInUnitOfWork(ReadAllQuery.java:723) at org.eclipse.persistence.queries.ReadAllQuery.executeObjectLevelReadQuery(ReadAllQuery.java:420) at org.eclipse.persistence.queries.ObjectLevelReadQuery.executeDatabaseQuery(ObjectLevelReadQuery.java:1074) at org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java:736) at org.eclipse.persistence.queries.ObjectLevelReadQuery.execute(ObjectLevelReadQuery.java:1034) at org.eclipse.persistence.queries.ReadAllQuery.execute(ReadAllQuery.java:380) at org.eclipse.persistence.queries.ObjectLevelReadQuery.executeInUnitOfWork(ObjectLevelReadQuery.java:1112) at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecuteQuery(UnitOfWorkImpl.java:2909) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1291) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1273) at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1247) at org.eclipse.persistence.internal.jpa.EJBQueryImpl.executeReadQuery(EJBQueryImpl.java:479) at org.eclipse.persistence.internal.jpa.EJBQueryImpl.getResultList(EJBQueryImpl.java:714) at org.jpab.Test.retireveEntities(Test.java:382) at org.jpab.Test.doAction(Test.java:251) at org.jpab.Runner$RemoveAction.run0(Runner.java:587) at org.jpab.Runner$TestAction.run(Runner.java:517) at java.lang.Thread.run(Thread.java:662)
- Hibernate with SQLite embedded
javax.persistence.RollbackException: Error while committing the transaction at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:93) at org.jpab.Test.persist(Test.java:217) at org.jpab.Test.persist(Test.java:200) at org.jpab.Runner$PersistAction.run0(Runner.java:538) at org.jpab.Runner$TestAction.run(Runner.java:517) at java.lang.Thread.run(Thread.java:662) Caused by: javax.persistence.PersistenceException: org.hibernate.exception.GenericJDBCException: could not insert: [org.jpab.col.CollectionPerson] at org.hibernate.ejb.AbstractEntityManagerImpl.convert(AbstractEntityManagerImpl.java:1214) at org.hibernate.ejb.AbstractEntityManagerImpl.convert(AbstractEntityManagerImpl.java:1147) at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:81) ... 5 more Caused by: org.hibernate.exception.GenericJDBCException: could not insert: [org.jpab.col.CollectionPerson] at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:140) at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:128) at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66) at org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2436) at org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2856) at org.hibernate.action.EntityInsertAction.execute(EntityInsertAction.java:79) at org.hibernate.engine.ActionQueue.execute(ActionQueue.java:273) at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:265) at org.hibernate.engine.ActionQueue.executeActions(ActionQueue.java:184) at org.hibernate.event.def.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:321) at org.hibernate.event.def.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:51) at org.hibernate.impl.SessionImpl.flush(SessionImpl.java:1216) at org.hibernate.impl.SessionImpl.managedFlush(SessionImpl.java:383) at org.hibernate.transaction.JDBCTransaction.commit(JDBCTransaction.java:133) at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:76) ... 5 more Caused by: java.sql.SQLException: PRIMARY KEY must be unique at org.sqlite.DB.throwex(DB.java:288) at org.sqlite.DB.executeBatch(DB.java:236) at org.sqlite.PrepStmt.executeBatch(PrepStmt.java:82) at com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch(NewProxyPreparedStatement.java:1723) at org.hibernate.jdbc.BatchingBatcher.doExecuteBatch(BatchingBatcher.java:70) at org.hibernate.jdbc.BatchingBatcher.addToBatch(BatchingBatcher.java:56) at org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:2416) ... 16 more
The following runs have been stopped due to being too slow
- EclipseLink with PostgreSQL server
- Hibernate with PostgreSQL server
The results above are in use in calculating the following average results
- All Tests - All Operations - All Batch Size Modes
- All Tests - All Operations - Many Entities (5000)
- All Tests - Removal Operations - All Batch Size Modes
- All Tests - Removal Operations - Many Entities (5000)
- Element Collection Test - All Operations - All Batch Size Modes
- Element Collection Test - All Operations - Many Entities (5000)
- Element Collection Test - Removal Operations - All Batch Size Modes
