Performance Evaluation of Object Oriented Middleware - Development of a Benchmarking Toolkit

A method for evaluating several aspects of the performance of object oriented middleware is introduced. Latency, data transfer, parameter marshalling and scalability are considered. A portable benchmark toolkit is developed to implement the method. A number of actual middleware products were measured, such as C++ and Java based CORBA implementations, DCOM and Java/RMI. The measurements are evaluated and related to each other. Keywords performance evaluation, middleware, distributed databases, CORBA, DCOM, JAVA/RMI 2 Motivation and Related Work One of the key issues in distributed database technology is interoperability. Interoperability must be provided on many levels of a distributed system. On the technical level --- on the level of communication ---, the use of middleware helps a lot. A lot of effort has been done in defining appropriate middleware standards. Much less effort has been done to evaluate middleware implementations. Currently, a certain number of de facto and de jure..