About

Results

Manuals

Download

List

Home

CCPsuite

About

The suite provides a comprehensive benchmarking platform for CORBA middleware. The platform consists of five separate projects complementing each other:

Sampler

A simplified benchmarking suite with benchmarks covering basic scalability aspects including multiple sizes of messages and multiple counts of objects and threads. The results can be submitted to a searchable database that provides overview of performance associated with specific system configuration. Supports C++ and Java on Linux, Windows, Solaris.

Xampler

A detailed benchmarking suite with benchmarks covering basic scalability aspects including multiple sizes and types of messages, multiple counts of objects, threads, clients. Each benchmark collects variety of information including processor, memory and network usage on both client and server and separate and aggregate timings of individual parts of benchmark operations. The suite can be extended simply by supplying the code of single benchmark operation. Supports C++ and Java on Linux, Windows, Solaris.

Avenger

A set of scripts that executes benchmarks from Xampler and generates plots with Bagatel. Results illustrating performance of several major brokers generated with Avenger are available here.

Bagatel

A utility for generating configurable plots from results produced by Xampler. Results illustrating performance of several major brokers plotted with Bagatel are available here.

Browser

A utility for quick browsing of results produced by Xampler.

The suite has been developed and used within the framework of numerous research and industrial projects. The major projects include:

• The Bagatel utility is used by the DOC Group of Vanderbilt University in their DDS Middleware Benchmarks.
• The Xampler suite is used by the DOC Group of Vanderbilt University in their TAO Middleware Benchmarks.
• The Xampler suite monitoring code is used by the PEL Lab of University College Dublin in their COMPAS Monitoring Framework.
• The Xampler suite has been partially developed and used in a benchmarking project for Borland International, USA, 2002.
• The Xampler suite has been partially developed and used in a benchmarking project for IONA Technologies, PLC, Ireland, 2000.
• CORBA Comparison Project with MLC Systeme GmbH, now a part of Deutsche Post under the name DP Com, 1998.

Results

The Sampler results are available here. The Xampler results are available in the table below.

Standard Results		Experimental Results	Older Results
All Results Summary
C++ Brokers	Java Brokers
JacORB major releases 2.1 series 2.0 series OpenORB major releases 1.3 series	omniORB major releases 4.1 series 4.0 series OrbRiver major releases 2.5 series TAO major releases 1.7 series 1.6 series 1.5 series 1.4 series 1.3 series 1.2 series	TAO 1.5.2 threading experiments 1.5.0 hacking experiments 1.4.8 patching experiments 1.4.7 subsetting experiments	JacORB 1.4.1 on Solaris and Windows Jonathan 3.0 alpha 10 on Linux Orbix 5.1 on Solaris and Windows TAO 1.2.4 on Solaris and Windows VisiBroker 5.1 on Solaris and Windows

We would like to acknowledge, in alphabetical order, Borland Software Corporation, Intel Corporation, Iona Technologies. Borland and Iona have kindly provided research grants for developing and running some of the benchmarks. Intel has kindly provided an equipment grant for developing and running some of the benchmarks.

Manuals

Please report bugs using our bug tracking system for Sampler, Xampler, Avenger, Bagatel, Browser, Support is available using our mailing list.

You can access the frequently asked questions for Bagatel.

The developer documentation generated from the sources is also available for Bagatel.

More manuals will be added. In the meantime, please check the documentation inside the source packages.

Download

It is recommended to download the latest SVN snapshot. The latest SVN snapshot is rarely broken and the officially released version tends to lag behind the latest SVN snapshot in the support for latest versions of the underlying platforms.

Sampler

• The latest SVN snapshot is here.
• The SVN repository is accessible at http://shiva.ms.mff.cuni.cz/svn/sampler.
• The latest officially released version is Sampler 1.17.

Xampler

• The latest SVN snapshot is here.
• The SVN repository is accessible at http://shiva.ms.mff.cuni.cz/svn/xampler.
• The latest officially released version is Xampler 1.10.

Avenger

• The latest SVN snapshot is here.
• The SVN repository is accessible at http://shiva.ms.mff.cuni.cz/svn/avenger.
• Avenger does not have officially versioned releases.

Bagatel

• The latest SVN snapshot is here.
• The SVN repository is accessible at http://shiva.ms.mff.cuni.cz/svn/bagatel.
• Bagatel does not have officially versioned releases.

Browser

• The latest SVN snapshot is here.
• The SVN repository is accessible at http://shiva.ms.mff.cuni.cz/svn/browser.
• Browser does not have officially versioned releases.