Openbench

About

Preparing an article for the German Linux Magazin, I had to notice that no standard OpenSource benchmark suite did exist. Of course there are the well-known SPEC suits, but they are not free and cost multiple hundred USD. Most open-source people used their selection of source to benchmark GCC.

So after I did some scripting to build various GCCs automatically and to run benchmarks for buildtime and runtime speed, I decided to open them to the public with the hope to increase the possiblity to agree on a OpenSource benchmark standard (in the future).

Openbench does build uppon already well-known OpenSource packages, including gzip, Bzip2, OpenSSL, GnuPG, libmad, Ogg/Vorbis, Botan, and Linux (2.6.6).

Releases

There is no Openbench tarball release yet (too much a moving target). The source can be optained from the Subversion repository.

Feedback

To improve the benchmark please send feature ideas, report compile problems, bugs via email to rene@exactcode.de.

Included tests

Gzip: The standard compression package - also included in the SPEC CPU2000. A 64MB tar and 16MB binary are compressed and decompressed, using -1 and -9.

Bzip2: The standard compression package - also included in the SPEC CPU2000. A 64MB tar and 16MB binary are compressed and decompressed, using -1 and -9.

OpenSSL: The open SSL implementation - "openssl speed" is used to meassure the performance. (First only "make test" was used, but the data-set was too small and ICC-8.0 miscompiles the code, so "openssl speed" allows to get an indication how fast ICC is although it needs to be noted that the resulting binary is not fully functional ...)

GnuPG: The open Privacy Guard implementation. "make check" is used and the 64MB tar and 16MB binary are encrypted additionally.

libMAD: The open MP3 decoding implementation. Three .mp3's are used to measure the performance: Jazz (4.5M), OpenBSD release song for 3.4 (6.7M) and 3.5 (9.9M).

Ogg/Vorbis: To be implementated.

Botan: A quite modern C++ (utilizing templates) security library - "make check" is used to measure the performance.