Linux Benchmark Suite 관련

by · Published · Updated

Introduction

This project is made up of various parties interested in measuring aspects
of linux performance. Some members are interested in performance of a specific
workload on normal PC architectures, some are comparing specific hardware
capabilities,some are trying to push linux’s scalibility limits on larger
systems, and some are trying to measure performance of specific applications.

One of the problems with benchmarking on linux is the ability to talk about
benchmark numbers in the open as certain benchmarks have specific restrictions
on their use, usually requiring the results to be audited and approved. We hope
to develop open benchmarks to use in substitution of restricted benchmarks.

Project Resources

Project management tools and mailing lists can be found on the SourceForge
site.

Benchmark Tools

Quick-Hit Benchmarks

“Quick-hit” benchmarks are simple tests to measure a certain aspect of
performance, but usually do not give a larger perceptive of system performance.

  • Ttcp – measures the point-to-point bandwidth over a network connection
  • Ping – can measure the latency of a network connection
  • Hdparm – “-t” and “-T” options can be used to measure disk-to-memory (disk reads) transfer rates
  • Dga – the “-b” option measures CPU/video memory bandwidth

Synthetic Benchmarks

Synthetic benchmarks are similar to “quick-hit” tests in that they are
not meant to represent a “real-world” workload, but can often be useful in
measuring the maximum capacity of specific aspects of a system.

  • lmbench – a GPL’d suite of
    atomic benchmarks, no publishing restrictions

  • UnixBench     – a fundamental high-level Linux benchmark suite,
    Unixbench integrates CPU and file I/O tests, as well as system
    behaviour under various user loads

  • AIM9     – the AIM Independent Resource Benchmark exercises and times
    each component of a UNIX computer system, independently. The benchmark
    uses 58 subtests to generate absolute processing rates, in operations
    per second, for subsystems, I/O transfers, function calls, and UNIX
    system calls. GPL’d and can be published under the “non-audited” clause.

  • Netperf – a sophisticated network and filesystem benchmark, freely available, publishable?
  • SSLperf – open source web benchmark designed to measure performance of SSL operations
  • dbench – similar
    workload to netbench but GPL’d and much easier to config and run (doesn’t
    require clients), suite also includes tbench and smbtorture, no publishing restrictions
  • Bonnie – io throughput benchmark, GPL’d with no publishing restrictions
  • Bonnie++ an enhanced version of bonnie written in C++, GPL’d with no publishing restrictions
  • Iozone is useful for performing a
    broad filesystem analysis of a vendor’s computer platform. The
    benchmark tests file I/O performance for the following operations:
    Read, write, re-read, re-write, read backwards, read strided, fread,
    fwrite, random read, pread ,mmap, aio_read, aio_write. It has recently
    added tests for NFS, CIFS, and distributed/cluster systems.

  • SPEC CPU2000 – benchmark suite designed to
    evaluate raw cpu and compiler power
  • BYTEmark – CPU
    benchmark suite, reporting CPU/cache/memory, integer and floating-point
    performance
  • Cachebench – measures bandwidth of the memory subsystem (L1, L2 and main memory)
  • Stream – measures
    sustainable memory bandwidth vs. FPU performance

  • SPECviewperf – synthetic graphics benchmark
  • Xengine – a little X window toy that shows the speed with which a
    system will redraw a coloured bitmap on screen (a simulation of a four
    cycle engine), availible from www.tux.org/pub/benchmarks/
  • Xbench Xserver benchmark
  • XMark93 – Xserver benchmark (part of SPEC, defunct?)

Application Benchmarks

  • Open Source Database Benchmark
    – GPL’d benchmark based on the AS3AP database benchmark with no
    publishing restrictions
  • VolanoMark – a
    Java-based chat room benchmark, freely availible, publishable?
  • chat – a GPL’d chat room benchmark
    written in C, designed to emulate VolanoMark behavior, no publishing
    restrictions
  • Postal SMTP mail delivery
    test and POP mail reception test

  • AIM7     – the AIM Multiuser Benchmark – Suite VII tests and measures
    the performance of Open System multiuser computers. It comes with
    preconfigured workload mixes for Multiuser/Shared System, Compute
    Server, Large Database,and File Server. Publishable under the
    “non-audited” clause.
  • Webstone – web server benchmark, freely availible, publishable?
  • MDBNCH – a large FORTRAN 77 application benchmark, accesses a large data set in a very irregular pattern, generates misses in both the L1 and L2 caches
  • TPC-A – now defunct Online Transaction Processing (OLTP) database benchmark
  • TPC-B – now defunct Online Transaction Processing (OLTP) database benchmark
  • TPC-C – current industry standard Online Transaction Processing (OLTP) database benchmark
  • TPC-D – now defunct Decision Support System (DSS) database benchmark
  • TPC-H – current industry standard ad-hoc DSS database benchmark
  • TPC-R – current industry standard Business Reporting database benchmark
  • TPC-W – current industry standard E-commerce database benchmark
  • SPECapc – graphics application benchmark
  • SPEC HPC96 – hpc application benchmark
  • SPEC JBB2000 – server-side Java benchmark
  • SPEC JVM98 – client-side Java benchmark
  • SPEC SFS97 – NFS benchmark
  • SPEC WEB99 – Web server benchmark
  • SPEC SDM – defunct multi-user system benchmark
  • NAS Parallel Benchmark
    – Computational Fluid Dynamics benchmark, source freely available,
    publishable?

  • ARC2D Benchmark     – scientific benchmark, source freely available,
    publishable?
  • PARKBENCH –
    PARellel Kernels and BENCHmarks
  • High Performance Linpack
    Benchmark

Findings and Whitepapers

Other useful resources

Tags:

서진우

슈퍼컴퓨팅 전문 기업 클루닉스/ 상무(기술이사)/ 정보시스템감리사/ 시스존 블로그 운영자

You may also like...

페이스북/트위트/구글 계정으로 댓글 가능합니다.