Jump to content

List of benchmarking methods and software tools

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by 194.69.224.14 (talk) at 09:54, 11 January 2018. The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Benchmarking requires the use of specific valuation methods. With evaluation is meant the level of achieving the target for a particular evaluation item. There are general "methods" respectively approaches as well as IT-supported "software tools" that enable an effective and efficient work.

The following is a list of notable methods and benchmarking software tools.

Benchmarking methods

There are many benchmarking methods each having different analytical focus. The methods are mostly known and will be shown in the following summary.[1]

Methods Notes
Matrix technology
Comparison tables
Graphs: Pie chart, Bar chart / Histogram
SWOT analysis
Potential/resources-analysis
Price/performance ratio
Potential analysis
Life cycle analysis
market growth/market share portfolio
market attractiveness/competitive strength portfolio
Portfolio attractiveness customer/supplier position
Technology/resource strength
Market position/technology position portfolio
Contribution margin/cost development portfolio
Price/customer satisfaction portfolio
Revenue share/revenue portfolio
Spider web diagram

Benchmarking software tools

There are a number software tools that allow the support of different kinds of benchmarking types.

Software Publisher Platforms Notes
BenchmarkIndex Winning Moves Ltd web-based
Combo Benchmark Compare to Compete Online Benchmarking web-based database This web-based database is suitable for groups of competitors to benchmark individual performance against group performance. All process and performance benchmarks can be processed in this software, providing interesting analysis tools and complete benchmarking report.
GOBENCH INDEC GmbH & Co. KG web-based database The web-based database supports different kinds of benchmarking categories (product, process, competitor / customer, reverse engineering, marketing, patents, technologies, innovations, ...) and allows reams of analysing possibilities [2]
Workload Simulator (WSim) IBM mainframe server WSim simulates one or many network terminal(s) to load a mainframe computer system by executing programmed scripts, for functional testing, system testing, regression testing, capacity management, benchmarking and stress testing. It is a re-packaged, subset version of IBM's Teleprocessing Network Simulator.[3]: 19–22 

Benchmarking HPC Clusters

There are numerous suites for examining the performance of a High Performance Computing cluster, including

  • ADEPT - 4 suites relating to energy measurements
  • HPCC, HPCG, Linpack
  • IMB (Intel MPI Benchmark) - gives rates for common MPI-1 point-to-point and collectives
  • Mantevo - series of "mini apps" from Sandia National Labs (SNL)
  • NAS & NPB
  • SHOC - for accelerators
  • Stream (memory b/w)

See also

References

  1. ^ Peter Kairies: So analysieren Sie Ihre Konkurrenz. expert Verlag, Renningen 2001, 3-8169-1977-4.
  2. ^ Anette von Ahsen (Hrsg.): Bewertung von Innovationen im Mittelstand. Springer, Berlin-Heidelberg 2010, 978-3-642-01699-8.
  3. ^ *IBM Workload Simulator ~ User's Guide (PDF). First Edition. IBM. August 2002. SC31-8948-00. {{cite book}}: Cite has empty unknown parameter: |sectionurl= (help) Retrieved on October 29, 2015.