Standard Performance Evaluation Corporation

Standard Performance Evaluation Corporation

The Standard Performance Evaluation Corporation (SPEC) is a non-profit organization that aims to produce "fair, impartial and meaningful benchmarks for computers." SPEC was founded in 1988 and their goal is to ensure that the marketplace has a fair and useful set of metrics to differentiate candidate systems. Its member organizations includes leading computer and software manufacturers. SPEC benchmarks are widely used today in evaluating the performance of computer systems; the results are published on the SPEC web site. Results are informally referred to as "SPECmarks", results or even just "SPEC".

The benchmarks aim to test "real-life" situations. SPECweb2005, for example, tests web server performance by performing various types of parallel HTTP requests, and SPEC CPU tests CPU performance by measuring the run time of several programs such as the compiler gcc and the chess program crafty. The various tasks are assigned weights based on their perceived importance; these weights are used to compute a single benchmark result in the end.

SPEC benchmarks are written in a platform neutral programming language (usually C or Fortran), and the interested parties may compile the code using whatever compiler they prefer for their platform, but may not change the code. Manufacturers have been known to optimize their compilers to improve performance of the various SPEC benchmarks.

In order to use a benchmark, a license has to be purchased from SPEC; the costs vary from test to test with a typical range from several hundred to several thousand dollars. This pay-for-license model might seem to be in violation of the GPL as the benchmarks include software such as GCC that is licensed by the GPL. However, the GPL does not require software to be distributed for free, only that recipients be allowed to redistribute any GPLed software that they receive; the license agreement for SPEC specifically exempts items that are under "licenses that require free distribution", and the files themselves are placed in a separate part of the overall software package.

Benchmarks

Current

* SPEC CPU2006, combined performance of CPU, memory and compiler
** CINT2006 ("SPECint"), testing integer arithmetic, with programs such as compilers, interpreters, word processors, chess programs etc.
** CFP2006 ("SPECfp"), testing floating point performance, with physical simulations, 3D graphics, image processing, computational chemistry etc.
* SPECjms2007, Java Message Service performance
* SPECweb2005, PHP and/or JSP performance.
* SPECviewperf, performance of an OpenGL 3D graphics system, tested with various rendering tasks from real applications
* SPECapc, performance of several 3D-intensive popular applications on a given system
* SPEC OMP2001 V3.2, for evaluating performance of parallel systems using OpenMP (http://www.openmp.org) applications.
* SPEC MPI2007, for evaluating performance of parallel systems using MPI (Message Passing Interface) applications.
* SPECjvm2008, measuring basic Java performance of a Java Runtime Environment on a wide variety of both client and server systems.
* SPECjAppServer2004, a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers.
* SPECjbb2005, evaluates the performance of server side Java by emulating a three-tier client/server system (with emphasis on the middle tier).
* SPEC MAIL2001, performance of a mail server, testing SMTP and POP protocols
* SPECpower_ssj2008, evaluates the energy efficiency of server systems.
* SPEC SFS97_R1, NFS file server throughput and response time

Future

* SPECappPlatform, performance of web enterprise platforms (such as Java EE and .NET)
* SPECimap2003, performance of an enterprise level mail server, testing SMTP and IMAP4 protocols

Retired

* SPEC CPU2000
* SPEC CPU95
* SPEC HPC96
* SPEC HPC2002 (no longer available)
* SPECjAppServer2001
* SPECjAppServer2002
* SPECjbb2000
* SPEC SDM91
* SPEC SFS97
* SPECweb96
* SPECweb99
* SPECweb99_SSL
* SPEC JVM98

External links

* [http://www.spec.org/ Official SPEC website]


Wikimedia Foundation. 2010.

Игры ⚽ Поможем решить контрольную работу

Look at other dictionaries:

  • Standard Performance Evaluation Corporation — (SPEC), es un consorcio sin fines de lucro que incluye a vendedores de computadoras, integradores de sistemas, universidades, grupos de investigación, publicadores y consultores de todo el mundo. Tiene dos objetivos: crear un benchmark estándar… …   Wikipedia Español

  • Standard Performance Evaluation Corporation — (SPEC) некоммерческая организация, главной целью которой является разработка и публикация наборов тестов, предназначенных для измерения производительности компьютеров. SPEC была учреждена в 1988 году крупнейшими производителями компьютерного… …   Википедия

  • Standard Performance Evaluation Corporation — Standard Performance Evaluation Corporation,   SPEC …   Universal-Lexikon

  • Standard Performance Evaluation Corporation — Die Standard Performance Evaluation Corporation (SPEC) ist eine Non Profit Organisation, die Benchmarks zur Leistungsbewertung von Hardware und Software entwickelt. Die Mitglieder sind alle großen Hardware und Softwarehersteller und einige… …   Deutsch Wikipedia

  • Standard Performance Evaluation Company — Die Standard Performance Evaluation Corporation (SPEC) ist eine Non Profit Organisation, die Benchmarks zur Leistungsbewertung von Hardware und was weniger bekannt ist auch von Software entwickelt. Der Benchmark selbst ist jedoch kostenpflichtig …   Deutsch Wikipedia

  • Evaluation (disambiguation) — Evaluation is the process of characterizing and appraising something of interest or of determining the value of an expression (mathematics). Computer science * determining the value of an expression (programming) * Eager evaluation or strict… …   Wikipedia

  • Performance measurement — with a process is the complement to process execution. Based on measured performance, the feedback control loop may be closed. The metrics to assess performance is set according to a determined econometric model. The expected best result is… …   Wikipedia

  • Test de performance — Un test de performance est un test dont l objectif est de déterminer la performance d un système informatique. L acception la plus courante de ce terme est celle dans laquelle ces tests logiciels vont avoir pour objectif de mesurer les temps de… …   Wikipédia en Français

  • Computer performance — is characterized by the amount of useful work accomplished by a computer system compared to the time and resources used. Depending on the context, good computer performance may involve one or more of the following: Short response time for a given …   Wikipedia

  • Corporation — This article is about business corporations. For other uses, see Corporation (disambiguation). Corporate redirects here. For the Bollywood film, see Corporate (film). A corporation is created under the laws of a state as a separate legal entity… …   Wikipedia

Share the article and excerpts

Direct link
… Do a right-click on the link above
and select “Copy Link”