June 13, 2012
GAINESVILLE, VA, June 13 — The Standard Performance Evaluation Corp. (SPEC) has formed a new group to research and recommend application workloads for benchmarking cloud computing performance.
The group functions under SPEC's Open Systems Group (OSG) and is working in cooperation with other SPEC committees and subcommittees to define cloud benchmark methodologies, determine and recommend application workloads, identify cloud metrics for existing SPEC benchmarks, and develop new cloud benchmarks.
Current participants in OSGCloud include AMD, Dell, IBM, Ideas International, Intel, Karlshuhe Institute of Technology, Oracle, Red Hat and VMware. Long-time SPEC benchmark developer Yun Chao is a supporting contributor. The group collaborates with the SPEC Research Cloud group, which is working on gaining a broader understanding of cloud behavior and performance issues.
A major shift
While cloud performance takes into account many of the same characteristics as current SPEC benchmarks – throughput, response time and power, for example – it also brings into play new metrics such as elasticity, defined as how quickly a service can adapt to changing customer needs.
"Cloud computing is on the rise and represents a major shift in how servers are used and how their performance is measured," says Rema Hariharan, chair of OSGCloud. "We want to assemble the best minds to define this space, create workloads, augment existing SPEC benchmarks, and develop new cloud-based benchmarks."
Call for wider participation
The group targets three types of users for the workloads and benchmarks it will create:
OSGCloud has already developed a 50-page report that details its objectives, benchmark considerations, characteristics of a cloud benchmark, and tools for creating metrics.
"We have gotten off to a great start in creating guidelines for benchmarks with clearly defined, standardized metrics, but we would like to see wider participation, especially from cloud providers and users," says Hariharan.
For more information
For more information on OSGCloud and to download the report on cloud computing, visit www.spec.org/osgcloud.
SPEC is a non-profit organization that establishes, maintains and endorses standardized benchmarks to evaluate performance for the newest generation of computing systems. Its membership comprises 130 leading computer hardware and software vendors, educational institutions, research organizations, and government agencies worldwide.
10/30/2013 | Cray, DDN, Mellanox, NetApp, ScaleMP, Supermicro, Xyratex | Creating data is easy… the challenge is getting it to the right place to make use of it. This paper discusses fresh solutions that can directly increase I/O efficiency, and the applications of these solutions to current, and new technology infrastructures.
10/01/2013 | IBM | A new trend is developing in the HPC space that is also affecting enterprise computing productivity with the arrival of “ultra-dense” hyper-scale servers.
Ken Claffey, SVP and General Manager at Xyratex, presents ClusterStor at the Vendor Showdown at ISC13 in Leipzig, Germany.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?