December 08, 2009
CHICAGO, Dec. 8 -- At the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC09), a research team led by the Open Cloud Consortium won the Bandwidth Challenge for new technology to support data-intensive applications over wide area clouds.
In addition to the Open Cloud Consortium (OCC), the research team included the Laboratory for Advanced Computing at the University of Illinois at Chicago, the International Center for Advanced Internet Research (iCAIR) at Northwestern University, and the Naval Research Laboratory.
The team demonstrated three applications, each showing how data-intensive applications could span geographically distributed datacenters given the appropriate hardware and software infrastructure. The demonstration used four datacenters located in Chicago, Baltimore and San Diego and connected by wide area 10 Gbps networks provided through a partnership with the National Lambda Rail and Cisco Systems, Inc.
The first application used the OCC's Open Cloud Testbed to process very large datasets over 256 servers in four datacenters connected by wide area high performance networks. Data was exchanged at over 100Gb/s among the participating nodes. This application used a new version (version 1.24) of the open source software Sector/Sphere large data cloud, which was developed by the Laboratory for Advanced Computing.
A protocol called UDT that was developed by the Laboratory for Advanced Computing is used by Sector/Sphere to achieve high performance, even over clouds that are distributed.
"With the Sector/Sphere technology demonstrated at the SC09 Bandwidth Challenge, new classes of large data cloud applications are now practical," according to Robert Grossman, who is the director of the Laboratory for Advanced Computing and managing partner of Open Data Group.
The second application was an image rendering application developed by the Naval Research Laboratory that delivered very high resolution visualization (computed by remote cloud systems) over wide area Infiniband and IPv6. A hardware implementation of UDT was deployed to support the wide area Infiniband protocol.
The third application used a new protocol called that UDX that is a lightweight variant of the UDT protocol. UDX was able to sustain a data transfer rate of 9.2 Gb/s over a 10 Gb/s connection with a 200ms RTT (which corresponds to a 12,000 mile path or long enough to reach half way around the world).
In addition to the Open Cloud Consortium applications being selected as the overall winner of the SC09 Bandwidth Challenge, a team led by Caltech and the University of Tokyo received SC09 Bandwidth Challenge Awards.
Source: Open Cloud Consortium
10/30/2013 | Cray, DDN, Mellanox, NetApp, ScaleMP, Supermicro, Xyratex | Creating data is easy… the challenge is getting it to the right place to make use of it. This paper discusses fresh solutions that can directly increase I/O efficiency, and the applications of these solutions to current, and new technology infrastructures.
10/01/2013 | IBM | A new trend is developing in the HPC space that is also affecting enterprise computing productivity with the arrival of “ultra-dense” hyper-scale servers.
Ken Claffey, SVP and General Manager at Xyratex, presents ClusterStor at the Vendor Showdown at ISC13 in Leipzig, Germany.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?