November 14, 2011
Demo leverages ESnet’s transcontinental Advanced Networking Research Initiative (ANI) testbed and multi-vendor participation to demonstrate RDMA-enabled data transfer, spanning approximately 7,000 miles
SEATTLE, Wash., Nov. 14 -- Today at Supercomputing 2011 (SC11), the international conference for high performance computing, networking, storage and analysis, researchers from Orange Silicon Valley, The Department of Energy’s Energy Sciences Network (ESnet), InfiniBand Trade Association (IBTA) and OpenFabrics Alliance (OFA) join forces with the SC11 conference network SCinet to showcase the world’s first demonstration of a Remote Direct Memory Access (RDMA)-enabled data transfer at 40 Gigabits per second (Gbps) over wide area network links spanning approximately 7,000 miles.
This experiment marks the first time that RDMA has been demonstrated at 40Gbps data rates for such a long distance, showcasing the technology’s ability to improve performance for bulk data transfer in the wide area. The demonstration illustrates three usage models of RDMA at such a distance: the ability to move multiple simultaneous data streams; the ability for a user to access a remote data set as though it were locally mounted; and the ability to move large file transfers at high bandwidths. The RDMA protocols in the wide area enable the three usage models to achieve up to 96 percent utilization of the available bandwidth in the network.
During the demonstration, SC11 attendees will see firsthand how RDMA enables servers in the local nodes to transfer data to or from application memory, eliminating the overhead of copying data between application memory and the data buffers in the operating system. When an application performs an RDMA operation, the application data is delivered directly to the network, eliminating the additional latency the transfer would incur if the data were to be copied into the operating system memory buffers. This dramatically increases the application-messaging rate and the application processing efficiency of the servers from approximately 20 percent up to 80-90 percent.
“RDMA communication opens new possibilities for collaboration among researchers by enabling quick and efficient data sharing,” said Jim Ryan, chair of the Open Fabrics Alliance. “By eliminating many of the typical network performance bottlenecks, users make more efficient use of their WAN, cloud and data center infrastructures.”
The demonstration was conceived this past summer when Orange Silicon Valley, a subsidiary of France Telecom-Orange, an international operator for mobile and broadband Internet services and one of the world leaders in providing telecommunication services to multinational companies, partnered with ESnet and Bay Microsystems to perform the first field trial of this technology demonstrating RDMA protocols over a 40Gbps WAN over a distance of 230 miles. The success of that field trial encouraged Orange Silicon Valley and the collaborators to consider longer distance trials at SC11, leveraging the SC11 SCinet Research Sandbox (SRS), a conference program, which provides a venue for network researchers to showcase disruptive innovation in an experimental network environment.
Orange Silicon Valley successfully submitted a proposal to the SCinet SRS to showcase this technology at SC11, choosing the OFA and IBTA booth based on both consortiums’ vision of embracing open standards. The SC11 demonstration – including technology from members of both the IBTA and OFA - leverages ESnet’s nationwide ANI Testbed which is being made available to researchers both in the public and private sector as a first of its kind platform to test experimental approaches to new network protocols and architectures in a greater than 10 Gbps network environment.
“This collaboration at SC11 between Orange Silicon Valley, ESnet and members of the IBTA and OFA enables a unique environment for demonstrating the benefits of globally scaling out and deploying RDMA-enabled applications,” said Brian Sparks, co-chair of the marketing working groups of the IBTA and OFA.
The following member companies provided hardware, software, architectural and/or operational expertise in this demonstration: 3M, Bay Microsystems, Chelsio Communications, DataDirect Networks, Finisar, HP, Mellanox Technologies, NetApp, Software Forge, System Fabric Works and Volex.
About the InfiniBand Trade Association
The InfiniBand Trade Association was founded in 1999 and is chartered with maintaining and furthering the InfiniBand specification. The IBTA is led by a distinguished steering committee that includes HP, IBM, Intel, Mellanox Technologies, Oracle, QLogic Corporation and System Fabric Works. Other members of the IBTA represent leading enterprise IT vendors who are actively contributing to the advancement of the InfiniBand specification. The IBTA markets and promotes InfiniBand from an industry perspective through online, marketing and public relations engagements, and unites the industry through IBTA-sponsored technical events and resources. For more information on the IBTA, visit http://www.infinibandta.org.
About the OpenFabrics Alliance
The OpenFabrics Alliance (OFA) is a 501c) (6) non-profit association that develops, tests, licenses and distributes the OpenFabrics Enterprise Distribution (OFED) – multi-platform, open-source software for high-performance, low-latency and energy-efficient computing. OFED is used in business, research and scientific environments that require fast and efficient networks, storage connectivity and parallel computing. OFED is free and is included in major Linux distributions, as well as Microsoft Windows. In addition to distributing OFED, the OFA conducts training, workshops and interoperability testing to ensure all releases meet multivendor enterprise requirements for security, usability and reliability. For more information about the OFA, visit http://www.openfabrics.org.
France Telecom-Orange is one of the world’s leading telecommunications operators with 170,000 employees worldwide, including 102,000 employees in France, and sales of 33.8 billion euros in the first nine months of 2011. Present in 35 countries, the Group had a customer base of 221 million customers at 30 September 2011, including 145 million customers under the Orange brand, the Group's single brand for Internet, television and mobile services in the majority of countries where the company operates. On 30 September 2011, the Group had 162 million mobile customers and 14 million broadband internet (ADSL, fibre) customers worldwide. Orange is one of the main European operators for mobile and broadband Internet services and, under the brand Orange Business Services, is one of the world leaders in providing telecommunication services to multinational companies.
With its industrial project, "conquests 2015,” Orange is simultaneously addressing its employees, customers and shareholders, as well as the society in which the company operates, through a concrete set of action plans. These commitments are expressed through a new vision of human resources for employees; through the deployment of a network infrastructure upon which the Group will build its future growth; through the Group's ambition to offer a superior customer experience thanks in particular to improved quality of service; and through the acceleration of international development. For more information, visit http://www.orange.com.
ESnet provides the high-bandwidth, reliable connections that link scientists at national laboratories, universities and other research institutions, enabling them to work together on some of the world's most important scientific challenges including energy, climate science, and the origins of the universe. Funded by the U.S. Department of Energy's Office of Science, and managed and operated by the ESnet team at Lawrence Berkeley National Laboratory (Berkeley Lab), ESnet provides scientists with access to unique DOE research facilities and computing resources, as well as to scientific collaborators including research and education networks around the world.
Source: Orange Silicon Valley, ESnet, InfiniBand Trade Association, and OpenFabrics Alliance
10/30/2013 | Cray, DDN, Mellanox, NetApp, ScaleMP, Supermicro, Xyratex | Creating data is easy… the challenge is getting it to the right place to make use of it. This paper discusses fresh solutions that can directly increase I/O efficiency, and the applications of these solutions to current, and new technology infrastructures.
10/01/2013 | IBM | A new trend is developing in the HPC space that is also affecting enterprise computing productivity with the arrival of “ultra-dense” hyper-scale servers.
Ken Claffey, SVP and General Manager at Xyratex, presents ClusterStor at the Vendor Showdown at ISC13 in Leipzig, Germany.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?