May 01, 2013
FREMONT, Calif. May 1 — SGI, the trusted leader in technical computing, today announced that iVEC and the Commonwealth Scientific and Industrial Research Organisation (CSIRO) have selected SGI to provide the massive data management infrastructure at the Pawsey Supercomputing Centre. The centre is part of the Australian Government Super Science Initiative to support the Australian Square Kilometre Array Pathfinder (ASKAP) and the Murchison Widefield Array (MWA) radio astronomy facility.
The Pawsey Centre will process huge volumes of data. The two largest generators of data are expected to be the Australian Square Kilometre Array Pathfinder (ASKAP), Australia's largest and most capable radio telescope ever constructed, and the Murchison Widefield Array (MWA) project, which studies the signals from the dynamic radio sky as well as measurements of the Sun and heliospheric plasma. These initiatives will expand understanding of the universe and drive technological development worldwide. It is anticipated that these two projects combined will generate eight petabytes of data each year, all of which will flow through the Pawsey Centre. When adding in data from other research areas, such as geothermal modelling and rock characterisation, iVEC forecasts supporting data volumes at approximately ten petabytes annually for the foreseeable future. To manage such volumes, CSIRO selected an SGI InfiniteStorage and SGI UV 2000 based solution to address the scale and cost-efficiency requirements for a project of this magnitude.
The SGI InfiniteStorage solution comprises disk storage systems and licences to support up to 100 petabytes of online storage that is virtualized across multiple performance tiers by SGI DMF software, with data ingest and workflow managed by SGI LiveArc. The system's six petabytes of primary storage is virtualized to provide further flexibility and savings with an additional cache of SGI MAID, the company's energy-efficient zero-watt disk technology. This environment integrates with 40 petabytes of data tape libraries and provides expansion capabilities to support a seamless 100-petabyte hierarchical storage management (HSM) online environment.
Beyond big data management and storage, the SGI UV 2000 solution delivers both big data analysis and visualization capabilities. Working as a set of data-analysis engines to move and process huge amounts of data very quickly, the SGI UV 2000 can be incorporated into an array of different workflows to provide pre- and post- processing for a range of scientific applications. The versatility of the SGI UV 2000 allows the Pawsey Centre to deliver extremely powerful big data visualization capabilities, enabling its researchers to view and manipulate vast amounts of data in new ways. This new technology will allow the Pawsey scientists to visualize images in the order of four terabytes, an order of magnitude greater than the size of images previously available, which in turn provides a quicker path to results and interactions.
"iVEC is committed to ensuring Australia maintains its place as a world leader in research and scientific computing, and the Pawsey Centre is a critical pillar in this strategy," says Neil Stringfellow, iVEC's executive director. "SGI's storage and data analysis infrastructure is a vital component of the Pawsey infrastructure. In particular the SGI UV 2000 visualisation system with its very large shared memory capability will enable our researchers to manipulate their data in a completely new way, leading to the potential for new insight and ambitious analysis."
The Pawsey Centre is expected to be fully operational and in production by October 2013, with users gaining early access before June. It is anticipated that the first component to be heavily used will be the SGI InfiniteStorage based HSM as the radio-astronomy community moves into the final testing phase for their apparatus and begins to stream significant volumes of data. The SGI UV 2000 based data-analysis engines and visualisation systems are expected to come online shortly thereafter.
"For decades, SGI has been solving Big Data challenges for researchers across science and industry in an effort to find answers to the world's toughest challenges," said Jorge Titinger, president and CEO, SGI. "We are very pleased to support the data management needs of the Pawsey Supercomputing Centre. They are conducting impressive research, and with our InfiniteStorage and UV 2000 technology, will be able to reach results and interactions more quickly. We look forward to continuing this partnership and seeing the Pawsey Centre's revolutionary solutions to challenges in science."
SGI InfiniteStorage Environment:
Data Processing and Visualisation:
iVEC provides high performance computing, network and visualisation capabilities to the Australian research community including Square Kilometre Array precursor projects. iVEC's goal is to enable world-class science and research to be undertaken in Western Australia and beyond, to gain international recognition for Australia's science and research capabilities and to enable researchers to realise the potential of computational science in the Petascale era.
About Australia Square Kilometre Array
The Australian SKA Pathfinder telescope (ASKAP), being developed by CSIRO, is made up of thirty six identical antennas, each twelve metres in diameter, working together as a single instrument. Incorporating novel receiver technologies and leading-edge ICT systems, ASKAP will be one of the world's premier radio telescopes. Technologies developed for ASKAP will be used in the further 64 dish antennas to form the basis of a 100-dish survey telescope to be built in SKA's first phase. The Murchison Widefield Array (MWA) will consist of 2048 dual-polarization dipole antennas optimized for the 80-300 MHz frequency range, arranged as 128 "tiles", each a 4x4 array of dipoles.
SGI, the trusted leader in technical computing, is focused on helping customers solve their most demanding business and technology challenges.
10/30/2013 | Cray, DDN, Mellanox, NetApp, ScaleMP, Supermicro, Xyratex | Creating data is easy… the challenge is getting it to the right place to make use of it. This paper discusses fresh solutions that can directly increase I/O efficiency, and the applications of these solutions to current, and new technology infrastructures.
10/01/2013 | IBM | A new trend is developing in the HPC space that is also affecting enterprise computing productivity with the arrival of “ultra-dense” hyper-scale servers.
Ken Claffey, SVP and General Manager at Xyratex, presents ClusterStor at the Vendor Showdown at ISC13 in Leipzig, Germany.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?