January 18, 2011
According to an announcement today from the team behind NASA’s Nebula cloud, work is being done on “the development and implementation of the next major feature: the Nebula Object Store.” Object stores are web-based approaches to storing and retrieving data that has been created by applications that use object-oriented programming techniques.
NASA has announced that later this year Nebula users will have access to the Nebula Object Store, which his based on the OpenStack Swift project. The project is nearing beta stage and, as Devin C. Carlen of the Nebula team notes, users “should see the value and utility of object storage as they gain experience using it with their projects.”
Carlen also stated that “the Nebula Object Store is extremely scalable, allowing total storage capacity to be extended into the 100’s of petabytes (and beyond) if required—something that is not out of the realm of future possibilities given NASA’s rate of data and information generation.
The team notes that this is not block storage or volumes device and there is no concrete file system. The system uses containers and instead of requiring them to write everything to disk, users instead can input or output data in via HTTP.
One of the distinct advantages of this is that when compared to traditional block storage approaches, “object store offers the kind of scalability and flexibility NASA needs to manage its large collection of scientific data.”
Furthermore, it will be possible for users to store their files in hierarchical logical containers and will grant users minute control over access to both files and containers.
Full story at NASA
10/30/2013 | Cray, DDN, Mellanox, NetApp, ScaleMP, Supermicro, Xyratex | Creating data is easy… the challenge is getting it to the right place to make use of it. This paper discusses fresh solutions that can directly increase I/O efficiency, and the applications of these solutions to current, and new technology infrastructures.
10/01/2013 | IBM | A new trend is developing in the HPC space that is also affecting enterprise computing productivity with the arrival of “ultra-dense” hyper-scale servers.
Ken Claffey, SVP and General Manager at Xyratex, presents ClusterStor at the Vendor Showdown at ISC13 in Leipzig, Germany.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?