Prototyping Innovative Data Storage

Storage Area Networks

• Department of Engineering Science Project
  This project was an outcome of a storage systems design project. Once the design phase was completed, this project attempted to implement the storage area network.

Distributed Data Storage

Distributed File Systems

Ceph

Ceph is a distributed file system designed for reliability, scalability, and performance. The storage system consists of some (potentially large) number of storage servers (bricks), a smaller set of metadata server daemons, and a few monitor daemons for managing cluster membership and state.

• System Installation
• Ceph Installation and Configuration
• Ceph Benchmark
• Ceph Research
• Ceph Tool

Experiments

• Initial System Configuration
• New System Configuration - SS vs LP
• Experiment with Ceph Performance

Augmentations

• Adding Tiering to Ceph

XtreemFS

XtreemFS is a distributed and replicated file system for the Internet. Distributed: Clients and servers can be distributed world-wide. XtreemFS allows you to mount and access your files via the internet from anywhere.

• XtreemFS Configuration
• XtreemFS Benchmark

With both Ceph and XtreemFS you can easily replicate your files across multiple devices this reducing network consumption and latency and increasing data availability.

Heterogenous Test System

• Building a Heterogenous Test System for Distributed Storage
  This work utilises the initial experimentation with distributed file systems to build a distributed file system on a storage network with heterogenous nodes.
• Visualising a Heterogenous Test System for Distributed Storage
  This work utilises BSOD from WAND to visualise a distributed file system in operation.
• Comparing Storage in OpenStack with Ceph
• Setting up VMs with Ceph
• Setting up VMs with OpenStack
• Setting up distributed storage with VMware

Test Installation

• Building a Test Installation with ITS
  This project describes a test installation performed at the ITS data center (at The University of Auckland).

Benchmarking

Benchmarking Tiering

• Benchmarking tiering options in Ceph
  This project describes benchmartking work to evaluate different tiering set-ups in Ceph.