HPC Storage (Shared & Dedicated)

Key Benefits

  • CIFS, NFS, SSH, & GridFTP Access
  • Available snapshots (included) and replication (optional) that meet institutional backup requirements
  • 1TB-300TB Shared or Dedicated Space
  • $80/TB/Year ($40/TB/Year if no backups are required)

Useful For

  • Researchers and research labs

HPC Storage Service Overview

What the Service is and what you get

The HPC Storage service offers three tiers of service.

Tier 1 – Public Shared Storage

Public shared storage such as scratch storage is provided on HPC systems at no charge. Public shared storage is subject to quotas or deletion of inactive files. Public shared storage is not backed up and is subject to variations in performance due to the shared nature of the resource.

Tier 2 – Shared Storage

Shared storage provides persistent data storage with flexible quotas and can be used to share data within a group. The system is still subject to some performance variation because it resides on a shared server. Space is available at $80/TB/Year with backups or $40/TB/Year without backups in increments of 1TB.

Connectivity into HPC is >1GB and connectivity to campus is >=1GB. Preferred access methods for migrating large volumes of data into the HPC environment is via the HPC "Data Mover" service using GridFTP into the host helium-data.hpc.uiowa.edu rather than other methods of access (CIFS or NFS directly into the shared storage service.)

Tier 3 – Dedicated Storage

Research groups may purchase a dedicated storage server from ITS and have it located with high performance computing resources and managed by ITS staff. This option provides dedicated I/O performance for data intensive jobs and helps isolate the group from performance impact caused by other users. Systems typically vary from 30-300TB in size and generally start at $10,000 without backups. Backups may go to the shared backup service or a dedicated backup server may also be purchased. At this time there is not a cost for colocation of approved servers with HPC resources.

To keep costs low commodity hardware is used in this service. This hardware does not include high availability features. The target service availability is 99.5% uptime but occasional scheduled or unscheduled outages may occur.

Access, Permissions, & Data Protection

At present access to this storage is available CIFS (Windows File Sharing), NFS, GridFTP, and scp/sftp. Data is also available on the Helium high performance computing cluster.

Permissions must be managed by ITS-Research Services at this time and may be restricted to relatively simple configurations to support the multiple access methods that are available.

Connectivity into HPC is >1GB and connectivity to campus is >=1GB. Preferred access methods for migrating large volumes of data into the HPC environment is via the HPC "Data Mover" service using GridFTP into the host helium-data.hpc.uiowa.edu rather than other methods of access (CIFS or NFS directly into the shared storage service.)

This service does not generally meet the requirements for the storage of highly sensitive information. If you plan to store sensitive information please contact us to discuss the best option.

Data protection is provided by user accessible snapshots and backups that are taken at hourly, nightly, and monthly intervals. Backups are optional but are highly recommended. The standard schedule is below but may be customized to meet the needs of the requestor.

Snapshots:

Hourly – Retaining the last twelve hourly snapshots

Daily – Retaining the last seven daily snapshots

Monthly – Retaining the last three monthly snapshots

 

Backups:

Daily – Retaining the last thirty daily backups

Monthly – Retaining the last three monthly backups

 

How to subscribe to the service

To request data storage space on this service please contact ITS - Research Services at research-storage@iowa.uiowa.edu or send a general inquiry to ITS at: its-helpdesk@uiowa.edu or call the ITS Help Desk at 319-384-HELP (4357).

 

 

 

Article number: 
100965
Last updated: 
May 19, 2016