HPC Storage (Shared & Dedicated)
HPC Storage Service Overview
What the Service is and what you get
The HPC Storage service offers three tiers of service.
Tier 1 – Public Shared Storage
Public shared storage such as scratch storage is provided on HPC systems at no charge. Public shared storage is subject to quotas or deletion of inactive files. Public shared storage is not backed up and is subject to variations in performance due to the shared nature of the resource. You can learn more about these storage options by visiting the HPC wiki.
Tier 2 – Shared Storage
Shared storage provides persistent data storage with flexible quotas and can be used to share data within a group. The system is still subject to some performance variation because it resides on a shared server. Space is available at $80/TB/Year with backups or $40/TB/Year without backups in increments of 1TB.
Connectivity into HPC is >1GB and connectivity to campus is >=1GB. Preferred access methods for migrating large volumes of data into the HPC environment is via the HPC "Data Mover" service using GridFTP into the host data.hpc.uiowa.edu rather than other methods of access (CIFS or NFS directly into the shared storage service.)
Tier 3 – Dedicated Storage
Research groups may purchase a dedicated storage server from ITS and have it located with high performance computing resources and managed by ITS staff. This option provides dedicated I/O performance for data intensive jobs and helps isolate the group from performance impact caused by other users. Systems typically vary from 30-300TB in size and generally start at $10,000 without backups. Backups may go to the shared backup service or a dedicated backup server may also be purchased. At this time there is not a cost for colocation of approved servers with HPC resources.
To keep costs low commodity hardware is used in this service. This hardware does not include high availability features. The target service availability is 99.5% uptime but occasional scheduled or unscheduled outages may occur.
Access, Permissions, & Data Protection
At present access to this storage is available CIFS (Windows File Sharing), NFS, GridFTP, and scp/sftp. Data is also available on the Helium high performance computing cluster.
Permissions must be managed by ITS-Research Services at this time and may be restricted to relatively simple configurations to support the multiple access methods that are available.
Connectivity into HPC is >1GB and connectivity to campus is >=1GB. Preferred access methods for migrating large volumes of data into the HPC environment is via the HPC "Data Mover" service using GridFTP into the host helium-data.hpc.uiowa.edu rather than other methods of access (CIFS or NFS directly into the shared storage service.)
This service does not generally meet the requirements for the storage of highly sensitive information. If you plan to store sensitive information please contact us to discuss the best option.
Data protection is provided by user accessible snapshots and backups that are taken at hourly, nightly, and monthly intervals. Backups are optional but are highly recommended. The standard schedule is below but may be customized to meet the needs of the requestor.
Hourly – Retaining the last twelve hourly snapshots
Daily – Retaining the last seven daily snapshots
Monthly – Retaining the last three monthly snapshots
Daily – Retaining the last thirty daily backups
Monthly – Retaining the last three monthly backups
How to subscribe to the service
To request data storage space on this service please contact ITS - Research Services at firstname.lastname@example.org or send a general inquiry to ITS at: email@example.com or call the ITS Help Desk at 319-384-HELP (4357).