ARCC S3
ARCC's S3 storage service is a low-cost, expandable storage solution that enables a cloud-like presence for research data hosted by ARCC. Its core functionality is hosting onsite backups as well as enabling data sharing and collaboration. If you want to make data, reports, etc available to external-to-UWyo collaborators, S3 is a tool you can use.
S3 uses the Simple Storage Service (S3) protocol originally developed by Amazon. S3 works on object storage through a service called Ceph, provided by Red Hat Enterprise Linux.
S3 does not handle files like Windows or traditional storage systems. S3 uses treats folder and files as buckets and objects. Instead of a file path, S3 buckets are accessed via a URL, and instead of usernames and passwords, Pathfinder uses access keys and secret keys. These characteristics make S3 uniquely suited to providing a cloud-like data repository.
Use Cases
On-premise, ARCC managed backup target for other ARCC services such as Alcova.
S3 itself is not backed up
Web-enabled S3 buckets for data storage, data transfer, etc.
Time-based token-authenticated links for file sharing. The S3 protocol allows users to make data publicly available with a tokenized link that will expire after a specified time-frame.
Publication of research data in partnership with UW Libraries.
Cost
The charges for using S3 is based on actual hardware costs and does not include personnel or infrastructure (network/datacenter) costs. Those costs have been subsidized by ARCC and the Office of Research and Economic Development. See the ARCC Cost Policies for current rates.
Requesting Access
To request access to S3 and receive an Accesskey/Secretkey combo, please fill out the request a new research project form.
Maintenance Policy
To apply critical security updates and new feature releases, S3 may undergo ad-hoc maintenance. Most often, maintenance occurs in the background with no user impact. If a major upgrade or other significant maintenance is to occur, user’s will be notified one week in advance via email. In general, Pathfinder adheres to the upstream Ceph project upgrade schedule, with a maximum of 24 months between major upgrades.
-
Getting Started on S3
Learn how to get started with ARCC's S3 service, including creating buckets, uploading and downloading data, and managing access permissions.
-
Connecting to S3
Learn how to connect to ARCC's S3 service using various clients and programming packages.