#

Storage

Mounting Storage on Desktop or Laptop

(Short link) In addition to connecting to Odyssey servers and launching compute jobs, many scientists use Odyssey file systems for storage of lab data. Many, but not all, file systems can be mounted on your desktop to simplify data transfer. Odyssey file systems which are available to be mounted are shared via the Windows SMB protocol so this process is…

Policy: regal scratch

REGAL SCRATCH RC maintains a large, shared temporary scratch filesystem for general use for high input/output jobs at /n/regal. This workspace is made available with the provisions that each group use no more than 50TB, and that files older than 90 days will be deleted through a periodic purge process. This purge can run at any time, especially if Regal…

Globus File Transfer

Globus1 is a service enabling file sharing with external collaborators without requiring them to have accounts on FAS Research Computing systems. A collaborator has to use their Globus service login and their Globus shared endpoint while FAS Research Computing user has to follow the steps described in this document to gain access to the Globus service. Using Globus Service To…

Transferring files to DATA.RC

Users of the data.rc.fas.harvard.edu server have three options for doing so. Please note that if you choose option 2, the settings for FTP/S are not the same as for regular SFTP settings you might use to transfer files to other servers. The connection methods in order of preference: Via Web browser - This is the default means of accessing data.rc…

SFTP file transfer using Filezilla – Filtering

There may be times when you wish to filter the file listing in the local or remote pane. If you need to do this often, you may want to set up a filter. Unlike the search feature (binoculars icon), filters modify what is shown in the Remote Site: or Local Site: pane. If you simply need to see files grouped together…

SFTP file transfer using Filezilla (Mac/Windows/Linux)

Filezilla is a free and open source SFTP client which is built on modern standards. It is available cross-platform (Mac, Windows and Linux) and is actively maintained. As such Research Computing is recommending its use over previous clients, especially as it does not have some of the quirks of clients like Cyberduck or SecureFX. This document will outline setting up a…

Odyssey storage

Research Computing maintains multiple petabytes of storage in association with the Odyssey cluster. This storage is not uniform, however, and each class of storage is designed and maintained with different purposes in mind. This page describes cluster storage in detail as a guide for day-to-day usage. Please see the terminology section at the end of this document for clarification on…

Hardware, Software, and Storage Purchasing

Research Computing can provide faculty and other research staff with assistance in purchasing hardware and software that fit special computing needs. From storage equipment purchases to licenses for software packages, Research Computing can help facilitate the transaction with the vendor, and assist with installation and set-up. Research Computing offers various storage arrays which can be customized to satisfy unique needs. For a more in-depth overview of…

Copying Data to & from Odyssey using SCP or SFTP

SCP (Secure Copy) From/To Odyssey We generally recommend using SCP to copy data to and from Odyssey. It is available across the cluster (login nodes, interactive sessions, NoMachine or batch jobs). It's usage is simple, but the order that file locations are specified is crucial. SCP always expects the 'from' location first, then the 'to' destination. Depending on which is…