Globus File Transfer

Globus1 is a service enabling file sharing with external collaborators without requiring them to have accounts on FAS Research Computing systems. A collaborator has to use their Globus service login and their Globus shared endpoint while FAS Research Computing user has to follow the steps described in this document to gain access to the Globus service. Using Globus Service To…

Transferring files to DATA.RC

Users of the data.rc.fas.harvard.edu server have three options for doing so. Please note that if you choose option 2, the settings for FTP/S are not the same as for regular SFTP settings you might use to transfer files to other servers. The connection methods in order of preference: Via Web browser - This is the default means of accessing data.rc…

Policy: regal scratch

REGAL SCRATCH RC maintains a large, shared temporary scratch filesystem for general use for high input/output jobs at /n/regal. This workspace is made available with the provisions that each group use no more than 50TB, and that files older than 90 days will be deleted through a periodic purge process (generally during our maintenance period, but also any time the…

SFTP file transfer using Filezilla – Filtering

There may be times when you wish to filter the file listing in the local or remote pane. If you need to do this often, you may want to set up a filter. Unlike the search feature (binoculars icon), filters modify what is shown in the Remote Site: or Local Site: pane. If you simply need to see files grouped together…

SFTP file transfer using Filezilla (Mac/Windows/Linux)

Filezilla is a free and open source SFTP client which is built on modern standards. It is available cross-platform (Mac, Windows and Linux) and is actively maintained. As such Research Computing is recommending its use over previous clients, especially as it does not have some of the quirks of clients like Cyberduck or SecureFX. This document will outline setting up a…

Hardware, Software, and Storage Purchasing

Research Computing can provide faculty and other research staff with assistance in purchasing hardware and software that fit special computing needs. From storage equipment purchases to licenses for software packages, Research Computing can help facilitate the transaction with the vendor, and assist with installation and set-up. Research Computing offers various storage arrays which can be customized to satisfy unique needs. For a more in-depth overview of…

MassSpec Directory Structure

1. c:\MassSpec\Microchem_PBS_storage

Link to the original Microchem group storage on old EMC.

May be helpful to manually copy files back and forth, however apps on Windows HPC may not be able to read data from this location due current permission/authentication problems. Plus, it would be slower for apps to process data stored here.

This storage will eventually go away anyway -- currently scheduled for October 2010.

2. c:\MassSpec\Microchem2

Link to the NEW Microchem group storage on new EMC.

Continue reading

Copying Data to & from Odyssey using SCP or SFTP

SCP (Secure Copy) From/To Odyssey We generally recommend using SCP to copy data to and from Odyssey. It is available across the cluster (login nodes, interactive sessions, NoMachine or batch jobs). It's usage is simple, but the order that file locations are specified is crucial. SCP always expects the 'from' location first, then the 'to' destination. Depending on which is…