Globus1 is a service enabling file sharing with external collaborators without requiring them to have accounts on FAS Research Computing systems. A collaborator has to use their Globus service login and their Globus shared endpoint while FAS Research Computing user has to follow the steps described in this document to gain access to the Globus service.
Using Globus Service To Transfer Data In or Share Data Out
- Step 1
- Familiarize yourself with the Globus How To2 — documentation.
- Step 2
- Login into the Globus web interface3, selecting Harvard University as your organization which will allow you to log in using Harvard Key, and land on Transfer Files page.4
- Step 3
fasrc#transfer(aka FAS Research Computing Transfer) in the Endpoint field. Click on the continue button, type your FAS RC Username and your FAS RC Verification Code5 in the fields located on the FAS RC Client Authorization page.
- Note 1
- As soon as you connect to the fasrc#transfer endpoint using the Globus web interface, it will create your personal transfer folders inside the TRANSFER folders located in the
- Note 2
- The transfer folders can now be used to transfer files, either externally to/from outside collaborator’s using the Globus web interface, or internally by copying or moving files to/from your lab share using usual file transfer tools.
- Example 1
- To transfer files between the transfer folder and an external collaborator’s Globus shared endpoint, type the external collaborator’s shared endpoint name in the other Endpoint field on the Transfer Files page,4 select the files to transfer, specify the transfer settings and initiate the transfer by clicking on the large arrow button.6
- Example 2
- Share out a subfolder located in your transfer folder by creating a shared endpoint7 and authorizing external collaborator’s Globus account to access your shared endpoint. Let the collaborator know the shared endpoint’s name — the collaborator will then be able to initiate file transfers to/from your shared endpoint.
- Example 3
- To transfer files to/from a laptop or a desktop machine, set up a shared endpoint on it by installing Globus Connect Personal software8 and then connect to that shared endpoint the same way you would connect to an external collaborator’s shared endpoint — as described in the Example 1. Premium Globus account is not required to transfer files between an institutional (FAS RC) shared endpoint and the Globus Connect Personal software created endpoint.
Moving Data Between Lab Storage and Transfer Folders
Use 'datamover01' server to transfer data to or from /n/boslfs or /n/holylfs and your lab storage or home folders. If larger amount of data located on a lab storage server has to be transferred out — certainly more than 10T — or the data has to be shared out continuously, it is more efficient to send a request to FAS RC helpdesk to mount your lab storage on the transfer server to expose the TRANSFER folder located in your lab storage to the Globus interface. You will then have to create your personal shared folder inside the TRANSFER folder located on your lab storage which would then be used to transfer files out. The best practice would be to move your data into the
/n/our_lab/TRANSFER/$USER/ folder and then create a symlink which points to it.
$> cd /n/our_lab/Lab
$> mv datafolder/ ../TRANSFER/$USER/
$> ln -s ../TRANSFER/$USER/datafolder/
$> ls -l
$> lrwxrwxrwx 1 user group 0 Jan 01 12:00 datafolder -> ../TRANSFER/user/datafolder/
Sharing out, or transferring in large amounts of data regularly is a demanding task that would be best served by
/n/boslfs filesystems as they are significantly faster than other lab share storage. Please contact FAS RC to discuss possibility of having your lab storage moved or integrated into the
Please do not use your personal transfer folders located on
/n/holylfs or on
/n/boslfs as permanent storage without talking to FAS RC first.
- http://www.globus.org ↩
- http://docs.globus.org/how-to/get-started/ ↩
- http://globus.org/login ↩
- http://docs.globus.org/how-to/get-started/#the_transfer_files_page ↩ ↩
- FAS RC Verification Code is the OpenAuth token generated code associated with your FAS RC user account. The same token is also used as the second factor for FAS RC VPN and FAS RC login nodes authentication. ↩
- http://docs.globus.org/how-to/get-started/#request_a_data_transfer ↩
- http://docs.globus.org/how-to/share-files/ ↩
- http://www.globus.org/globus-connect-personal ↩
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. Permissions beyond the scope of this license may be available at Attribution.