Globus file transfer

Overview

Globus is a secure, reliable service for research data transfers that automates retries and enables high-performance movement of large datasets. On SeaWulf you create temporary personal endpoints rather than permanent ones.

Initial setup

1. Load the module.

   module load globus/3.15.0

2. Authenticate.

   globus login

   Select Stony Brook University in the browser, authenticate with NetID credentials, and paste the authorization code back into the terminal.

3. Create your personal endpoint.

   globus endpoint create --default-directory /gpfs/scratch/$USER/ --personal seawulf

   Retain the returned Endpoint ID and Setup Key.

4. Complete setup.

   globusconnectpersonal -setup SETUP_KEY

Working with the endpoint

# start (in the background, restricted to your directories)
globusconnectpersonal -start -restrict-paths rw/gpfs/scratch/$USER,rw/gpfs/home/$USER &

# verify
globus ls $ep1

# transfer a folder
globus transfer $ep1:/gpfs/scratch/$USER/myfolder $ep2:~/otherfolder --recursive --label "CLI single folder"

# status / stop
globusconnectpersonal -status
globusconnectpersonal -stop

Command reference