Using globus online to transfer files across UC Grid resources

Globus online is a software tool to transfer file across the world in a reliable, high-performance and secure way. In order to start using globus online with UC Grid resources, users of UC Grid need to sign up for an account with globus online through their web interface. Once you are signed up with globus online please follow the steps below to start using this service. The instructions below will help you transfer files between your desktop and UCLA's Hoffman2 cluster.

STEP I: Sign up for an account at globus online website

The sign up process requires a valid e-mail address. Choose an account name and password and wait for a confirmation e-mail from globus online.
At this stage you are actually ready to use globus online services (You may have to wait for few minutes to get your account provisioned across the system) . Hoffman2 endpoint is already available on Globus Online as ucla#grid4. You just need to execute next steps in order to make your desktop as one of the other end points.

STEP II: Download globusconnect software from globus online website

globusconnect is an executable that will run on Mac OS X, Linux or Windows. Download Globus Connect by going to the Dashboard (select ‘Dashboard’ in the ‘Go To’ drop down box in the top bar) and clicking on ‘Globus Connect’. Download the package and install on your local machine. On Linux machines you need to execute chmod +x globusconnect before running ./globusconnect.
On the same interface where you downloaded globusconnect, you need to generate an authentication key. You will also have to give a name to your desktop endpoint. If you call it simply desktop then it will be displayed as username#desktop in the File Transfer interface that will be explained in the next step.
Double click the globusconnect icon (Mac and Windows) or run globusconnect from command line (Linux). Very first time you do this, you will be asked to input the authentication key you just generated above.

STEP III: Transfer files using globus online

while globusconnect is running from above step on your desktop, click File Transfer on the globus online web site. Your web page will have a two columns display with drop down menus at the top to choose two end points. Now you already know one of the endpoints. Click the drop down menu and choose username#desktop. Your desktop home directory will be displayed shortly.
For UCLA's Hoffman2 cluster users we alreadiy created a public endpoint it is called ucla#grid4. From the dropdown menu for second column choose *ucla#grid4* from the alphabetical listing of all public end points. You can also type letters into the box to filter endpoints. In order to display your home directory on Hoffman2 cluster globus online needs to get a proxy (short lived credential) from you. So you need to provide your UC Grid username and UC Grid passphrase when an interface pop up. You can leave the rest of the fields blank. Just click Authenticate and in few minutes your home directory will be displayed. If you think your transfer will take longer than default 12 hours then you may also give a longer credential life time on the corresponding field.
You may select any number of files from left or right columns and click the middle arrow buttons to transfer your files back and forth. Just make sure you don't accidentally overwrite existing files during the transfer process.

Command line Instructions for transferring files

Sometimes if you have any non UTF-8 characters in your home directory web interface may have difficult time loading your home directory. If you need to transfer files on a command line terminal follow the instructions below
Login to your new account and from the top pull down menu which says Go To: choose My Account. This will display your account details. On the left cloumn choose Manage Identities
Choose Add SSH Public Key option. Cut and paste your desktop's ssh public keys on to the web and save it.
Additional help CLI web page

Instructions for UC Grid Appliance administrators to publish cluster end point

STEP I: Sign up for an account at globus online website

Preferably choose a username that will identify your cluster or campus name.
Login to your new account and from the top pull down menu which says Go To: choose My Account. This will display your account details. On the left cloumn choose Manage Identities
Choose Add SSH Public Key option. Cut and paste your desktop's ssh public keys on to the web and save it.

STEP II: ssh to the command line interface to globus online machine and add public end point.