Globus: Automated Data Transfer

Overview

Globus is a file transfer service focused on large research data over high speed links. This article will give you the basics of a completing a transfer using the Globus web portal.

Globus repositories are called collections. Transfers between repositories run in the background so you don't need to stay logged into your computer.

There are collections to Unity, OSC, and OneDrive to name a small subset.

Contents

Setting up a Globus transfer via the web portal:

Globus is an automated parallel transfer application.  It is used worldwide in the research community for moving data from instruments, laptops, desktops, clusters, tapes and high performance storage arrays.  This article covers it's web interface.

Step 1: Sign Up and Log In

  1. Go to the Globus website: https://www.globus.org/
  2. Click on the "Log In" button, look up "Ohio State University".
  3. Sign in with OSU's Single Sign On (your name.# identity).
    • Note, if you previously used Globus with another login you can link it to your Ohio State University login.
    • When linked, both logins will be able to access the same Globus account permissions and history.
    • If you are a new user you will need to state you are an educational user and allow Globus permissions.

Step 2: File Manager

  1. After logging in, you'll be directed to the Globus dashboard.
  2. You will be dropped into the "File Manager" tab

Step 3: Configure Transfer

  1. In the File Manager configuration section:
    • In the Collections box select the source endpoint (where your data is located).
      • OSU-ASC-Project for Unity/ASC Project storage see end of article for Popular Collections
      • Depending on the collection you may be asked for additional permissions / login / access.
        • For example, OneDrive will require sign in to OSU's Microsoft 365 instance.
    • Select the files or directories you want to transfer.
      • Depending on the collection you may be asked for additional permissions / login / access.
    • On the left sidebar select Transfer or Sync to...
      • Select the destination collection (where you want to transfer your data).
        • If you want to transfer from your desktop/laptop download the Globus Connect Personal Connect application (Mac/Windows/Linux))
      • You can also use Panels in the upper right to see source, destination, or both.
    • Between the two Start buttons, set "Transfer & Timer Options", such as overwriting files or preserving timestamps, if desired.

Step 6: Review and Start Transfer

  1. Review the transfer details to ensure everything is set up correctly.
  2. Click "Start" to initiate the transfer.
  3. A green pop-up window will inform you your request is submitted.

Step 7: Monitor Transfer Progress

  1. After starting the transfer, click "View details" on the green pop-up window.
  2. Here, you can monitor the progress of your transfer, including transfer speed and completion percentage.

Step 8: Manage Transfers

  1. On the "Activity" tab, you can pause, cancel, or restart transfers if needed.
  2. Completed transfers will be listed as well.

Step 9: Notifications and Completion

  1. You can set up email notifications to receive updates about your transfers.
  2. Once the transfer is complete, you'll receive an email notification with status.

Popular Collections:

  • OSU-ASC-Project - ASCTech's project storage space used by Unity and also referred to as project storage.  This is the Dell Powerscale system with 25Gb interfaces on 10 storage nodes.
  • OSU-ASC-OneDrive-Collection - ASCTech's connection into Microsoft's OneDrive. Customers are encourage to zip or tar+zip files to this location. Larger files lead to MUCH better transfer rates. We are rate limited on the speed of transfers to this location
  • keithosu#Unity-Cluster - This is home directories for Unity. This will be deprecated by the end of September 2023.
  • OSC Globus Connect Server - Search for this to see many OSC filesystems which include $HOME, scratch, project and ess. See: https://www.osc.edu/resources/getting_started/howto/howto_use_globus_overview for more info on Globus and OSC.

Details

Article ID: 153647
Created
Mon 8/14/23 6:27 PM
Modified
Wed 8/16/23 3:59 PM