Use Globus for transferring data to and from OSG Connect and its storage
service Stash. For data to be used on the
OSG, move the data into your storage area on Stash. From the OSG Connect login
login.osgconnect.net, this appears as:
Transfer data between existing Globus endpoints
From the portal.osgconnect.net web site, click the Transfer ▸ Start Transfer menu.
On one side, enter
osgconnect#stashinto the endpoint field, and press "Return" or the "Go" button.
On the other side, enter the other endpoint from which you want to transfer data.
Browse the files and folders on the two endpoints to configure you transfer.
Optionally modify the advanced options below the two file browser panes.
Click on one of the arrows at the top to submit the transfer request: Go to the View Transfer window to see your transfer progress. Click on the progress bar to drill in on transfer details.
Transferring between your laptop and OSG Connect Stash
To add your own laptop as an endpoint, so that you can transfer data to/from stash, you need to install Globus Connect, by clicking on the "Get Globus Connect" in the upper right corner of the Start Transfer page. More detailed instructions for installing Globus Connect can be found here: https://www.globusonline.org/globus_connect/.
Adding a server as a Globus endpoint
To add your own server as an endpoint, so that any user on that server can transfer data to/from stash, you need to install Globus Connect Multiuser. Detailed instructions can be found here: https://www.globusonline.org/gcmu/.
Using the Globus Online Command Line Interface
You can also use the Globus Online CLI via ssh @cli.globusonline.org. More instructions on using the Globus Online CLI are here: https://www.globusonline.org/usingcli/.
Using the Globus CLI from login.osgconnect.net
When logging into
login.osgconnect.net, if you use the
flag, then you will be able to login from
cli.globusonline.org. This would be useful to run transfer
login.osgconnect.net. Check the Globus command line
interface from your terminal.
$ ssh -A email@example.com $ ssh firstname.lastname@example.org help Task Management: cancel modify details status events wait Task Creation: scp transfer rm delete File Management: ls rename mkdir Endpoint Management: endpoint-add acl-add endpoint-activate acl-list endpoint-deactivate acl-remove endpoint-list endpoint-modify endpoint-remove endpoint-rename Other: help profile history versions man
Now check the available endpoints:
$ ssh email@example.com endpoint-list ... username#desktop ... connect#stash ...
To activate the end points:
$ ssh firstname.lastname@example.org endpoint-activate \ username#desktop connect#stash
To copy a file from
$ ssh email@example.com scp \ connect#stash:/stash/user/username/public/file.txt \ username#desktop:/home/username/.
There are a few other quick start guides here: https://www.globusonline.org/quickstart/.
There's lots of good Globus Online material, including documentation, faqs, etc here: https://support.globusonline.org/forums
More instructions on using the Globus Online CLI are here: https://www.globusonline.org/usingcli/.
This page was updated on Nov 12, 2019 at 09:45 from start/data/data-transfer-with-globus.md.