GFFSRequirements

GFFS Client Requirements

  1. To install client on your machine, you should download appropriate client software from xsede.org. Steps to install client
  2. Should have atlaeat 2GB memory on the client machine

After installing the client

  • User should be able to run basic grid commands like 'grid ls /'

To mount grid name space on to local file system (only on linux, unix operating systems)

  • user should have fuse module installed on your machine

GFFS Server/container Requirements

General requirements

For sharing data

  1. The servers must have publicly accessible IP address.
  2. At least 2 GB of memory free.
  3. Local attached storage for our relational database (includes accounting records) of at least 20 GB, ideally 100 GB. We have found databases do not do well over networked file systems.
  4. An inbound open port, ideally 18443
  5. Ability to open outbound https (TCP/TLS) connections.
  6. XSEDE approved IGFT server certificate or IGFT server certificate issued by your institution. If your server's hostname ends with xsede.org (ex. mason.iu.xsede.org) you can request IGTF host certificate from xsede.org. Here's the link for requesting certificates from xsede.

For sharing compute resources, all of the above plus following

  1. At least one, and ideally two NON-PRIVILEDGED user accounts, e.g., gffs-user and gffs-run.
  2. The ability to sudo from gffs-user to gffs-run for three commands, qsub, qstat, qdel or their basic equivalent (For providing EMS/Compute service)
  3. A file system shared between the "head" node and the compute nodes

To run GFFS server/container for data sharing

NOTE: Since the xsede grid's central containers are still running on SDIACT-126 version, it is important to install SDIACT-126 container version first and then upgrade that container to SDIACT-149 version.

  1. You should have a XSEDE GFFS container installed and running on a machine from where you would like to share data. Steps to install container
  2. This container should have access tot he File system/directory that you want to share with other users on XSEDE grid

Once you have container running

  • Link the container to XSEDE grid name space using grid ln command
ex. grid ln https://myhost.uva.edu:18443/axis/services/VCGRContainerPortType /home/xsede.org/joe/my-container
  • To share/export your local directory /home/joe/shared-dir with other grid users, you will need to export that directory to Grid name space using grid export command
ex. grid export --create /home/xsede.org/joe/my-container local:/home/joe/shared-dir /home/xsede.org/joe/shared-dir

This will create an export in grid /home/xsede.org/joe/shared-dir i.e you will be able to access your local files in grid name space.

  • Set acls on local File system/directory that you want to share
ex. set_acls.sh jan /home/joe rx
set_acls.sh -R jan /home/joe/shared-dir rwx

Here 'jan' is the user that is running the local GFFS container. First command gives access to home (/home/joe) and second commands recursively gives rwx access to "shared-dir" which will allow grid user 'jan' (in turn container) to read/write to /home/joe/shared-dir directory.

  • Allow other grid users to access your export using grid chmond command
ex. grid chmod /home/xsede.org/joe/shared-dir +rwx /users/xsede.org/mary
You can also do this using client GUI, click here for more information on how to use client GUI.

Grid user 'mary' will be able to read/write/execute contents of /home/xsede.org/joe/shared-dir i.e files on your local file system /home/joe/shared-dir