IU-BigRed2-Mason

Main.IU-BigRed2-Mason History

Hide minor edits - Show changes to markup

Changed line 67 from:
ex. bash ~grimshaw/set_acls.sh gffs-user /N/u/xd-agrimshaw/Mason rx
to:
step1. bash /N/u/xd-agrimshaw/set_acls.sh gffs-user /N/u/xd-agrimshaw/Mason rx
Changed line 70 from:
ex. bash ~grimshaw/set_acls.sh -R gffs-user /home1/01264/grimshaw/shared-dir rwx
to:
step2. bash /N/u/xd-agrimshaw/set_acls.sh -R gffs-user /home1/01264/grimshaw/shared-dir rwx
July 24, 2015, at 01:16 PM by 128.143.63.67 -
Changed lines 66-70 from:

ex. bash ~grimshaw/set_acls.sh gffs-user /N/u/xd-agrimshaw/Mason rx The above command gives user 'gffs-user' permissions to read user 'grimshaw''s home directory on Mason. gffs-user is the user running GenesisII GFFS container on Mason. When user shares data, it it important to give atleast read access to all the directories upto (and including) the directory to be shared. ex. bash ~grimshaw/set_acls.sh -R gffs-user /home1/01264/grimshaw/shared-dir rwx The above command give user 'gffs-user' permissions to read/write/execute recursively on user 'grimshaw''s shared-dir on Mason

to:
ex. bash ~grimshaw/set_acls.sh gffs-user /N/u/xd-agrimshaw/Mason rx
The above command gives user 'gffs-user' permissions to read user 'grimshaw''s home directory on Mason. gffs-user is the user running GenesisII GFFS container on Mason. When user shares data, it it important to give atleast read access to all the directories upto (and including) the directory to be shared.
ex. bash ~grimshaw/set_acls.sh -R gffs-user /home1/01264/grimshaw/shared-dir rwx
The above command give user 'gffs-user' permissions to read/write/execute recursively on user 'grimshaw''s shared-dir on Mason
Added line 76:
Changed lines 80-82 from:

ex. grid export --create /resources/xsede.org/maosn.iu.xsede.org/containers/mason-gffs local:/N/u/xd-agrimshaw/Mason/shared-dir /home/xsede.org/grimshaw/mason-shared-dir This command creates a export in grid namespace, /home/xsede.org/grimshaw/mason-shared-dir.

to:
ex. grid export --create /resources/xsede.org/maosn.iu.xsede.org/containers/mason-gffs local:/N/u/xd-agrimshaw/Mason/shared-dir /home/xsede.org/grimshaw/mason-shared-dir
This command creates a export in grid namespace, /home/xsede.org/grimshaw/mason-shared-dir.
Changed lines 85-86 from:

ex. grid chmod /home/xsede.org/grimshaw/mason-shared-dir +rwx /users/xsede.org/vana Here, xsede grid user 'grimshaw' shared /home/xsede.org/grimshaw/mason-shared-dir with xsede grid user 'vana'. Now xsede user 'vana' will be able to directly read/write/execute files in user 'grimshaw''s Mason home directory /N/u/xd-agrimshaw/Mason/shared-dir.

to:
ex. grid chmod /home/xsede.org/grimshaw/mason-shared-dir +rwx /users/xsede.org/vana
Here, xsede grid user 'grimshaw' shared /home/xsede.org/grimshaw/mason-shared-dir with xsede grid user 'vana'. Now xsede user 'vana' will be able to directly read/write/execute files in user 'grimshaw''s Mason home directory /N/u/xd-agrimshaw/Mason/shared-dir.
July 24, 2015, at 12:11 PM by 128.143.63.67 -
Changed line 63 from:

1. Send email to bret@iu.edu asking to give rx (read and execute) permissions to xsede-user (your xsede portal-id) on Mason GenesisII LighWeightExportPortType. Due to center policies, Bret Hammond at IU maintains the GFFS container and only he can give permissions to xsede-user to create exports on that container.

to:

1. Send email to bret@iu.edu asking to give rwx (read, write and execute) permissions to xsede-user (your xsede portal-id) on Mason GenesisII LighWeightExportPortType. Due to center policies, Bret Hammond at IU maintains the GFFS container and only he can give permissions to xsede-user to create exports on that container.

July 24, 2015, at 12:09 PM by 128.143.63.67 -
Added lines 56-82:

Data sharing on IU Mason

To share your Mason data with XSEDE grid users

1. Send email to bret@iu.edu asking to give rx (read and execute) permissions to xsede-user (your xsede portal-id) on Mason GenesisII LighWeightExportPortType. Due to center policies, Bret Hammond at IU maintains the GFFS container and only he can give permissions to xsede-user to create exports on that container.

2. Run set_acls.sh script (located in ~grimshaw/set_acls.sh) allowing the user that runs GenesisII container access to your data ex. bash ~grimshaw/set_acls.sh gffs-user /N/u/xd-agrimshaw/Mason rx The above command gives user 'gffs-user' permissions to read user 'grimshaw''s home directory on Mason. gffs-user is the user running GenesisII GFFS container on Mason. When user shares data, it it important to give atleast read access to all the directories upto (and including) the directory to be shared. ex. bash ~grimshaw/set_acls.sh -R gffs-user /home1/01264/grimshaw/shared-dir rwx The above command give user 'gffs-user' permissions to read/write/execute recursively on user 'grimshaw''s shared-dir on Mason

3. Install xsede grid client on your desktop/laptop. If you have already installed the client, skip to Step3.

4. On your grid client, login to xsede grid using your xsede credentials ex. grid xsedeLogin --username=<xsede-portal-id>

5. Run grid export create command to share your Mason data on grid ex. grid export --create /resources/xsede.org/maosn.iu.xsede.org/containers/mason-gffs local:/N/u/xd-agrimshaw/Mason/shared-dir /home/xsede.org/grimshaw/mason-shared-dir This command creates a export in grid namespace, /home/xsede.org/grimshaw/mason-shared-dir.

6. To share your export with other xsede users, give appropriate permissions to access the shared directory ex. grid chmod /home/xsede.org/grimshaw/mason-shared-dir +rwx /users/xsede.org/vana Here, xsede grid user 'grimshaw' shared /home/xsede.org/grimshaw/mason-shared-dir with xsede grid user 'vana'. Now xsede user 'vana' will be able to directly read/write/execute files in user 'grimshaw''s Mason home directory /N/u/xd-agrimshaw/Mason/shared-dir.

July 21, 2015, at 02:34 PM by 128.143.63.67 -
Changed line 5 from:

To submit bacth jobs, use this resource in grid name space

to:

To submit bacth jobs on BigRed2, use this path in grid name space

Changed line 8 from:

To run MPI jobs (openMPI), use this resource in grid name space

to:

To submit MPI jobs (openMPI) on BigRed2, use this path in grid name space

Changed line 16 from:

To submit bacth jobs, use this resource in grid name space

to:

To submit bacth jobs on Mason, use this path in grid name space

Added lines 19-20:

Added lines 38-39:

July 21, 2015, at 02:33 PM by 128.143.63.67 -
Added line 44:
Changed lines 47-52 from:

grid:\$> xsedeLogin

  • Username *

Hint: You may enter "Cancel" to cancel this selection. Please enter username:

to:

grid:\$> xsedeLogin --username=<XUP-username>

July 21, 2015, at 02:31 PM by 128.143.63.67 -
Changed line 44 from:
to:
Added line 55:
July 21, 2015, at 02:31 PM by 128.143.63.67 -
Added lines 36-54:

GenesisII client on Mason

GFFS at XSEDE is currently available on the Mason cluster and can be loaded using the standard Modules environment manager commands:

login1$ module load genesis-ii

Use your XSEDE User Portal (XUP) username/password to authenticate with the GFFS GIU servers and the XSEDE grid. Here's a command line example on the Mason cluster:

login1$ grid grid:\$> xsedeLogin

  • Username *

Hint: You may enter "Cancel" to cancel this selection. Please enter username: Password for : Replacing client tool identity with credentials for "CN=......, O=National Center for Supercomputing Applications, C=US". grid:\$>

July 21, 2015, at 02:25 PM by 128.143.63.67 -
Changed lines 31-35 from:

You can also submit jobs to grid queue, submitting to queues is recommended since it allows better resource allocation and job handling. We recommend using Campus bridging queue located /resources/xsede.org/queues/CBQueue in the grid name space. For more information on how to submit jobs to queue, click here

to:

You can also submit jobs to grid queue, submitting to queues is recommended since it allows better resource allocation and job handling.

We recommend using Campus bridging queue located /resources/xsede.org/queues/CBQueue in the grid name space.

For more information on how to submit jobs to queue, click here

July 21, 2015, at 02:24 PM by 128.143.63.67 -
Changed lines 1-2 from:

IU BigRed2

to:

IU BigRed2

Changed lines 5-7 from:

IU Mason

to:

To submit bacth jobs, use this resource in grid name space

/resources/xsede.org/bigred2.iu.xsede.org/bes-containers/pbs-sudo-bigred2

To run MPI jobs (openMPI), use this resource in grid name space

/resources/xsede.org/bigred2.iu.xsede.org/bes-containers/pbs-sudo-mpi-bigred2
Make sure your MPI code was compiled on Bigred2.

IU Mason

Added lines 16-31:

To submit bacth jobs, use this resource in grid name space

/resources/xsede.org/mason.iu.xsede.org/bes-containers/mason-u6-bes

Job submission via BES

To submit jobs to BES resource

  1. User should have installed client on your desktop/laptop.
  2. Login to grid with your xsede credentials and create job JSDL file. For more information on how to create JSDL file, click here
  3. Use grid run command to run your job
ex. grid run /resources/xsede.org/bigred2.iu.xsede.org/bes-containers/pbs-sudo-bigred2 --jsdl=local:<path-to-jsdl-file>

Job Submission via Grid Queue

You can also submit jobs to grid queue, submitting to queues is recommended since it allows better resource allocation and job handling. We recommend using Campus bridging queue located /resources/xsede.org/queues/CBQueue in the grid name space. For more information on how to submit jobs to queue, click here

July 20, 2015, at 01:47 PM by 128.143.63.67 -
Added lines 1-9:

IU BigRed2

On BigRed2, we are running GenesisII BES service which interacts with BigRed2 compute resources to run grid users jobs. Users can run either batch jobs or MPI jobs on BigRed2.

IU Mason

On BigRed2, we are running Unicore6 BES service which interacts with Mason compute resources to run grid users jobs. Users can run batch jobs Mason.