Campus Compute Cooperative (CCC)

Welcome to the Campus Compute Cooperative.

Background: Universities struggle to provide both the quantity and diversity of compute resources that their researchers need when their researchers need them. Purchasing resources to meet peak demand for all resource types is cost prohibitive for all but a few institutions. Renting capacity on commercial clouds is seen as an alternative to owning. Commercial clouds though expect to be paid. The Campus Compute Cooperative (CCC) provides an alternative to purchasing capacity from commercial providers that provides increased value to member institutions at reduced cost. Member institutions trade their resources with one another to meet both local peak demand as well as provide access to resource types not available on the local campus that are available elsewhere. Only when CCC resources are completely exhausted and there is more high priority demand than supply are commercial clouds considered. The CCC builds upon the XSEDE Execution Management Services (EMS), the Global Federated File System (GFFS), and the Campus Bridging use cases.

Participating institutions have dual roles. First as consumers of resources as their researchers use CCC resources, and second as producers of resources as CCC users use their resources. In order to avoid the tragedy of the commons in which everyone only wants to use resources, when a member-owned resource is used the resource owner receives a credit and the consumer is charged based on the quality of service (high, medium, low) and the particulars of the resource provided (speed, interconnection network, memory, etc.). Account balances are cleared monthly.

The CCC currently consists of the University of Virginia and Indiana University. Other institutions and research labs are welcome to join.

Anyone faculty or researcher at a participating institution is invited to share resources of various types (compute resources, data resources, and group and identity resources). See here for more details on what kind of resources can be shared.

Start using the CCC.

1) The first step toward using the CCC is to get an identity that allows you to use CCC resources. To get an identity, or bind an existing identity such as an XSEDE identity to the CCC you should send email to your institutional representative with your name, email address, and department. For the University of Virginia email xcghelp@virginia.edu. For Indiana University email Rich Knepper, rknepper@iu.edu. If your institution is not part of the CCC and would like to become a member, email grimshaw@virginia.edu.

2) After receiving your identity, decide whether you want to install the client or server version of Genesis 2 (the client and server software that implements the GFFS).

Client Version
The client version allows you to access data and compute resources in the CCC. This includes the ability to define and execute jobs on the CCC job queues and share files via the GFFS. You may access remote resources even if you are behind a NAT or firewall, as long as you are able to make connections to the Internet.
Server Version
The server version allows you to share (export) compute and data resources that are located on your machine/server (without copying them to the cloud). However, you must be sure that your machine has a public IP address and, if there is a firewall, you must be able to open a port in the firewall. Additionally, you should be aware that when you export resources, any changes made to them via the GFFS are propagated to the original files in their original location.

3) Once you decide which version you want, proceed to the downloads page and select which version of Genesis 2 you want (client or server) and download the appropriate installer for your platform (Windows, Linux, Mac).

4) Install Genesis 2 on your machine. Genesis 2 can be installed via the command line or via the GUI installer.

Installation considerations and instructions

Help Resources

Running Jobs using CCC

Tutorials on YouTube

  1. Download and Install the GFFS Client (3:09)
  2. GUI Client Basics (8:28)
  3. Install a GFFS Container (21:37)
  4. Copy files in and out of the GFFS (28:37)
  5. Map the GFFS into your Linux file system using FUSE (9:39)
  6. Run a simple job with the GFFS (16:30)

Visit our YouTube Channel

Downloads

Campus Compute Cooperative (XSEDE) Installers

Citation

When using resources through CCC for your paper or presentation, please use the following citation as an acknowledgement. Thank you!

@inproceedings{grimshaw2016campus,

  title={Campus Compute Co-operative (CCC): A service oriented cloud federation},
  author={Grimshaw, Andrew and Prodhan, Md Anindya and Thomas, Alexander and Stewart, Craig and Knepper, Richard},
  booktitle={e-Science (e-Science), 2016 IEEE 12th International Conference on},
  pages={1--10},
  year={2016},
  organization={IEEE}

}