CIRCE

CIRCE is the "Central Instructional and Research Computing Environment”. CIRCE is USF's on-campus research cloud computing cluster. A computing cluster is set of connected computers that work together. USF's Research computing maintains the CIRCE cluster. We use CIRCE to gain access to over 422 nodes (computers used as a server) with over 8,400 processor cores to utilize processing power for our research. CIRCE uses a Lustre parallel file system for fast I/O, and InfiniBand for a computational interconnect.

Table of Contents

Why We Use CIRCE

We use CIRCE to schedule and run scripts, and to store data.

We deploy memory-intensive and time-dependent scripts that we would otherwise not run on our personal computers. These scripts include scheduled data collection procedures that run constantly during the collection stage, intermittent data cleaning procedures, and various forms of analysis (such as complex sentiment analysis, and OTHER EXAMPLES). CIRCE is capable of scheduling and deploying scripts written in various languages; these languages include R, Python, and BASH. When scheduling either a memory-intensive or time-dependent script, researchers must use BASH shell scripts to sent instructions to CIRCE. Requests are put into a queue and CIRCE executes those requests based on a first-come-first-serve basis.

CIRCE is also home to our data. We store our data in a shared drive on CIRCE, in which all members of the lab have authority to access. It contains our datasets and programming scripts.

Requesting Access

To request access, send an email from your official USF email address:

• TO: rc-help@usf.edu
• CC: Dr. Hagen
• SUBJECT: "CIRCE Account Request"
• BODY: Provide Dr. Hagen's name and email address.

Connection Methods

Once approved, you have many methods to connect with CIRCE. You can read about different methods to connect and access data here.

Linux -- Interactive Interface

If you have never remotely accessed another machine before, Research Computing recommends the free remote desktop called X2Go. It can be installed here. Instructions are located here. This linux-based remote desktop can run on Windows, MacOS, and Linux. It provides a virtual machine that runs on your computer where you can execute normal computer operations; these operations include using a file explorer, drag and drop, copy/paste, connecting to the internet with Firefox, and deploying programming scripts.

• Session Type: MATE 
• Host: circe.rc.usf.edu
• Login: Your USF NetID
• SSH Port: 22

FTP --  Move data to/from local machine to CIRCE

If you only need to move data to/from your local machine to CIRCE, an FTP client might be best.

SSH -- Terminal or CMD

If you need to schedule and run scripts and would prefer to not rely on a remote desktop application, using an SSH client might be best.

• The following information will be needed to connect via SSH:
• Credentials: Your USF NetID and Password
• Hostname: circe.rc.usf.edu
• SSH Port: 22 (This is the default)
• ie: ssh NetID@circe.rc.usf.edu

How to Use Storage on CIRCE

Once approved, you should gain access to at-least 2 partitions (home and work)

Home Directory (250 GB of storage):

1. Path: home/first_initial/first_initial_last_name
2. Example: home/d/ddyson

Work Directory  (2 TB of storage):

1. Path: work/first_initial/first_initial_last_name
2. Example: work/d/ddyson

Shares Directory (shared cluster): 

1. Path: shares_bgfs/si_twitter

How to Use Scripts on CIRCE

Running jobs:

There are many ways to run scripts with linux. Here we will discuss three methods.

First you will need to request resources. DO NOT RUN SCRIPTS WITHOUT REQUESTING RESOURCES.

Request resources:

1. Inside X2go: https://youtu.be/0Q-8QFKbKdA
2. SSH from terminal/cmd: https://youtu.be/g2ad1pbYk8s 

- SLURM

- Batch scripts

Related

• Research Computing
• CIRCE cluster

External Links

• Interconnect for OpenHigh-Performance Computing