Why We Use CIRCEWe utilize the processing out of CIRCE to store data, run memory-intensive scripts, and schedule scripts to be ran automatically.
We deploy memory-intensive and time-dependent scripts that we would otherwise not run on our personal computers. These scripts include automatic data collection scripts, intermittent data cleaning procedures, and various forms of analysis (such as complex sentiment analysis, and OTHER EXAMPLES). CIRCE is capable of scheduling and deploying scripts written in various languages; these languages include R, Python, and BASH. When scheduling either a memory-intensive or time-dependent script, researchers must use BASH shell scripts to send scheduling instructions to Research Computing. Requests are put into a queue and the CIRCE Cluster executes those requests on a first-come-first-serve basis.
CIRCE is also home to our data, which is stored in a shared folder. After an approval process, all lab members have the authority to access this data. The shared folder contains our datasets and programming scripts.
Requesting AccessTo request access, send an email from your official USF email address:
Connection MethodsOnce approved, you have many methods to connect with CIRCE. You can read about different methods to connect and access data here. Linux -- Interactive Interface
If you have never remotely accessed another machine before, Research Computing recommends the free remote desktop called X2Go. It can be installed here. Instructions are located here. This linux-based remote desktop can run on Windows, MacOS, and Linux. It provides a virtual machine that runs on your computer where you can execute normal computer operations; these operations include using a file explorer, drag and drop, copy/paste, connecting to the internet with Firefox, and deploying programming scripts.
FTP -- Move data to/from local machine to CIRCEIf you only need to move data to/from your local machine to CIRCE, an FTP client might be best. SSH -- Terminal or CMDIf you need to schedule and run scripts and would prefer to not rely on a remote desktop application, using an SSH client might be best.
How to Use Storage on CIRCEOnce approved, you should gain access to at-least 2 partitions (home and work)
Home Directory (250 GB of storage):
Work Directory (2 TB of storage):
Shares Directory (shared cluster):
How to Use Scripts on CIRCERunning jobs:There are many ways to run scripts with linux. Here we will discuss three methods.
First you will need to request resources. DO NOT RUN SCRIPTS WITHOUT REQUESTING RESOURCES.
Request resources:
- SLURM
- Batch scripts
Related
External Links
|
|
Comments (0)
You don't have permission to comment on this page.