Introduction to CARC
The information on this page is designed to provide an introductory overview for new CARC users. Links to more detailed information and complete user guides can be found at the end of each section of this page.
Introduction to CARC systems
Discovery is a high-performance computing cluster, which is a collection of computers and disk arrays that are connected via fast networks. Discovery allows USC researchers to perform computing tasks, like data analyses and simulations, on a larger scale than is possible with a laptop or lab computer. The Discovery cluster is CARC's public cluster; any CARC user can use Discovery.
The following graphic depicts CARC's cyberinfrastructure and how different systems interact with one another:
For detailed information on the Discovery cluster, see our Getting Started with Discovery user guide.
Endeavour condo cluster
Endeavour is a high-performance computing cluster like Discovery, but Endeavour comprises resources that Condo Cluster Program (CCP) users lease or subscribe to, with each research group's resources dedicated for their use only. For more information on the CCP, see the Condo Cluster Program pages. For detailed information on the Endeavour cluster, see our Getting Started with Endeavour user guide
Storage file systems
All CARC account holders are assigned three directories where they can store files and run programs. Each of these three directories is located in the home, project, and scratch file systems.
Each file system serves a different purpose:
/home1 is a network file system for storing configuration files and personal scripts. Each CARC user has a 100 GB home directory quota.
/project: Assignment to a project gives you access to a subdirectory of the /project parallel file system. Managed by a Principal Investigator, this is where you have access to a maximum of 10 TB of storage space (shared among the project's members), and where you can collaborate and share files with your research group. Use this high-performance file system for most of your research computing work at CARC. If more than 10 TB of storage is needed, it can be purchased in 5 TB increments for $40/TB/year. See the Accounts and Allocations page for more information.
/scratch1 and /scratch2 are two parallel file systems that are shared among all CARC users. These file systems can be used for storing data temporarily and running I/O intensive jobs. Each CARC user receives a 10 TB quota for /scratch1 and a 10 TB quota for /scratch2.
For detailed information on the different storage systems available, see our Storage File Systems user guide.
Accessing CARC systems
All USC students, staff, and faculty have access to CARC's systems for their research projects. In order to access CARC's systems, you must either be the Principal Investigator (PI) of a research project or an authorized member of a PI's research project.
CARC resources are accessible only through USC's network, either via direct connection or a USC Virtual Private Network (VPN) with the USC Cisco AnyConnect Secure Mobility Client.
There are several benefits to this:
- increased security
- internet access from the compute nodes
- easer connection through the terminal
Duo two-factor authentication is required to access USC VPNs. If you have not already signed up for Duo on your USC NetID account, please visit this page to enroll.
Note: Your USC NetID is the first part of your USC email address (e.g., firstname.lastname@example.org's NetID is ttrojan).
Please note that USC ITS provides support for Cisco AnyConnect Secure Mobility Client. If you are experiencing connectivity issues, please contact them here.
Currently, CARC systems do not support the use or storage of sensitive data. If your research work includes sensitive data, including but not limited to HIPAA-, FERPA-, or CUI-regulated data, see our Secure Computing user guides or contact us at email@example.com before using our systems.
Access to and use of resources is based on participation in projects. Project setup and resource allocation requests must be made by a project's PI using the CARC User Portal.
For more information on accounts, see our Accounts and Allocations page.
How to use the systems
When using CARC systems, you will notice several differences from your desktop or laptop environment:
- The interface is command-line driven (no graphical user interface)
- The systems use the CentOS Linux operating system (not macOS or Windows)
- You submit your programs to a remote batch processing system, or job scheduler, to run them
CARC has prepared user guides specific to its systems in the following categories:
How to log in to Discovery and Endeavour and run jobs.
Data Management and File Transfers
An overview of the different storage directories available to you, and instructions on transferring files between your personal computer and CARC systems.
Software and Programming
Information on the software available on CARC systems, as well as instructions for installing your own software.
CARC User Portal
How to create and manage your projects and resource allocations.
Our main user guides page can be accessed here.
Resources for deeper learning
Each month, CARC's Research Facilitation & Applications team offers a number of free workshops designed to introduce users to the computing cluster and its features. The team is frequently developing new workshops, including workshops on useful software and programming languages.
All workshops are approximately two hours in length and are offered several times a year.
For information on the different workshops that CARC's Research Facilitation & Applications team offers on a rotating basis, see our Workshops page. For a schedule of upcoming workshops, see our Events page.
External tools and resources
If you want to improve your overall understanding of research computing, CARC has compiled a list of external resources that may be helpful for learning about research computing, programming languages, and software used by CARC systems.
You can view our External Tools and Resources page here.
How to get help
Weekly office hours
Every week, the Research Facilitation & Applications team hosts office hours for CARC users to ask questions about anything related to research computing. No appointments are necessary, and all levels of users and questions are welcomed. Currently, all office hours are taking place via Zoom every Tuesday from 2:30-5:00 pm. Office hours are drop-in and do not require registration, but you will need a USC NetID to join the Zoom meeting.
For more information, see our Office Hours and Consultations page.
Frequently asked questions
See our extensive Frequently Asked Questions page for answers to common questions about CARC accounts, different cluster resources, and using software on CARC systems.
Discourse user forum
CARC uses Discourse, a question-and-answer community forum, to facilitate discussion and knowledge sharing among users. The User Forum is a great resource for discussing CARC-related topics, asking non-urgent technical questions, and sharing ideas. The CARC team monitors the forum for questions, but users are also encouraged to interact with each other.
You can access the CARC's User Forum here.
If you're experiencing an issue with system resources or your CARC account and you're unable to find a solution to your problem using the above resources, please submit a help ticket to the CARC team.