The information on this page is designed to provide an introductory overview for new CARC users. Links to more detailed information and complete user guides can be found at the end of each section of this page.
What is the Center for Advanced Research Computing?
USC's Center for Advanced Research Computing (CARC) provides advanced computational research support to USC faculty and students. When the needs of researchers exceed the capabilities of a personal computer, the CARC offers its support. Examples of services offered include high-performance computing, data storage and analysis, cloud computing, secure computing for sensitive data, research computing workshops, and customized research partnerships.
Currently, the CARC supports more than 100 research groups across a variety of disciplines in the USC community.
What is high-performance computing?
High-performance computing aggregates the resources from individual computers (known as nodes) into a cluster that works together to perform advanced, specialized computing jobs. Many academic fields, including epigenetics, geophysics, materials science, engineering, natural language translation, and health sciences, utilize high-performance computing to advance their research beyond what would be possible with a personal computer.
As the amount of data used in research continues to grow with the popularity of such technologies as artificial intelligence (AI) and advanced data analysis, high-performance computing is becoming increasingly necessary for technological advancement.
Introduction to CARC systems
Discovery is a high-performance computing cluster, which is a collection of computers and disk arrays that are connected via fast networks. Discovery allows USC researchers to perform computing tasks, like data analyses and simulations, on a larger scale than is possible with a laptop or lab computer. The Discovery cluster is the CARC's public cluster; any CARC user can use Discovery.
The following graphic depicts the CARC cyberinfrastructure and how different systems interact with one another:
Endeavour condo cluster
Endeavour is a high-performance computing cluster like Discovery, but Endeavour comprises resources that Condo Cluster Program (CCP) users lease or subscribe to, with each research group's resources dedicated for their use only. For more information on the CCP, see the Condo Cluster Program pages. For detailed information on the Endeavour cluster, see our Getting Started with Endeavour user guide
Storage file systems
All CARC account holders are assigned three directories where they can store files and run programs. Each of these three directories is located in the home, project, and scratch file systems.
Each file system serves a different purpose:
- /home1 is a network file system for storing configuration files and personal scripts. Each CARC user has a 100 GB home directory quota.
- /project: Assignment to a project gives you access to a subdirectory of the /project parallel file system. Managed by a Principal Investigator, this is where you have access to a maximum of 10 TB of storage space (shared among the project's members), and where you can collaborate and share files with your research group. Use this high-performance file system for most of your research computing work at CARC. If more than 10 TB of storage is needed, it can be purchased in 5 TB increments for $40/TB/year. See the Accounts and Allocations page for more information.
- /scratch and /scratch2 are two parallel file systems that are shared among all CARC users. These file systems can be used for storing data temporarily and running I/O intensive jobs. Each CARC user receives a 10 TB quota for /scratch and a 10 TB quota for /scratch2.
Accessing CARC systems
All USC students, staff, and faculty have access to the CARC's systems for their research projects. In order to access the CARC's systems, you must either be the Principal Investigator (PI) of a research project or an authorized member of a PI's research project.
CARC systems are accessed using your USC NetID and password, so there is no additional requirement for CARC-specific account creation.
Note: Your USC NetID is the first part of your USC email address (e.g., email@example.com's NetID is ttrojan).
Duo two-factor authentication is also required. If you have not already signed up for Duo on your USC NetID account, please visit this page to enroll.
Currently, CARC systems do not support the use or storage of sensitive data. If your research work includes sensitive data, including but not limited to HIPAA-, FERPA-, or CUI-regulated data, see our Secure Computing user guides or contact us at firstname.lastname@example.org before using our systems.
Access to and use of resources is based on participation in projects. Project setup and resource allocation requests must be made by a project's PI using the CARC User Portal.
For more information on accounts, see our Accounts and Allocations page.
How to use the systems
When using CARC systems, you will notice several differences from your desktop or laptop environment:
- The interface is command-line driven (no graphical user interface)
- The systems use the CentOS Linux operating system (not macOS or Windows)
- You submit your programs to a remote batch processing system, or job scheduler, to run them
The CARC has prepared user guides specific to its systems in the following categories:
How to log in to Discovery and Endeavour and run jobs.
Data Management and File Transfers
An overview of the different storage directories available to you, and instructions on transferring files between your personal computer and CARC systems.
Software and Programming
Information on the software available on CARC systems, as well as instructions for installing your own software.
CARC User Portal
How to create and manage your projects and resource allocations.
Our main user guides page can be accessed here.
Resources for deeper learning
Each month, the CARC's Research Facilitation & Applications team offers a number of free workshops designed to introduce users to the computing cluster and its features. The team is frequently developing new workshops, including workshops on useful software and programming languages.
All workshops are approximately two hours in length and are offered several times a year.
For information on the different workshops that the CARC's Research Facilitation & Applications team offers on a rotating basis, see our Seminars and Workshops page. For a schedule of upcoming workshops, see our Events page.
External tools and resources
If you want to improve your overall understanding of research computing, the CARC has compiled a list of external resources that may be helpful for learning about research computing, programming languages, and software used by CARC systems.
You can view our External Tools and Resources page here.
How to get help
Weekly office hours
Every week, the Research Facilitation & Applications team hosts office hours for CARC users to ask questions about anything related to research computing. No appointments are necessary, and all levels of users and questions are welcomed. Currently, all office hours are taking place via Zoom every Tuesday from 2:30-5:00 pm. Office hours are drop-in and do not require registration, but you will need a USC NetID to join the Zoom meeting.
For more information, see our Office Hours and Consultations page.
Frequently asked questions
See our extensive Frequently Asked Questions page for answers to common questions about CARC accounts, different cluster resources, and using software on CARC systems.
Discourse user forum
The CARC uses Discourse, a question-and-answer community forum, to facilitate discussion and knowledge sharing among users. The User Forum is a great resource for discussing CARC-related topics, asking non-urgent technical questions, and sharing ideas. The CARC team monitors the forum for questions, but users are also encouraged to interact with each other.
You can access the CARC's User Forum here.
If you're experiencing an issue with system resources or your CARC account and you're unable to find a solution to your problem using the above resources, please submit a help ticket to the CARC team.