There are four types of applications currently supported on the Neocortex system, divided into the following individual tracks:
- Track 1: Cerebras modelzoo ML models
- Track 2: Models similar to the Cerebras modelzoo models
- Track 3: General purpose SDK
- Track 4: WFA, WSE Field-equation API
This document is expected to serve as the guiding technical guide for Neocortex users. It is under continuous development. If you have any recommendations for this document, please make sure to share them with the team (see Feedback section).
Neocortex, a system that captures groundbreaking new hardware technologies, is designed to accelerate Artificial Intelligence (AI) research in pursuit of science, discovery, and societal good. Neocortex is a highly innovative resource that will accelerate AI- powered scientific discovery by vastly shortening the time required for deep learning training, foster greater integration of artificial deep learning with scientific workflows, and provide revolutionary new hardware for the development of more efficient algorithms for artificial intelligence and graph analytics.
Neocortex aims to democratize access to game-changing compute power otherwise only available to tech giants for students, postdocs, faculty, and others, who require faster turnaround on training to analyze data and integrate AI with simulation. It also aims to inspire the research community to scale their AI-based research and integrate AI advances into their research workflows.
With Neocortex, users are expected to be able to apply more accurate models and larger training data, scale model parallelism to unprecedented levels and avoid the need for expensive and time-consuming hyperparameter optimization. The development of new algorithms in machine learning and graph analytics will be enabled through this innovative AI platform.
The Neocortex System Slack Organization is now available. Please feel free to join if you want to communicate with other project team members through Slack.
The list below presents the different stages we hope every project will go through:
- Researcher on-boarding (you will get different emails from email@example.com and access to the Neocortex system)
- Accessing the Neocortex portal and user documentation (this webpage)
- Accessing the Neocortex system (over SSH)
- Running a job in the Neocortex system (using scripts or Slurm commands like srun/sbatch to outlined )
- Executing Cerebras reference/sample code (i.e. modelzoo networks, SDK examples, ...)
- Transferring your data into the Neocortex environment
- Executing your code base in the Neocortex environment
- Producing ML key metrics / SDK Detailed project plan
- Porting code to Cerebras stack
- Optimizing your code for maximum performance