Create an HPC Cluster

hpc_logo

AWS ParallelCluster is an AWS supported open source cluster management tool that helps you to deploy and manage High Performance Computing (HPC) clusters in the AWS Cloud. Built on the open source CfnCluster project, AWS ParallelCluster enables you to quickly build an HPC compute environment in AWS. It automatically sets up the required compute resources and shared file system. You can use AWS ParallelCluster with a variety of batch schedulers, such as AWS Batch, SGE, Torque, and Slurm. AWS ParallelCluster facilitates quick start proof of concept deployments and production deployments. You can also build higher level workflows, such as a genomics portal that automates an entire DNA sequencing workflow, on top of AWS ParallelCluster.

This lab requires an AWS Cloud9 IDE. If you do not have an AWS Cloud9 IDE set up, complete sections a. Sign in to the Console through d. Work with the AWS CLI in the Getting Started in the Cloud workshop.

In this lab, you are introduced to AWS ParallelCluster and how to run your HPC jobs in AWS as you would on-premises. This workshop includes the following steps:

  • Install and configure ParallelCluster on your AWS Cloud9 IDE.
  • Create your first cluster.
  • Submit a sample job and check what is happening in the background.
  • Delete the cluster.