AWS-Logo_White-Color
I ⁃
AWS HPC Overview
II ⁃
Getting Started in the Cloud
Prerequisites
a. Sign in to the Console
b. Create a Cloud9 Environment
d. Create a Key Pair
c. Work with the AWS CLI
e. Create an S3 Bucket
f. Launch the EC2 Dashboard
g. Create an EC2 Instance
h. Create an IAM Role
Summary
III ⁃
ParallelCluster Manager
a. Deploy Pcluster Manager
b. Connect to Pcluster Manager
c. Summary
III ⁃
ParallelCluster CLI (optional)
a. Install AWS ParallelCluster
c. (Optional) Create config with 'pcluster configure'
c. Create a Cluster Config
d. Build an HPC Cluster
e. Log in to Your Cluster
IV ⁃
Create an HPC Cluster
a. Create a Cluster
b. Connect to the Cluster
c. Get to know your Cluster
f. Submit your first HPC job
g. Update your cluster
h. Terminate Your Cluster
IV ⁃
Build a High-Performance File System
a. Create HPC Cluster
b. Create FSx Lustre
c. Create S3 Bucket
d. Link S3 to FSx Lustre
e. Examine the File System
f. About Lazy File Loading
g. Install IOR Benchmark Tool
h. View Metrics with CloudWatch
i. Test IO Performance
j. Summary and Cleanup
V ⁃
Simulations with AWS Batch
a. Lab Environment
b. IAM Role Setup
c. Build A Container With Docker
d. Upload to Amazon ECR
e. Set up Compute Environment
f. Set up a Job Queue
g. Set up a Job Definition
h. Describe Your Environment
i. Run a Single Job
j. Run an Array Job
k. Job Dependencies
l. Next Steps & Clean up
m. Optimize Cost with EC2 Spot
n. Next Steps & Clean up
VI ⁃
Remote Visualization using NICE DCV
DCV Connect in ParallelCluster
a. Create a cluster configured with NICE DCV
a. Connect to your NICE DCV Session
DCV Queue in ParallelCluster
a. Create Security Group
b. Modify Cluster Configuration
c. Create DCV Session
d. No-Ingress DCV Session
DCV using web browser/native client
a. Deploy EC2 instance with NICE DCV
b. Connect to NICE DCV EC2 Instance
c. Connect to Remote Desktop Session
d. Terminate Your Instance
VII ⁃
Elastic Fabric Adapter (EFA)
a. EFA Basics
b. Create an HPC Cluster with EFA
c. Examine an EFA enabled instance
d. Work With Intel MPI
e. Download, compile and run the OSU Benchmark
f. Delete Your EFA Cluster
VIII ⁃
Distributed Machine Learning
a. Upload training data to S3
b. Create a distributed ML cluster
c. Run single node data preprocessing with Slurm
d. Run PyTorch Data Parallel training on ParallelCluster
e. Delete Distributed ML Cluster
More
Github
AWS - HPC
External Worshops
Conferences Worshops
Authors
Feedback / Questions?
Tags
Clear History
Star
Fork
Privacy
|
Site Terms
| © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS HPC Workshops
>
Tags
> Slurm
Slurm
c. Run single node data preprocessing with Slurm
d. Run PyTorch Data Parallel training on ParallelCluster
Distributed Machine Learning