In this section, you learn about the file system, it’s structure and content.
First, use the following command to list all the files present.
time lfs find /lustre
You should see something similar as in the image below.
Now, look at the size of your files by listing the content of the /lustre directory.
ls -lh /lustre
You should see something like the following image:
Next, use the following command to look at how much data is stored on the Lustre partition for the Metadata Target (MDT) and Object Storage Targets (OSTs).
time lfs df -h
The result should be comparable to the one shown below.
Notice that there is a discrepancy between
This discrepancy is due to the lazy loading functionality of Amazon FSx for Lustre when it is linked to an Amazon S3 bucket. Only the metadata of the objects is retrieved on the MDT, the actual bytes or content of the files is copied at first read.