Hi, everyone, and welcome back.
Now, in today's video, we are going to discuss about the storage options that are available in Elastic
block store.
Now, generally in production environments, apart from the CPU and the RAM that you assign to the instance,
one of the other important factors is the storage.
If storage is not fast, then it will prove to be a bottleneck for your entire application or the database
and everything will slow down.
And this is the reason why you need to choose the right storage option for your use case.
If you choose a storage drive that is much more faster, then the pricing will increase.
If you choose a storage drive that is much more slower, then you will see bottlenecks.
And this is the reason why in today's video will be exploring various storage options that are available
and which one you should choose depending upon the use case.
Now, whenever you choose a storage device, generally you will see in the documentation there are two
important matrix that have been shown.
One is the IOPS, which stands for the input output operations per second, and second is the throughput.
Now, depending upon the storage device that you choose, you can choose a hard disk drive, you can
choose a solid state drive.
The overall IOPS throughput and other matrix will also change.
Now, for those who know, if you have installed a Windows operating system in a hard disk drive and
if you have installed the Windows operating system in an SSD, you will note the difference that it
makes.
Installing Windows in SSD leads to much more faster boot performance and also overall things are much
more faster.
If you have used SSD, you will not really go back to the HDD volumes unless and until you want to use
the HDD for storing some large files.
Now, before we proceed further, let's go ahead and quickly look into the IOPS and throughput at overview.
So IOPS is a count of read and write operations per second that the storage device can make.
And throughput is the measurement of read and write bits per second that are transferred over a network.
So with this base set, let's go ahead and explore the volume types.
Now, at a high level overview, when we discuss about EBS, there are two primary volume types.
One is the hardest trace and second one is the solid state drives and the EBS volume types that are
available.
They either use primarily the HDD or the solid state drives.
Now, before we proceed further, let's go ahead and look into where exactly can we select the volume
types of EBS now from the EC two console under the Elastic BLOCK store, let's go ahead and quickly
create a volume.
Now, one of the important configuration here is the volume type.
Now you see you have multiple volume types that are available.
You have a general purpose SSD, you have a provisioned IOPS SSD, you have a cold HDD, you have a
throughput, optimized HDD and so on.
And this is where the things that we will be learning in this lecture will prove to be useful and will
allow you to decide which one will you choose for your application.
So first, let's go ahead and start with the solid state drive.
Now, when we discuss about the SSD backed volumes, there are two important ones that are available.
One is the general purpose SSD, and second one is the pro vision IOPS SSD.
At an overview.
If you have to see which one is the fastest, the fastest one among all of them is the provisioned IOPS
SSD.
But at an overview you should be choosing the SSD volumes because they are optimized for transactional
workloads involving frequent read write operations with small IOCs where the dominant performance attribute
is IOPS.
Now note that although the SSD volumes are much more faster, it is not recommended for all of the use
cases.
So will be discussing about this in just a moment.
But in a use case where you need faster performance like faster read, write operations, then SSD can
prove to be useful.
Now the second type is the hard disk drives as we're discussing in the hard is that there are two major
categories that you will see being used in the organization.
You have a throughput optimized HDD and you have the cold HDD volumes and these volumes are not really
recommended.
If you need a frequent read, write operations and much more faster IOPS.
However, they are optimized for large streaming workloads where the dominant attribute is throughput.
You also have one more volume of magnetic, which is a previous generation, and generally this is not
really recommended.
Now let's go ahead and start with our first type of SSD, which is the general purpose SSD.
Now general purpose SSD, again, it is divided into two.
You have a GP to volume and you have a GP three volume.
Now let's go ahead and discuss about each one of them.
First primary characteristic is related to IOPS.
Now one thing to note is that GP two is the older generation of volumes.
Earlier, GP three was not really.
And GPT three has been recently introduced.
GP2 has been there for many years.
So at a high level overview you can identify that GPT three will provide some kind of a benefit over
GP2 volumes.
So regarding the baseline IOPS GP two provides three IOPS per jib with minimum of 100 IOPS to a maximum
of 16,000 IOPS.
So this is the baseline here, and the baseline of GP three is 3000 IOPS.
Now we will be discussing about the first pointer in just a moment.
Before that, let's also look into the throughput.
So baseline throughput for GP three is 125.
The GP two ranges from 122 to 58 might be however, maximum throughput for GP three is much more larger,
which is 1000.
As we know, the generation of GP three is much more newer than that of GP two.
Now we were discussing about the baseline IOPS over here.
Let's go ahead and look into it in much more detail perspective Now before we look into it in detail,
one more important thing to note is that GP three offers SSD performance at 20% lower cost per GB than
that of the GP two volumes.
So let's do one thing.
Let's go ahead and understand about this baseline IOPS in more detail.
Now I'll use a notepad so that we understand it in a better terms.
So for GP two volumes, here you have three IOPS per GP, alright, and you have 100, which is the
minimum IOPS.
So in such case, let's say if you create a GP two volume of size 100 GB, then the overall IOPS that
you get is three.
IOPS in 100 is equal to 300 IOPS.
Similarly, if you create a one TB GP to volume, you have three into say, 1000 just for simplicity
and we'll say we'll get 3000 IOPS in a one TB volume.
All right.
Now if you look into the baseline IOPS of GP three, it is 3000 IOPS.
So in case if you're using GP three volume, even if you create a 50 GB volume, you'll be getting a
baseline performance of 3000 IOPS.
All right, so this is what the first pointer really means.
Now the second category of SSD volumes is the provisioned IOPS provision.
IOPS is the highest performance SSD that is available.
And again in the provisioned IOPS you have the IO two BLOCK Express, IO two and IO one.
Now, at a high level overview, you do not really need to remember these numbers.
For example, you do not really need to know that GP two provides 128 GB per second and two $0.50 per
second.
But you should know that GP three provides much more faster performance and at a lower cost.
So this is something that needs to be remembered.
Now when we discuss about the provisioned IOPS for IO two, you will see that the durability is much
more better where you have a 99.99%.
However, for IO one the durability is a little lesser, so the annual failure rate of IO one is higher
than that of the IO two.
Now when we discuss about the IO two volumes here, one of the primary distinguished pointers here is
the maximum IOPS per volume IO to block Express Pro is to 56,000 IO to provide 64,000 IO 1.64 thousand.
So if you need the highest performance, you need to choose the IO to block express here.
Similarly, the throughput also IO to block x plus 4000 IO two and IO one is 1000 respectively.
Now let's also look into the hard disk drives.
There are two primary categories.
You have a throughput optimized and you have a cold HDD throughput optimized, also referred to as SD
one.
Cold HDD is referred to as SD one.
If you look into the maximum IOPS per volume for throughput optimize, it is 500 cold HDDs to 50.
Similarly, the throughput also differs accordingly.
Now one important part to remember is that when you look into the pricing, cold HDD is giving much
more better pricing than that of the throughput optimized volumes.
So generally in a scenarios where lowest storage cost is important, you need to choose the core HDD.
We'll be discussing about this in just a moment.
So currently I am in the pricing calculator.
Let's go ahead and quickly look into the difference.
So I'll search for the Elastic BLOCK store.
And within here, let's say the storage volume, I'll select as 100 GB, I'll just say no snapshot so
that we get the accurate pricing.
Now for the 100 GB GP to volume over year, it is costing us 10 USD.
Similarly, if I choose a GP three volume of 100 GB, the total monthly cost is 8 USD, so GP three
provides much more better value.
And also you see the provision IOPS per volume is 3000.
So even if you choose a 50 GB volume, the baseline performance remains to be the same.
So here it says that the GP three supports 3000 IOPS included per volume with option to provision up
to 16,000.
So let's say you choose how.
IOPS your say, 9000 IOPS.
You see, the pricing has changed significantly.
All right?
So the higher the IOPS, the higher the pricing that you will generally see.
Now, let's change this to provision IOPS.
You have IO one and IO two.
So let's see IO two.
For an example, the 50 GB volume with a provision IOPS of 3000.
You see, it is costing significantly higher.
If I make it 9000, the pricing has reached almost 600 USD.
So provision IOPS are generally much more expensive, but for a lot of workloads like database and others,
provision IOPS proves to be quite useful.
All right.
Now let's switch to the cold HDD as we're discussing here.
Coal HDD is recommended for scenarios where lowest storage cost is important.
So now if I choose a cold HDD 125 GB volume is just costing you 1.88 USD less than $2 is what this provides.
So this is much more better in a large set of use cases.
Now, generally from exam perspective, let's say they give you a use case and based on the use case,
you'll have to select which one can prove to be useful.
Now, before we conclude, let's look into a sample question at a high level overview that will allow
or give you a gist to make sure that you understood the topic well.
So the use case states that Medium Corp is an organization and you have been assigned a responsibility
for performance optimization.
And the use case states that they have a critical database server that receives a lot of connection.
Now they have tried increasing the RAM and CPU, but the overall performance is still slow.
Now what type of EBS volume will you suggest so that the performance can be increased?
First is general purpose SSD.
You have a throughput optimized, you have a provisioned IOPS and you have a cold HDD easily.
From here we can say that provisioned IOPS is the highest performance SSD and this is something that
we can choose to make sure that the performance increases.
As we know, Provision IOPS SSD also has the highest IOPS that you can request pricing increases, but
this question does not really state any pricing related data.
So provisioned IOPS is the right option for this.
So this is the very high level overview about the volume type offerings in EBS, and with this will
conclude today's video.