-: So in this lesson,
we are going to talk about monitoring cluster performance,
and specifically cluster performance in HDInsight.
So what we're going to do, is we're going to take just a
minute and we're going to talk about monitoring in
HDInsight, and then I'm going to jump over into an HDInsight
instance in Azure, and we'll see what that looks like.
So with that, let's start off
by talking about how we measure in HDInsight clusters.
So it all starts with something called Apache Ambari.
And Apache Ambari is a service that lets us manage
and monitor HDInsight clusters, lets us create alerts.
This is what it looks like over here on the right.
So it's pretty similar to Azure Monitor,
but it's specific to HDInsight clusters.
And so here's just a couple of pictures.
And again, we're going to jump in to look at this,
but that's what Apache Ambari does in HDInsight, okay?
So how do I access Ambari?
Well, we go to your CLUSTERNAME.azurehdinsight.net,
and then that'll allow you to access.
And so with that, let's actually stop talking
about HDInsight and let's jump over into the portal
and take a look at what this looks like.
So I've opened up an internet browser
and I put my CLUSTERNAME.azurehdinsight.net here,
and when you do that, it asks you for a sign in
and this is something that you create
when you first create your HDInsight cluster.
And it's going to log me into Ambari.
There we are, so now we are actually looking
at the dashboard for our HDInsight service.
So you can see over here on the left,
there are a ton of different resources
for our HDInsight cluster,
and we also have metrics that we can choose
and kind of look at on the fly.
If we want to add to these metrics, we can of course do
that. We can also dive into different services
like HDFS by clicking on that and you'll see details
about what's going on in that cluster.
In addition, we can come down here to Alerts
and we can see some alerts that have already been created
and enabled, so we can enable or turn off those alerts
and you can see that it pre-configures, what,
79 different alerts for us.
And if I was to click on one of those
it's going to give you thresholds and give you more
information on each one of those alerts.
So it's a pretty robust system,
and if we want to, we can manage notifications
and we can create notifications and recipients
if we wanted to, we can also come in
and mess with alert settings if we want to
so we can figure how many alert checks we want
before a notification is dispatched.
We can also manage alert groups.
So there's quite a bit of different stuff
that we can do here.
Honestly, for the DP-203, you don't really need
to get into Ambari all that much and what it can do.
The bigger thing is that you know that Ambari
is what we are actually using to manage clusters
in HDInsight, or at least to monitor clusters in HDInsight.
So if you understand that,
that's pretty much all we need to know for the DP-203.
If you actually get into HDInsight in any meaningful way,
you'll do definitely get much more familiar with Ambari,
but for now, I'm actually going to stop talking about Ambari
and we're going to jump into key points to remember,
even though this has been a short lesson.
The things you need to know for the DP-203,
HDInsight clusters, they're managed by using Apache Ambari
and you can monitor, manage, and create alerts
through Apache Ambari.
If you understand those 2 concepts,
that's literally all you need to understand for the DP-203.
As it relates to monitoring HDInsight clusters,
use Apache Ambari.
With that, let's jump onto the next lesson.