-: Hey, what's up, gurus
and welcome to a new section,
Monitor Data Storage and Data Processing.
In the grand scheme of things,
we now find ourselves here,
which congratulations, you are getting very,
very, very close to the end of this course,
and just about ready to take your exam
and get your brand new data engineering certification.
So with that, let's dive in
and talk a little bit about this section.
So in this section, we are going to be talking about
how we develop a monitoring strategy
with a focus on performance.
How do we make things cost less, finish faster,
become more streamlined,
and we're really going to break this thought
of performance into a couple of different terms.
First is monitor.
So we're going to talk about data pipelines,
cluster performance, Azure Monitor metrics and logs,
and what that means.
And then the other side of that is going to be measuring.
So, moving away from that pipeline performance kind of
metric, into more how our queries are performing
or looking at the performance of our data movement.
So that's going to help us in a different way,
one using more of a script-based methodology,
and then one using more of that, hard coding
what's actually happening with the system.
So we're going to look at that in this section
and then we're also going to talk about
a variety of different data services.
And it's very important that you focus on
the service as we talk about this,
because we're going to go over several of the services
that we've been talking about through this entire course.
A few key points to remember:
1. Hey, this is not very code-based.
So if you don't like the scripts,
this is going to be a good section for you.
Don't forget the service though.
You do need to know where you access each concept.
So when we talk about those concepts
make sure that in your mind
that you're tying that to Azure Synapse,
or Azure Stream Analytics,
or whatever the service is.
And don't forget the scenario.
This is true.
We've talked about this
at a couple of different points in this exam,
but those scenarios is going to help you
do better on the DP-203.
So be thinking about how all of this ties together
into that larger pipeline or that larger project.
And so with that, hey, we finished our introduction.
Let's jump into the first lesson and get started.