You don't want sensitive data from
your web application to be publicly Exposed
on the internet as a result of Google indexing.
What more you don't want other people to find
this sensitive data by means of Google
hacking.
That's why you need to learn how to prevent Google
indexing from happening.
What you should do is as follows.
You should add the robots.txt file
in the root directory of
your web application with the following content.
user agent asterisk this allow
slash
This is a message for all web crawler. Bots
including Google Bots saying hey,
I don't want you to
index my web pages.
Then the web pages will not be indexed by
Google.
Sensitive data will not be exposed to
everyone on the internet and other people
will not be able to find the sensitive
data by means of Google hacking.
So as you can see the countermeasure to
Google indexing is pretty simple,
but you have to remember about it and you
have to implement it otherwise different types
of sensitive data from your web application can
be indexed by Google and this is
what I presented to you in the previous clips.
Okay. Now we are done with this clip and
in the next one, I will summarize what
you have learned in this course.