Hello, in the previous session, we have performed lots of people sitting on our data.
We have deal with this.
This are all logic because our substitute function of Audy module isn't going to be very handy in this
use case.
That's why we have.
Right.
Our own logic.
And after this, we have used this one function to remove punctuation.
Then we have deal with what we have is worth in our data.
So we have to use all these logics like that.
And in this session, we are basically going to do still lots of people sitting on our data.
And at the end we will come up with some meaningful insights from this huge chunk of data.
So that's a very full time way to check whether I have any some hyperlinks or some others present in
my text column or not.
For this, I'm just going to say final of text.
Very first.
I have to exit this text on this.
I'm just going to say Star Dot contains what I have to contain basically to deep, so deep, dark some
because I just need total number of rows that contains this SCDP in there, as are Substring to just
execute it.
And it will show me.
Yeah, there are thirty five entries who have this SCDP as a substring.
So if I'm going to select it as to be Kushima just executed.
Still you have thirty five rule.
It means there are thirty five rules who have dirtiness so you have to remove this.
So let me show you where exactly it has to be.
So for this I'm just going to copy all this stuff and here I'm just going to say I have to remove this
so I'm just executed.
It will show me value in the form of force and rule.
So wherever it is false, it means that a string or you can say at that particular index, it doesn't
contain SCDP, wherever it is true, it means it has to be all there.
So you will see you don't have to adhere to like me show all these two draws.
So for days I'm just going to say, please dot set option.
And here I have to say I have to display my maximum rules as two thousand.
So I'm going to say display dot max underscore roles.
And here I'm just going to say which is exactly my two thousand just executed.
It will take some couple of seconds and you will figure out this twenty first index has as DDP as a
service shrink.
It means you have to remove this extra deeply in this string.
So let me show you how exactly it looks like.
So I'm going to say final of text of twenty one just executed.
You will see it has this hyperreal phrase, SCDP, Amazon and all these kinds of things.
You will see this is that dirtiness that I was talking about in the previous session.
So you have to remove this hyperlink from your data for this is what I'm going to do.
Very first.
You have to write some all logic over here using your armadillo's here.
I'm going to say very first, if you haven't imposed that order, you guys can import ideas were so
in this ardie, you have a function which is exactly my compiler function and just start to read all
the documentation, all the parameters for this function do and all these kinds of things.
So here I'm just going to say using its function, you guys can find out some patterns from your data.
So for this, I have to mention some pattern over here.
So that pattern is exactly let me write that pattern.
The pattern is nothing but which is exactly it contains either hyper reference, which is X or if you
will see or here and whether it will have some, let's say, skip.
So here I would say it is exactly dippie.
And here you have to say, doc, it means after s GDP, you have any number of characters still in space
and after it here you have to mention this word.
So this this W plus means W is basically my word character, which which includes basically smally to
that capitally to that like underscore.
And this plus indicates here more than one word character that does that exact meaning of this entire
line of code that I have written over here.
So this is exactly my usual pattern.
So I'm going to say this is exactly my let's say you order an escort pattern.
So once wherever or you can see wherever I have this pattern, you have to just add a.
It was something else.
So for this time, we just say, let me let me see it, let's say wherever I have this pattern so that
if I have to exit this, you are a pattern dot certitudes.
So to which you have to substitute it.
So here I'm going to say wherever I have this pattern, just replace it.
So using this, you guys can say just replace it and now you have to pass it over here.
Let's say I'm just going to store this in somewhere else.
Let's see.
This is exactly my review so you guys can also print your review as well.
Now, here you have to mention this review, which is exactly this one.
So after that, you have to just execute it.
Now, you will see over here you don't have any hyperlinks in your data.
By just writing these blocks of code, you will see the power of python and power of this regular expression
module.
So now what you have to do, you have to just create a function and you have to just paste that logic
over there so that you can apply this function on each and every rule of data.
So far, this I'm just going to say my function imitating would remove underscore you are else.
And here you have to mention, you can see here you have to pass your review after it.
You have to just copy all this stuff and you have to just paste over there, make sure you have to provide
right indentation as well.
Now you have to just return this and after it what you have to do, you have to just execute these blocks
of code.
Now you have to apply this function on your text.
So I'm going to say final text dot apply and you have to apply this remove, underscore you are a function.
Once you apply this, you have to update this text as well.
So I'm just going to update using this just executed.
All of this stuff gets executed with some warnings.
Don't worry at all.
I now what I'm going to do and if let me show you a thing and if I'm just going to copy this and if
again, I am going to print over here now, you will figure out you don't have any of the hyperlinks
available in your data.
Similarly, let me select some other rule, say 25.
And here, if I want to say it is my twenty five.
Now, you will see you don't have any any dirtiness in your data.
It means now your data is going to ready for your analysis purposes, but you still have some doubt.
Yeah.
What if you had you still have some SCDP in this data or soul searching in your data.
So let me just copy this and let me just paste over there to show you whether it contains or not.
Just execute it.
You will see its count is zero.
It means you don't have any hyperlinking your data.
And if let's say I'm going to print the data out for index, you will still observe over here.
You have some extra value.
Let's say this B are over here, which is exactly this one, because what if this bar is available in
each of the text?
So that definitely makes no sense at all.
It means you have to remove this for this.
If I'm going to say replace this bar with something else, let's have to replace this bar.
So if I'm going to execute it now, you will see your B-R guess disappear.
Now, you have to apply this to replace function on each and every two or three days.
For this, I'm going to say for I in range zero to 10, whatever be the length of the final text for
this, I have to exit this final text over there.
Now, on each and every I, I have to say I have to apply this replace, so I have to apply this to
replace and wherever I have this beyond just replace it, that's it.
And I have to update this each and every day as well.
So here I have to paste it now.
Just executed.
It will take some couple of seconds and all the stuffs gets executed now.
Now your wait is over and it's a time to perform your workload, your presentation of data.
So now if I'm going to say final thought, had to get a preview of how exactly my data looks like.
So this is exactly my next feature that I have to consider for my workload representation.
So here I'm going to say I have to use this word cloud, and this is exactly my word.
And in this word cloud, what I have said already for let's say I have to set my custom parameter,
what exactly is word, which is 800 and after it, I have to set some custom height, which is, let's
say, exactly of 800.
After doing all these things, let's say I have to say my stop words is equal to stop force that I have
already defined earlier.
And on this, I'm just going to say I have to generate my workload.
So here you need some data so that if I'm just going to create my entire data for this, I'm going to
save Dot Joachin and I have to join what I have to do on average on this final of text, let's say I'm
going to say this is exactly my comment on this code words, and I have to just pass this in my comment
on as code words in general function, which is exactly command underscore words very first.
You have to execute the cell, just best tab.
And this is exactly your comment and score.
Now I'm going to say it will be done with my word cloud object.
So I have this there after it.
You have to set your own figures.
So I'm going to say BLT Dot Prager here, you have some fixed sites like We Saijo IT Comite, whatever
you want to assign, it's up to you.
After that, you have to showcase it.
So I'm going to say I am sure of what cloud, which is exactly this one after doing all this is does
I have to disable my access as well for this?
I have to say this axis of just as good, all this stuff.
Now, this is a beautiful word, core of which I was talking about.
So you can definitely come up with some conclusion here.
This is exactly the behavior of the customer.
It means he or she is going to perform from these these these key words.
Most of the time he's going to Praful, these key words so you can easily examine what exactly the behavior
of your customer.
So that's all about this project.
Hope you love this project very much to try to explore as much as from your own site.
So that's all about this project.
Guys, hope you love this session and project very much.
Thank you.
How nice to keep learning.
Keep growing, keep motivated.