How to replace Values after TF-IDF
Hi all,
Sorry if this topic was already answered by I was not able to find it.
Here's the situation.
I've perfomed a TF-IDF score to a set of documents and my idea is to get rid of words were their tf-idf score is very low (ex. below 0.001).
How can I "clean" my example set in order to set values that are below 0.001 to 0.
It's not simple to set a word tf-idf score into 0, because a word can have a higher tf-idf in particular document and low values in order documents.
I hope I could made myself clear.
Any help would be very much apreciated.
Thank's a lot
Cheers,
Ruca
Sorry if this topic was already answered by I was not able to find it.
Here's the situation.
I've perfomed a TF-IDF score to a set of documents and my idea is to get rid of words were their tf-idf score is very low (ex. below 0.001).
How can I "clean" my example set in order to set values that are below 0.001 to 0.
It's not simple to set a word tf-idf score into 0, because a word can have a higher tf-idf in particular document and low values in order documents.
I hope I could made myself clear.
Any help would be very much apreciated.
Thank's a lot
Cheers,
Ruca