Regarding Semantic Analysis

Sushmitha

Can someone tell how to implement or add semantic analysis into my process? means i need to compare not only similar words but also the meanings of 2 words  are same in a single document.

Telcontar120

I don't believe there is any built-in operator or extension that would allow synonym analysis within the TF-IDF framework.  You would have to do something manual by using token replacement and a dictionary of synonyms.  I agree that Word2Vec is typically the better approach if you are looking for semantic similarity as the basis of your analysis.

MartinLiebig

Hi,

sounds like word2vec? Please check: https://community.rapidminer.com/discussion/52507/synonym-detection-with-word2vec

Best,

Martin

Sushmitha

Hi again, Actually I am trying to achieve Syntactic and Semantic similarity with TF-IDF model. So it would be better if I get some source related to TF-IDF model.  

Telcontar120

I don't believe there is any built-in operator or extension that would allow synonym analysis within the TF-IDF framework.  You would have to do something manual by using token replacement and a dictionary of synonyms.  I agree that Word2Vec is typically the better approach if you are looking for semantic similarity as the basis of your analysis.