"Add spelling filter"

yijun
yijun New Altair Community Member
edited November 5 in Community Q&A
There is filter in text processing to remove dictionary words (stop words). Is there a filter to remove none-dictionary words?

One of the use is to filter words NOT in user-file. If the user-file is "linux.words", English dictionary, then this will remove none-English words. This is useful when we want to remove bad words from poorly scanned collection of OCR text files.

Answers

  • MariusHelf
    MariusHelf New Altair Community Member
    Hi, this is currently not possible out of the box with the Text Processing operators. You can however transform the document into an example set and then use the standard RapidMiner operators to remove all words which are not contained in a dictionary.

    Best,
    Marius