Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

Home
Discussions
Community Q&A

"Add spelling filter"

There is filter in text processing to remove dictionary words (stop words). Is there a filter to remove none-dictionary words?

One of the use is to filter words NOT in user-file. If the user-file is "linux.words", English dictionary, then this will remove none-English words. This is useful when we want to remove bad words from poorly scanned collection of OCR text files.

Find more posts tagged with

AI Studio

Filtering

Accepted answers

All comments

MariusHelf

Hi, this is currently not possible out of the box with the Text Processing operators. You can however transform the document into an example set and then use the standard RapidMiner operators to remove all words which are not contained in a dictionary.

Best,
Marius

Quick Links

All Categories
Recent Discussions
Activity
Unanswered
日本語 (Japanese)
한국어(Korean)
Groups