filter a list of words with filter token by content operator
Find more posts tagged with
Sort by:
1 - 4 of
41
Telcontar120 thank you for your reply
I have 1500 token from which i only want to 300 specific and all other exclude from the example set how can I use replace in this scenario?
@Telcontar120 oh yes it's working, thank you for help. You save my life
Sort by:
1 - 1 of
11
With that volume of words I would suggest the Custom Stopword dictionary option I mentioned. Just create a simple text file with all the words you don't want (each word on a separate row) and connect that as your external dictionary file. Only the words that are not on that list will be retained.
You can use "Replace Tokens" first to change every token you want to eliminate (this operator takes multiple rows of inputs) into something like "replaceme" and then just use a single "Filter Tokens by Content" on "replaceme" after those substitutions.
Or you can use the "Filter Stopwords (Dictionary)" operator and use an external file of words to eliminate.