Remove the attribute tokenize?

Wengki
Wengki New Altair Community Member
edited November 5 in Community Q&A
How i can remove attribute after tokenize without filter stopwords?
Tagged:

Answers

  • Wengki
    Wengki New Altair Community Member
    Only "a" i want remove from attribute
  • kayman
    kayman New Altair Community Member
    You could set the minimum length for your token at for instance 2, this would drop all single letter attributes.
    You can achieve this with the 'filter tokens (by length)' operator
  • Telcontar120
    Telcontar120 New Altair Community Member
    You can also try Filter Tokens by Content or Filter Stopwords (Dictionary), which allows you to provide a file of specific words you want to eliminate.

Categories