Altair RISE
A program to recognize and reward our most engaged community members
Nominate Yourself Now!
Home
Discussions
Community Q&A
Data preparation
LindsayKelevra
hi everybody! I made the data preparation shown in the picutre, but watching the tf-idf's weighting schemas i notice that there are some strange charaters (for example
“optionâ€
), how can eliminate them? thank u
Find more posts tagged with
AI Studio
Tokens
Stemming
Accepted answers
Telcontar120
This is likely the artifact of characters that can't be encoded normally (like emojis or other similar graphical items) so you can simply filter them out using the "Filter Tokens" after you transform, or you can deal with them before you even process your document by using the Replace operator.
All comments
Telcontar120
This is likely the artifact of characters that can't be encoded normally (like emojis or other similar graphical items) so you can simply filter them out using the "Filter Tokens" after you transform, or you can deal with them before you even process your document by using the Replace operator.
Quick Links
All Categories
Recent Discussions
Activity
Unanswered
日本語 (Japanese)
한국어(Korean)
Groups
