Community & Support
Learn
Marketplace
Discussions
Categories
Discussions
- General
- Platform
- Academic
- Partner
- Regional
User Groups
Documentation
Events
Altair Exchange
- Share or Download Projects
Resources
Employee Resources
- This tab can be seen by employees only. Please do not share these resources externally.
Groups
- Join a User Group
Support

Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

Home
Discussions
Community Q&A

IDF Calculation for Test Set

Can anyone explain the calculation of IDF value for Test sets?
Is it based on the IDF of Training sets?
I see that test set take only the word list used by the training set and IDF is Calculated solely based on the test set. So, if Test set contain only 1 document, then there is a chance that IDF becomes 0, correct?

Find more posts tagged with

AI Studio

Accepted answers

All comments

fras

If you are using TF-IDF you must store model _and_ wordlist after training.
To test or score unseen data you have to preprocess with exactly the same
"Process Documents"-Operator that you used for training including the wordlist.

smjsmj1

Thank you for the reply

Quick Links

All Categories
Recent Discussions
Activity
Unanswered
日本語 (Japanese)
한국어(Korean)
Groups