Overfitting - Sentiment Analysis
Hi together,
I am not very experienced. I did use the sentiment template and created a model with about 83 % accuracy. But the model does not predict the sentiments of my unseen data well. The confidence average is about 50 to 60% only. What can I do to get a model which generalizes better? And is there an opportunity to compare my labeled data with the unlabeled data to see if the bad confidence is really so so bad.
my training data is balanced about 1000 positive / 1000 negative. And I applied the model to about 100 unlabeled data.
Thank you very much for your help Silke
I am not very experienced. I did use the sentiment template and created a model with about 83 % accuracy. But the model does not predict the sentiments of my unseen data well. The confidence average is about 50 to 60% only. What can I do to get a model which generalizes better? And is there an opportunity to compare my labeled data with the unlabeled data to see if the bad confidence is really so so bad.
my training data is balanced about 1000 positive / 1000 negative. And I applied the model to about 100 unlabeled data.
Thank you very much for your help Silke