Optimize Parameters (Grid) fails when applied to a larger set of data
Greetings community,
Applying to the collective wisdom to find if anything could be done to help with Optimize Parameters (Grid) applied to a larger set of data/files.
I am using this operator to find an optimal number of topics for LDA and re-run it separately to find optimal number of topic-words, as well.
For finding the number of topics, the process I use runs well for a smaller test-set, it runs every second-third time for a bigger data set and fails applied to the larger data set, I am working on.
To explain, when I try applying it to the smaller number of steps/iterations it works fine for 100 topics and 5 steps, but refuses to work if steps are increased. (for the smaller data sets It works/brings results for 100 topics and 100 steps, as expected)
The process I run is below. Any suggestions are appreciated 😁
Answers
-
Would not allow me to insert the process, file attached
0 -
additional forum browsing shows that this problem has been reported before.
Could anyone confirm that it is correct to highlight that the problem is in the local machine/PC I use for analysis?
0