Optimize Parameters (Grid) fails when applied to a larger set of data

AO1User: "AO1"
Altair Community Member

Greetings community,

Applying to the collective wisdom to find if anything could be done to help with Optimize Parameters (Grid) applied to a larger set of data/files.

I am using this operator to find an optimal number of topics for LDA and re-run it separately to find optimal number of topic-words, as well.

For finding the number of topics, the process I use runs well for a smaller test-set, it runs every second-third time for a bigger data set and fails applied to the larger data set, I am working on.

To explain, when I try applying it to the smaller number of steps/iterations it works fine for 100 topics and 5 steps, but refuses to work if steps are increased. (for the smaller data sets It works/brings results for 100 topics and 100 steps, as expected)

The process I run is below. Any suggestions are appreciated 😁

Find more posts tagged with

Sort by:
1 - 2 of 21