Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

"RM text mining - NLP?"

Just a general question: does RM use also Natural Language Processing based techniques for text mining (in addition to the statistical ones)? If not, are they in the attention of the RM team for development in the near future? Thanks.

Best regards
Dan

Find more posts tagged with

AI Studio

Text Mining + NLP

Accepted answers

All comments

land

Hi Dan,
in fact we started making the needed architectural changes to the Text Processing Extension two weeks ago and once we have this capabilities we will add more and more NLP functionality to the extension.
For example we are planning to allow access to UIMA operations as we are doing for Weka.

Greetings,
Sebastian

dan_agape

Sounds exciting.

Cheers,
Dan

text_miner

Sebastian,

I'm also looking forward to the updated text processing plugin.

Do you have any other information about what will be new/changed for the updated plugin? Any new operators outside of the NLP operators? Also, how extensive are the architectural changes going to be? I've written some operators that make use of the text processing plugin. Is it likely that I will need to update my code when the updated plugin is released? Finally, is there a target date for the release of the updated plugin?

Thanks!

land

Hi,
we are going to clarify the usage of token sequences and texts a little bit. The document should support multiple levels of tokenization in order to not loose information about what sentence the toke belongs to.
Farther in the future there will be support for hierarchical data in attributes to support parse trees. This will come together with some tree kernels for SVM. Might be SVMstruct will be added as well.

If you are missing operators and these operators might be useful for someone else, please tell us your ideas or even share your code. We could then make the functionality available for everybody.

Greetings,
Sebastian