How to connect Rapidminer with a database (ScienceDirect, Scopus etc.)?

RMNewbie
RMNewbie New Altair Community Member
edited November 5 in Community Q&A
Hello together. ;)

I'm a total beginner with Rapidminer and I want to use it for my Master-Thesis.
First I would like to describe to you what I want to use Rapidminer for.
Rapidminer is supposed to do a topic modelling for me. The goal is to get a word cloud with the most important topics.
I want to use multiple articles, book chapters etc. from ScienceDirect. I got over 6,000 results in my first search, so it would be impossible to download all of them one by one. Is it possible to create a connection to a database like ScienceDirect?

I hope you can help me. Maybe I'm totally wrong with my approach and Rapidminer won't work like that.

Thank you!

Hannes
Tagged:

Best Answers

  • MartinLiebig
    MartinLiebig
    Altair Employee
    Answer ✓
    Hi there,

    ScienceDirect is not a database in the traditional sense. Usual databases like postgres, mysql etc are of course easily connectable.

    The question at hand here is what the services offer as progammable way to interface with them. If they have a way to connect, we can see what we can do and usually there is a way to read it.
    Best,
  • Caperez
    Caperez Altair Community Member
    Answer ✓
    Hi @RMNewbie,
    What I use to do in this case, is to work with Scopus and export the search results with all the details that I need for my analysis as csv. After that, you can work with RM text processing extenssion to analyze your data.

    best, 

    Cesar

Answers

  • MartinLiebig
    MartinLiebig
    Altair Employee
    Answer ✓
    Hi there,

    ScienceDirect is not a database in the traditional sense. Usual databases like postgres, mysql etc are of course easily connectable.

    The question at hand here is what the services offer as progammable way to interface with them. If they have a way to connect, we can see what we can do and usually there is a way to read it.
    Best,
  • RMNewbie
    RMNewbie New Altair Community Member
    Hey Martin,

    thanks for your answer, it helps me a lot.

    Kind regards,

    Hannes
  • Caperez
    Caperez Altair Community Member
    Answer ✓
    Hi @RMNewbie,
    What I use to do in this case, is to work with Scopus and export the search results with all the details that I need for my analysis as csv. After that, you can work with RM text processing extenssion to analyze your data.

    best, 

    Cesar
  • RMNewbie
    RMNewbie New Altair Community Member
    Hey Cesar,

    thanks for the tip, it sounds great! I will give it a try.

    Best,

    Hannes

Categories