Web Scraping - dynamic content
Hello folks,
we're trying to create a Text Mining project for our university class. Our goal is to scrape the data of our university courses description and look up Udemy for best matching courses. So far so good, now I realized that a saved HTML file of an Udemy course is missing relevant information like the "price" tag. Do you have an idea how to scrape those missing information?
Best regards
Patrick
we're trying to create a Text Mining project for our university class. Our goal is to scrape the data of our university courses description and look up Udemy for best matching courses. So far so good, now I realized that a saved HTML file of an Udemy course is missing relevant information like the "price" tag. Do you have an idea how to scrape those missing information?
Best regards
Patrick
Find more posts tagged with
Sort by:
1 - 2 of
21
To save you time and effort I recommend you could use Parsehub to build the scraper for Udemy.
Instructions to use it are really simple and the free version allows you to pull in 200 pages per run (should be enough for your task, but you can also contact them to ask about their academic program.
Best of all when you build your scraper it has a RestAPI which means you can then call it from your RapidMiner process and get the results back directly.
Thank you that solved it!
Sort by:
1 - 1 of
11
To save you time and effort I recommend you could use Parsehub to build the scraper for Udemy.
Instructions to use it are really simple and the free version allows you to pull in 200 pages per run (should be enough for your task, but you can also contact them to ask about their academic program.
Best of all when you build your scraper it has a RestAPI which means you can then call it from your RapidMiner process and get the results back directly.