Community & Support
Learn
Marketplace
Discussions
Categories
Discussions
- General
- Platform
- Academic
- Partner
- Regional
User Groups
Documentation
Events
Altair Exchange
- Share or Download Projects
Resources
Employee Resources
- This tab can be seen by employees only. Please do not share these resources externally.
Groups
- Join a User Group
Support

Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

Home
Discussions
Community Q&A

"Web mining a list of URLs"

Hello,

how can I loop over a list of different URLs and extract the content? The operator Crawl Web has no input but the parameter 'URL'. Is there a way to fill it dynamically using a Loop operator?

Thanks for your attention.

Regards
adommnich

Find more posts tagged with

AI Studio

Web Mining

Accepted answers

All comments

colo

Hi adommnich,

I would use a "Loop Examples" operator for the URL list (if you read it into an example set before). Inside the loop you can easily extract the current URL with "Extract Macro" and use the value for the "Get Page" operator. If you want to crawl and not just retrieve one website you can replace "Get Page" by "Crawl Web".

Regards,
Matthias

adommnich

Hi Matthias,

thanks a lot for your quick reply. I am afraid I wasn' t aware of the Macro concept. :-[

It works fine now.

Regards
Alex

Quick Links

All Categories
Recent Discussions
Activity
Unanswered
日本語 (Japanese)
한국어(Korean)
Groups