Altair RISE

A program to recognize and reward our most engaged community members

Nominate Yourself Now!

Extract Information

Hi - I'd like to try extract only the company names from this web page https://www.digitalmarketplace.service.gov.uk/g-cloud/search?q=, i.e. the second piece of text in each block. Is Process Documents from the Web, and Extract Information, the most efficient way to do this? And I'm new to Rapidminer and XPath, and wondered if anyone could advise the right XPath query expression to extract only the company name?

Find more posts tagged with

AI Studio

Accepted answers

Telcontar120

I can't help with the XPath query (I find XPath to be very finicky) but the attached process using simple string matching should do the trick. You can also do it with RegEx if you prefer.

get company names.rmp

Telcontar120

Yes, because get pages returns an exampleset rather than a document collection, you may need to add nominal to text and extract document operators as well, and put the subsequent processing inside a loop to iterate over multiple pages.

All comments

Telcontar120

I can't help with the XPath query (I find XPath to be very finicky) but the attached process using simple string matching should do the trick. You can also do it with RegEx if you prefer.

get company names.rmp

carl

Fantastic! Thank you for sending the sample process. So much easier with the string approach.

If I wanted to do that for multiple pages, would I replace Get Page with Read Excel + Get Pages? Seem to then get an error when connecting to Cut Document.

Telcontar120

carl

Thank you. I struggled with the loop approach (will save that for when I've got more adept with Rapidminer), but I have got a working solution by using Read Excel > Get Pages > Data to Documents > Combine Documents > Cut Document.