Append url parameter using loop

ecdbert

I'm sure this has been answered somewhere before.  I'm using the "Read HTML Tables' operator to scrape a table from a website.  However the data is across webpages that end with the page number, such as ?page=2.  How do I create a loop that changes the last digit with each step, using the "Loop Parameters" operator?

MartinLiebig

Hi,

you can use the normal loop, which exposes a macro called iteration. you can then use

...?page=%{iteration}

in your operator and are good to go. %{iteration} will be replaced by 1,2,3,4,5 etc.

Only if you have more complex things to loop over you need to use for example Loop Values and loop over a predefined list of values.

Best,

Martin

MartinLiebig

Hi,

you can use the normal loop, which exposes a macro called iteration. you can then use

...?page=%{iteration}

in your operator and are good to go. %{iteration} will be replaced by 1,2,3,4,5 etc.

Only if you have more complex things to loop over you need to use for example Loop Values and loop over a predefined list of values.

Best,

Martin

ecdbert

Perfect!  Thanks much