Append url parameter using loop
I'm sure this has been answered somewhere before. I'm using the "Read HTML Tables' operator to scrape a table from a website. However the data is across webpages that end with the page number, such as ?page=2. How do I create a loop that changes the last digit with each step, using the "Loop Parameters" operator?
Find more posts tagged with
Sort by:
1 - 2 of
21
Altair EmployeeHi,
you can use the normal loop, which exposes a macro called iteration. you can then use
...?page=%{iteration}
in your operator and are good to go. %{iteration} will be replaced by 1,2,3,4,5 etc.
Only if you have more complex things to loop over you need to use for example Loop Values and loop over a predefined list of values.
Best,
Martin
Perfect! Thanks much
Sort by:
1 - 1 of
11
Altair EmployeeHi,
you can use the normal loop, which exposes a macro called iteration. you can then use
...?page=%{iteration}
in your operator and are good to go. %{iteration} will be replaced by 1,2,3,4,5 etc.
Only if you have more complex things to loop over you need to use for example Loop Values and loop over a predefined list of values.
Best,
Martin