Help Center

Configure your Extractor to run multiple URLs

Last Updated: Aug 11, 2016 09:13AM PDT
Once you have created an Extractor, you are more than likely going to want to add multiple URLs to get similar data from other webpages. This could be to capture all pages of a product list (pagination), or to capture other categories or items. You can do this in the Extractor Settings tab on the Dashboard.

There are currently 3 ways you can apply a URL list to your Extractor.

1. Add an explicit list of URLs
2. Create a list based on variable parameters in the URL pattern - URL Generator
3. Use URLs extracted from a second Extractor - Chain

Add an explicit list of URLs

If you have already compiled a list of URLs that you want to run through your Extractor, you can simply paste them into the box. 

We will detect and invalid URLs so you can either validate them, or remove.  

If you have another Extractor you want to use these URLs with, hit the "Download visible URLs" button and you will get a simple text file that you can paste.

Once you hit save, your Extractor will be configured to query all of these URLs when it is run.

Click URL Generator or Chain to discover these options.
seconds ago
a minute ago
minutes ago
an hour ago
hours ago
a day ago
days ago
Invalid characters found