Getting Started Main Features Examples

【Smart Mode】How to extract a list page & detail page

2019-01-30 11:02:47

Abstract:This tutorial shows you how to extract the data from the list-type page & details page in this case. No Programming Needed. Visual Operation. ScrapeStormFree Download

When we use the web data extractor, sometimes we don’t just extract only one page type of data, but we need to extract the data on the list page as well as the data on the details page.

This tutorial shows you how to extract the data from a list-type page & details page in this case.

1. Scrap the contents of the list page

Click here to see how to scrape the page of the list type.

2. Scrape into
In the first step, the software will identify the link in the list content. Here we select the link field to be scraped (that is, the link to the detail page), click on “Scrape Into” or right click on the field and select “Scrape Into“.

At this point, the detail page corresponding to the first link will pop up in the software, and we will set the fields from the detail page.

There are three ways to use “Scrape Into”:

(1) Click “Scrape Into” directly. This method is applicable to the case where there is only one link in the field.

(2) Select the link you want to scrape, and then click “Scrape Into”.

(3) Click the link directly to the detail page.

Tips: The collection of the detail page is the same as the single-type web page. For details, please check →_→ How to scrape a single-type web page.

3. Start scraping task

After the field is set, start extracting data. The fields to be extracted set in the details page will be automatically extracted after the fields set on the list page.

Click here to see how to configure the scraping task.