Getting Started Main Features Examples

【Smart Mode】How to extract a list page & detail page

2018-11-07 10:30:44
512 views

Abstract:This tutorial shows you how to extract the data from the list-type page & details page in this case.

When we use the web data extractor, sometimes we don’t just extract only one page type of data, but we need to extract the data on the list page as well as the data on the details page.

This tutorial shows you how to extract the data from a list-type page & details page in this case.

1. Scrap the contents of the list page

Click here to see how to scrape the page of the list type.

 

2. Scrape into
In the first step, the software will identify the link in the list content. Here we select the link field to be scraped (that is, the link to the detail page), click on “Scrape Into” or right click on the field and select “Scrape Into“.

At this point, the detail page corresponding to the first link will pop up in the software, and we will set the fields from the detail page.

Tips: The collection of the details page is the same as the single-type web page. For details, please check →_→ How to scrape a single-type web page.

3. Start scraping task

After the field is set, start extracting data. The fields to be extracted set in the details page will be automatically extracted after the fields set on the list page.

Click here to see how to configure the scraping task.