Getting Started Main Features Examples

【Smart Mode】How to choose page type and pagination

2018-10-15 19:30:48

Abstract:This tutorial mainly introduces how to set the page type and paging conditions in smart mode.

In Smart Mode, ScrapeStorm will recognize by list-type by default. If you enter a single-page type, a recognition error will occur at this time; or for other reasons, even for list-type pages, intelligent recognition has a bias(we will always optimize the intelligent recognition function). At this point you can manually select the page type and set the pagination to help the software recognize the correct result.

1. Select the page type
The menu location for selecting the page type is shown below.
For a detailed description of the single-type, please click here.
For a detailed description of the list-type, please click here.

2. Pagination settings

The menu position of the pagination setting is as shown below.
Specific settings include:

(1) No Pagination

(2) Auto Detect

(3) Manually Select

(4) Max(-1 is unlimited)

There are several settings in “Manually Select”:

ⅰ: Set Page XPath

Users who are familiar with XPath, by writing XPath, let the software identify the location of the next page button in the web page.

ⅱ: Set Page Button

Click the next page button directly in the web page, the software will identify the location of the button according to the user’s click operation.

ⅲ:Scroll to Load

Suitable for web pages without the next button, the software automatically scrolls the content.

ⅳ: Scroll before Click

It is suitable for webpages that need to be scrolled to display the next page button, or the next page button has been displayed, but the current webpage content has not been displayed yet, and the entire content of the current webpage will be displayed after scrolling and loading.