Download and Sign Up
Get a $5 Coupon For Free
Getting Started Main Features

【Smart Mode】Basic operational procedures | Web Scraping Tool | ScrapeStorm

2019-10-14 14:22:16

Abstract:This tutorial demonstrates the basic operational procedures of Smart Mode. ScrapeStormFree Download

In the Smart Mode, the user enters the correct URL and runs according to the rules automatically configured by the system or the rules configured by the user, which can extract the required data. This tutorial demonstrates the basic operation flow of the smart mode.

1. Enter the correct URL
Copy the URL you want to scrape in the browser and open the ScrapeStorm smart mode and paste URL to create a new scraping task.
Click here to learn more about how to enter the correct URL.

2. Select page type and set the pagination
After selecting the URL to extract, we select the page type and what we need to extract and set the pagination.

The page types can be divided into two categories, one is single-type page (details page), the other is list-type page, and the Smart Mode is suitable for extracting the contents of single-type page (details page), list-type page, list-type page & details page.

After the page type is determined, we can set the pagination. The smart mode can identify 99% of the page type. The user can directly perform data scraping, but in the case of system identification error, the page can be set manually.

Click on the link below to learn more:

How to scrape a single-type web page

How to scrape a list-type web page

How to scrape a list-type page & details page

3. Scrape the content that needs to be logged in to view
In the process of data scraping, we sometimes encounter webpages that need to log in to view the content. At this time, we need to use the pre-login function to log in to the webpage and then perform normal data scraping.
Click here to learn more about how to log in to the web page.

4. Switch browser mode
In the process of data scraping, the data scraping effect of different browser modes is different. We can improve the effect by switching browsers, but not every webpage is suitable for this operation. Users need to judge whether to use this function according to the actual situation.
Click here to learn more about how to switch browser mode.

5. Set the extraction field
After entering the URL, the system will automatically identify the URL and set the extraction field. The user can directly use this field for data scraping, or you can set the field to extract.
Click here for more ways to set up the extracted fields.

6. Run Settings
After the extraction field is set, the scraping task can be set. The user can use the system default settings or set the scraping task by himself.
Click here to learn more about Run Settings.

(1) Schedule
Ordinary users can choose to start scraping data at a fixed point in time. In addition to allowing users to select data at a fixed time, Professional Plan and above users can also continuously scrape data in a fixed period(Please keep it turned on).
Click here to learn more about Schedule.

(2) Anti-Block

Users can achieve anti-block through a variety of settings.

Click here to learn more about Anti-Block.

(3) Automatic Export
Professional Plan and above users can use Automatic Export to export data while running data. It is not necessary to wait until the end of the task to export the data, and Automatic Export with Schedule function, which can greatly save time and improve efficiency.
Click here to learn more about Automatic Export.

(4) Download images
If the user needs to scrape the image on the web page to the local, you can use the download image feature to complete this requirement.
Click here to learn more about Download Images.

(5) Speed Boost

Premium users can use this feature to speed up the task’s scraping speed.

Click here to learn more about Speed Boost.

7. View the extraction results and export data
After the task is set, the user can view the extraction result and export the data.
Click here for more ways to view the results of the extraction and export the data.