Getting Started Main Features Examples

【Flowchart Mode】Application scenario of the loop component

2018-10-15 19:26:53
222 views

Abstract:This tutorial introduces the application scenario of the loop component.

In the tutorial What is a Flow Component and Introduction to the function points of the “Loop” component, we introduce the loop component in the Flowchart Mode of ScrapeStorm. This article mainly describes the application scenario of the loop component in more detail.

1. Extract all list elements on the current web page

If you want to extract all list elements on the current web page, you need to use “Loop  + Extract Data + Save Data” components to complete the scraping task configuration.

The specific use is as follows:

(1) Auxiliary point selection process

If the result of the same element identified by the software is correct and does not need to be modified, you can directly click “Extract all elements” to automatically generate “Loop  + Extract Data + Save Data” components.

(2) Auxiliary point selection process

If the result of the similar element identified by the software does not meet your expectations, you can directly click “Click on the same element to find element list“, then click “Extract all elements” to automatically generate “Loop  + Extract Data + Save Data” components.

(3) Manually drag and drop the process

Drag the required components from below and set them. The connection relationship is as shown in the figure below.

The specific settings are stamped here →_→  Behavior components and Flow components

2. Extract all list elements on the current web page and the details pages they link to

If you want to extract all list elements on the current web page and the details page they link to, you need to use “Loop  + Click Element + Extract Data + Save Data” components to complete the scraping task configuration.

The specific use is as follows:

(1) Auxiliary point selection process

If the result of the same element identified by the software is correct and does not need to be modified, you can directly click “Click on all the elements in turn” to automatically generate “Loop  + Click Element + Save Data” components.

Then drag the “Extract Data” component from below and place it between the “Click Element” component and the “Save Data” component.

Please set the component settings here. →_→ How to use the Extract Data component

(2) Auxiliary point selection process

If the result of the similar element identified by the software does not meet your expectations, you can directly click “Click on the same element to find element list“, then click “Click on all the elements in turn” to automatically generate “Loop  + Click Element + Save Data” components.

Then drag the “Extract Data” component from below and place it between the “Click Element” component and the “Save Data” component.

Please set the component settings here. →_→ How to use the Extract Data component

(3) Manually drag and drop the process

Drag the required components from below and set them. The connection relationship is as shown in the figure below.

The specific settings are stamped here →_→  Behavior components and Flow components

3. Extract list elements on all web pages

If you need to extract the list elements on all web pages, you need to use the page turning function based on the first case above.

The specific use is as follows:

(1) Auxiliary point selection process

If the result of the same element identified by the software is correct and does not need to be modified, you can directly click “Extract all elements” to automatically generate “Loop  + Extract Data + Save Data” components.

Then manually drag the “Loop” component and the “Click element” component from below. Set these two components separately as shown below.

(2) Auxiliary point selection process

If the result of the similar element identified by the software does not meet your expectations, you can directly click “Click on the same element to find element list“, then click “Extract all elements” to automatically generate “Loop  + Extract Data + Save Data” components.

Then manually drag the “Loop” component and the “Click element” component from below. Set these two components separately as shown below.

(3) Manually drag and drop the process

Drag the required components from below and set them. The connection relationship is as shown in the figure below.

The specific settings are stamped here →_→  Behavior components and Flow components

4. Extract all list elements on all web pages and the details pages they link to

If you need to extract the list elements on all web pages and the details pages they link to, you need to use the page turning function based on the second case above.

The specific use is as follows:

(1) Auxiliary point selection process

If the result of the same element identified by the software is correct and does not need to be modified, you can directly click “Click on all the elements in turn” to automatically generate “Loop  + Click Element + Save Data”.

Then drag the “Extract Data” component from below and place it between the “Click Element” component and the “Save Data” component.

Please set the component settings here. →_→ How to use the Extract Data component

Then drag the “Loop” component and the “Click element” component from below. Set these two components separately as shown below.

(2) Auxiliary point selection process

If the result of the similar element identified by the software does not meet your expectations, you can directly click “Click on the same element to find element list“, then click “Click on all the elements in turn” to automatically generate “Loop  + Click Element + Save Data“.

Then drag the “Extract Data” component from below and place it between the “Click Element” component and the “Save Data” component.

Please set the component settings here. →_→ How to use the Extract Data component

Then drag the “Loop” component and the “Click element” component from below. Set these two components separately as shown below.

(3) Manually drag and drop the process

Drag the required components from below and set them. The connection relationship is as shown in the figure below.

The specific settings are stamped here →_→  Behavior components and Flow components

5. Click on the element in turn

If you need to loop through an element on the page, you need to use the “Loop + Click Element” component to complete the scraping task configuration.

The specific use is as follows:

(1) Auxiliary point selection process

If the result of the same element identified by the software is correct and does not need to be modified, you can directly click “Click on all the elements in turn” to automatically generate “Loop  + Click Element + Save Data” components.

(2) Auxiliary point selection process

If the result of the similar element identified by the software does not meet your expectations, you can directly click “Click on the same element to find element list“, then click “Click on all the elements in turn” to automatically generate “Loop  + Click Element + Save Data” components.

(3) Manually drag and drop the process

Drag the required components from below and set them. The connection relationship is as shown in the figure below.

The specific settings are stamped here →_→  Behavior components and Flow components