/EasySpider: Visual Code-Free Web Crawler

A visual browser automation test/data collection/crawler software, which can be used to design and execute tasks in a code-free visual way. You only need to select the content you want to operate on the web page and follow the prompts to complete the design and execution of the task. At the same time, the software can also be executed separately in the command line, so that it can be easily embedded into other systems.

/Download EasySpider

Releases Page

Refer to the Releases Page to download the latest version of EasySpider.

/Sponsors | First Sponsor: CapSolver

Proxy302IPIP$12406500IPProxy302EasySpider

123ProxyIP, 8000+IP190+IP2-4****15%/123ProxyEasySpider

BrightData7200IPIPIP********BrightDataEasySpider

Koala-IPIPIPKoala-IP Koala-IPIP

Capsolver.com is an AI-powered service that specializes in solving various types of captchas automatically. It supports captchas such as reCAPTCHA V2, reCAPTCHA V3, hCaptcha, FunCaptcha, DataDome, AWS Captcha, Geetest, and Cloudflare Captcha / Challenge 5s, Imperva / Incapsula, among others. For developers, Capsolver offers API integration options detailed in their documentation, facilitating the integration of captcha solving into applications. They also provide browser extensions for Chrome and Firefox, making it easy to use their service directly within a browser. Different pricing packages are available to accommodate varying needs, ensuring flexibility for users.

/Official Website

www.easyspider.cn

Visit the official website of EasySpider: www.easyspider.net

/Software Usage Example

1/Example 1

-> -> -> ->

(Right click) Select a large product block -> The software will automatically detect similar blocks -> Click the 'Select All' option -> Click the 'Select Child Elements' option -> Click the 'Collect Data' option, you can collect the information of all products, and will be saved by sub-field.

2/Example 2

(Right Click) Select a product title, the same type of title will be automatically matched, click the 'Select All' option -> Click the 'Collect Data' option, you can collect the title information of all products.

At the same time, if you select the 'Loop-click every element' option after selecting all, you can automatically open the details page of each product, and then can set to collect the information of the details page.

/More Features

More features please scroll to the bottom of this page to view.

/Support Author

EasySpider

Github SponsorSponsor
[email protected]
PayPalnaibowang

You can support the author by clicking the Sponsor button at right side or pay via paypal: naibowang.

/Documentation

Ebayhttps://blog.csdn.net/ihero/article/details/130805504

Documentation can be found from GitHub Wiki.

/Video Tutorials

Bilibili/B:

Refer to Youtube Playlist to see the video tutorials of EasySpider.

/Sample Tasks

Examples0EasySpidertasksEasySpider

Download sample tasks from the Examples folder of this project, rename them to numbers greater than 0, import them into the tasks folder in EasySpider, and then open them in EasySpider.

/Declaration

/********

This software is for learning and communication only. It is strictly forbidden to use the software for any illegal operations, such as crawling government/military websites that are not allowed to be crawled. All consequences caused by the use of this software are at the user's own risk, and the author is not responsible for any consequences.

For the crawler operations of government and military websites, the author will not answer any questions in order to avoid violating relevant national laws, regulations and policies.

[email protected]

Meanwhile, the software is protected by patent rights. If it is used for commercial purposes, such as using the software to make profits, selling the collected data, or integrating the software into your own system, please contact the author by email: [email protected]

QQ

682921940GithubIssueQQQQ

/Publications

This software has been accepted by The Web Conference (WWW) 2023 (CCF A): EasySpider: A No-Code Visual System for Crawling the Web, April 2023.
20225
WEB20206