playwright-spider-utils

Playwright Spider Utils is a utility library for engineers using the Playwright framework to build web crawlers. This project provides common web scraping functions, simplifying the process of crawler development and enhancing productivity.

MIT License

Stars
0
Committers
1
View Code on GitHub
Ecosystems: Python, Selenium, Playwright

playwright-spider-utils

Playwright Spider Utils is a utility library for engineers using the Playwright framework to build web crawlers. This project provides common web scraping functions, simplifying the process of crawler development and enhancing productivity.

Related Projects
rebrowser-patches

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps...

06 Aug 2024 173
hive

lots of spider (很多爬虫）

06 Nov 2017 115
dyatel

Wrapper tool of Selenium/Appium/Playwright libraries to test web applications in a single project...

17 Jun 2022 8
Scrape-AI

Scrape-AI is a Python library for intelligent web scraping using LLMs like, OpenAI, Anthropicand ...

08 Sep 2024 1
seleniumcrawler

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to c...

26 Aug 2013 127
playwright-go

Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a sin...

16 Aug 2020 1,795
splinter

splinter - python test framework for web applications

18 Sep 2010 2,691
beachpatrol

A CLI tool to replace and automate your everyday web browser.

27 Dec 2023 38
Assistive-Webdriver

Assistive-Webdriver is a tool to automate end-to-end web application tests with a screen reader.

02 Mar 2020 25
souper-scraper

A simple web scraper base that combines BeautifulSoup and Selenium to scrape dynamic websites.

18 Mar 2024 2
scrapy-selenium

Scrapy middleware to handle javascript pages using selenium

11 Feb 2018 918
web_scraper_challenge

Web scraper I did for interview. Now, contributions welcome!!

10 Aug 2024 0
tarsier

Vision utilities for web interaction agents 👀

09 Nov 2023 1,394
dude

dude uncomplicated data extraction: A simple framework for writing web scrapers using Python deco...

14 Feb 2022 413
rebrowser-bot-detector

Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and ...

16 Sep 2024 10