dude

dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators

AGPL-3.0 License

Downloads
272
Stars
413
Committers
3
View Code on GitHub Visit Website Twitter
Ecosystems: Playwright, Selenium, CSS, Python

Bot releases are hidden (Show)

dude - ⬆️ Update dependencies Latest Release

Published by roniemartinez 8 months ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.27.0...0.28.0

dude - 🔧 Enable Poetry virtualenv

Published by roniemartinez about 1 year ago

What's Changed

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.26.0...0.27.0

dude - 🔥 Drop Python 3.7

Published by roniemartinez over 1 year ago

What's Changed

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.25.1...0.26.0

dude - 🔧 Sort optional dependencies

Published by roniemartinez over 1 year ago

What's Changed

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.25.0...0.25.1

dude - ✨ Follow redirects

Published by roniemartinez over 1 year ago

What's Changed

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.24.0...0.25.0

dude - ✨ Support generator handlers

Published by roniemartinez over 1 year ago

What's Changed

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.23.0...0.24.0

dude - 🔥 Drop Pyppeteer support

Published by roniemartinez over 1 year ago

What's Changed

Breaking change

Other

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.22.0...0.23.0

dude - ⬆️ Update dependencies

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.21.1...0.22.0

dude - 🐛 Fix memory leak

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.21.0...0.21.1

dude - ✨ ChromeDriver version selection

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.20.3...0.21.0

dude - ⬆ Update dependencies

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.20.2...0.20.3

dude - 🐛 Fix helper imports

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.20.1...0.20.2

dude - 💚 Set latest tag in docker/build-push-action

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.20.0...0.20.1

dude - 🐳 Docker image

Published by roniemartinez over 2 years ago

What's Changed

Other

Full Changelog: https://github.com/roniemartinez/dude/compare/0.19.0...0.20.0

dude - ✨ Follow dynamically-built URLs

Published by roniemartinez over 2 years ago

What's Changed

Dependencies

Full Changelog: https://github.com/roniemartinez/dude/compare/0.18.0...0.19.0

dude - ✨ Follow robots.txt rules with option to ignore

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.17.0...0.18.0

dude - ✨ Rename url to url_match and support function/lambda as matcher

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.16.0...0.17.0

dude - ✨ Support custom HTTP methods

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.15.2...0.16.0

dude - 🐛 Fix HTTPX async event hook

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.15.1...0.15.2

dude - ⬆️ Fix dependency gridlock

Published by roniemartinez over 2 years ago

What's Changed

Full Changelog: https://github.com/roniemartinez/dude/compare/0.15.0...0.15.1

Package Rankings
Top 10.64% on Pypi.org
Related Projects
scrapy-playwright

🎭 Playwright integration for Scrapy

10 Nov 2020 862
rebrowser-patches

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps...

06 Aug 2024 173
robotframework-puppeteer

Puppeteer Web testing library for Robot Framework

18 Sep 2019 58
playwright

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and...

15 Nov 2019 66,127
crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In ...

26 Aug 2016 15,235
linkedIn-scraper

A playwright bot which is implemented to scrape linkedin and store advertisement data in a databa...

13 Apr 2023 228
playwright-DOMPath

Retrieve XPath and CSS selectors from elements selected in Playwright

05 Jun 2022 9
webscraping-from-0-to-hero

The web scraping open project repository aims to share knowledge and experiences about web scrapi...

26 May 2022 1,533
hrequests

🚀 Web scraping for humans

06 Jul 2023 648
Visual-Regression-Tracker

Backend and Frontend application for tracking differences via image comparison

09 May 2020 571
crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In ...

26 Aug 2016 15,235
playwright-go

Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a sin...

16 Aug 2020 1,795
pipet

Swiss-army tool for scraping and extracting data from online assets, made for hackers

31 Aug 2024 1,062
stacks

⚛️ Type-safe full-stack framework for Artisans. Develop modern clouds, apps & framework-agnostic ...

26 Apr 2022 520
crawlee-python

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extr...

10 Jan 2024 4,020