goscrape

Web scraper that can create an offline readable version of a website

MIT License

Stars
174
View Code on GitHub
Ecosystems: Go

Bot releases are visible (Hide)

goscrape - v0.1.1 Latest Release

Published by github-actions[bot] over 1 year ago

Added:

  • proxy configuration support
  • http request timeout configuration support
  • binaries for releases

Fixed:

  • do not abort scraping on error
goscrape - https://github.com/cornelk/goscrape/releases/tag/v0.1.0

Published by cornelk almost 5 years ago

Package Rankings
Top 8.17% on Proxy.golang.org
Badges
Extracted from project README
Build status go.dev reference Go Report Card codecov
Related Projects
scrape

CLI utility to scrape emails from websites

30 Oct 2019 140
jsgo

GopherJS compiler, serving framework and CDN.

16 Jan 2018 271
gohttpserver

The best HTTP Static File Server, write with golang+vue

21 Jul 2016 2,534
cariddi

Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, to...

27 Apr 2021 1,501
geziyor

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

06 Jun 2019 2,602
goverview

goverview - Get an overview of the list of URLs

28 Apr 2020 144
crawdad

Cross-platform persistent and distributed web crawler

20 Jun 2017 61
urlgrab

A golang utility to spider through a website searching for additional links.

02 Jul 2020 327
http-server

A small application with no dependencies to expose a local folder as an HTTP server. It includes ...

12 Jun 2017 76
gospider

Gospider - Fast web spider written in Go

22 Jan 2020 2,356
flyscrape

Flyscrape is a command-line web scraping tool designed for those without advanced programming ski...

28 Aug 2023 1,035