x-crawl

x-crawl is a flexible Node.js AI-assisted crawler library. Making crawler work more efficient, intelligent and convenient. ------ x-crawl 是一个灵活的 Node.js AI 辅助爬虫库。使爬虫工作变得更加高效、智能和便捷。(v10 版本已发布)

MIT License

Downloads
762
Stars
829
Committers
4

Bot releases are hidden (Show)

x-crawl - v5.0.1

Published by coder-hxl over 1 year ago

🚀 Features

  • New adjustments to the document.

🚀 特征

  • 文档新的调整。
x-crawl - v4.0.1

Published by coder-hxl over 1 year ago

🐞 Bug Fixes

  • The page is not closed when there is an error in the crawlPage API
x-crawl - v4.0.0

Published by coder-hxl over 1 year ago

🚨 Breaking Changes

  • The crawlPage API can add batch requests.
  • The crawlPage API remove JSDOM.

🚀 Features

  • Document updates.
x-crawl - v3.3.0

Published by coder-hxl over 1 year ago

🚀 Features

  • The crawlerPage API crawling page allows to carry Cookies (for login and other operations).
x-crawl - v3.2.12

Published by coder-hxl over 1 year ago

🐞 Bug Fixes

  • Document jump fix
x-crawl - v3.2.11

Published by coder-hxl over 1 year ago

🚀 Features

  • Test updates, unit test all APIs

🐞 Bug Fixes

  • Fix crawlPage API internal error
x-crawl - v3.2.10

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.9

Published by coder-hxl over 1 year ago

🚀 Features

  • Update dependency
x-crawl - v3.2.8

Published by coder-hxl over 1 year ago

🐞 Bug Fixes

  • Internal type adjustment.
  • Catch crawlPage API errors.
x-crawl - v3.2.7

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.6

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.5

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.4

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.3

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.2

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.1

Published by coder-hxl over 1 year ago

🚀 Features

  • Update documents
x-crawl - v3.2.0

Published by coder-hxl over 1 year ago

🚀 Features

  • crawlPage API return value update

🐞 Bug Fixes

  • The result page of crawlPage API reported an error. Expose the browser and let the user decide to close the browser
x-crawl - v3.1.1

Published by coder-hxl over 1 year ago

🐞 Bug Fixes

  • publish type is missing
x-crawl - v3.1.0

Published by coder-hxl over 1 year ago

🚀 Features

  • The callback function adds a stopPolling parameter, which can be called to stop subsequent polling operations. The stop polling of the startPolling API is determined by the user
  • Update documents
x-crawl - v3.0.0

Published by coder-hxl over 1 year ago

🚨 Breaking Changes

  • The three APIs fetchPage, fetchData, and fetchFile are renamed to crawlPage, crawlData, and crawlFile respectively

🚀 Features

  • Multiple ways of writing requestConfig options
  • All types are exposed