skraper

Kotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, Coub, Vimeo, IFunny, VK, Odnoklassniki, Pikabu)

APACHE-2.0 License

Stars
252
Committers
9

Bot releases are hidden (Show)

skraper - 0.13.0 Latest Release

Published by sokomishalov 10 months ago

What's Changed

New Contributors

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.12.1...0.13.0

skraper - 0.12.1

Published by sokomishalov about 1 year ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.12.0...0.12.1

skraper - 0.12.0

Published by sokomishalov over 1 year ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.11.1...0.12.0

skraper - 0.11.1

Published by sokomishalov over 1 year ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.11.0...0.11.1

skraper - 0.11.0

Published by sokomishalov about 2 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.10.0...0.11.0

skraper - 0.10.0

Published by sokomishalov about 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.9.2...0.10.0

skraper - 0.9.2

Published by sokomishalov over 2 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.9.1...0.9.2

skraper - 0.9.1

Published by sokomishalov over 2 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.9.0...0.9.1

skraper - 0.9.0

Published by sokomishalov over 2 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.4...0.9.0

skraper - 0.8.4

Published by sokomishalov over 2 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.3...0.8.4

skraper - 0.8.3

Published by sokomishalov over 2 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.2...0.8.3

skraper - 0.8.2

Published by sokomishalov almost 3 years ago

What's Changed

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.1...0.8.2

skraper - 0.8.1

Published by sokomishalov almost 3 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/sokomishalov/skraper/compare/0.8.0...0.8.1

skraper - 0.8.0

Published by sokomishalov about 3 years ago

  • getPosts and extensions for it should return Flow<Post>and be paginable.
  • add statistics field to Post, which includes likes, reposts, views and comments amount fields.
  • add statistics field to PageInfo, which includes posts, followers and following amount fields.
  • remove baseUrl from Skraper interface
  • provide UnknownMedia type
  • various extraction fixes

Full changelog

skraper - 0.7.0

Published by sokomishalov over 3 years ago

Changelog:

  • tiktok implemented
  • telegram implemented
  • instagram: hashtag posts + some improvements
  • clients rework
  • post's publishedAt is an instance of Instant
  • migrate tests to junit 5
  • page info refactoring: covers and avatars are single-imaged now
  • maven central distribution
  • some refactoring
  • dependency upgrades
skraper - 0.6.3

Published by sokomishalov almost 4 years ago

skraper - 0.6.2

Published by sokomishalov almost 4 years ago

  • Youtube fix
  • bump versions
skraper - 0.6.1

Published by sokomishalov almost 4 years ago

Add postCount and followerCount for Pinterest (https://github.com/sokomishalov/skraper/pull/92)
Bump deps

skraper - 0.6.0

Published by sokomishalov about 4 years ago

Changelog:

  • bump kotlin to 1.4.0 and other dep upgrades
  • fixes #76
  • fixes #77
skraper - 0.5.1

Published by sokomishalov about 4 years ago

Package Rankings
Top 23.7% on Repo1.maven.org
Badges
Extracted from project README
Awesome Kotlin Badge Apache License 2
Related Projects