scrapper

• fix: handle empty strings in levenshtein_similarity to avoid division by zero
• feat(parser): include zero and one pixel elements in hidden checks
• feat(parser): add comment removal functionality to article parser
• feat(htmlutil): add text content improvement function
• fix: remove 'media' from negative regex to prevent image removal in Readability.js

• fix: remove fixed width from code elements in custom.css
• feat(htmlutil): expand tag checks in content improvement function

• add support for fetching any web page
• add support for the device parameter to simulate specific device behaviors
• deprecate explicit viewport-width, viewport-height, screen-width, and screen-height in favor of using the device parameter

BREAKING CHANGE: Default values for viewport-width, viewport-height, screen-width, and screen-height have been removed. Users should now use the device parameter to specify device-specific behaviors.

• add Docker health check features
• fix parser for extra HTTP headers
• display app version in API, documentation, and UI
• rename user_data_dir to user_dir for clarity
• add browser context limit
• refactor test script for clarity
• add Pylint for code linting
• add HTTPS and authentication deployment instructions

• update dependencies: Playwright and Readability (0.5.0)
• move backend from flask to fastapi (use async)
• switching to uvicorn from gunicorn
• fix some errors
• add tests

Added --user-scripts-timeout parameter

fix http404 error

• extract social meta tags (open graph, twitter)
• new request parameter: headless
• new request parameter: scroll-down

add page URL after redirects

add link parser

fix some errors

modular project structure

fix error: cannot take screenshot larger than ...

first public release