A collection of self-using anime-related crawlers.
A collection of self-using anime-related crawlers.
Supported sites:
.. code-block::
.
├── Pipfile # Python package management
├── README.rst
├── Pipfile.lock
├── scrapy.cfg # scrapy config file
├── anime_spiders # Spiders
├── manage.py # Django manage.py
├── exhibition # Django backend application
├── db.sqlite3
├── package.json # Frontend package management
├── package-lock.json
├── node_modules # Frontend dependencies
├── index.html # index.html of frontend
├── src # Frontend application source
├── build # Frontend build
├── config # Frontend code build configs
├── dist # Distribution code of frontend
└── static # Frontend related static files
npm run dev
;./manage.py runserver
;192.168.2.10
;pipenv install && pipenv install --dev && pipenv shell
;scrapy crawl [spider_name]
;Use yapf
to format Python code::
yapf -irp -e "./.venv/**" -e "**/migrations/**" **/**.py
Only scrapy commands supported for now.
You can use it as normal scrapy.Spider of course.
Not supported yet.