You will need pnpm, Poetry installed and Postgres running locally
> pnpm
> pnpm run watch
In another tab
> poetry install
> poetry run uvicorn orflaedi.main:app --reload
Drop into a Fish shell in the Docker
docker compose up --build -d
docker exec -it db1eead29953 fish
Use something like this for black formating in a .vscode/settings.json
file.
{
"python.formatting.provider": "black",
"editor.formatOnSave": true,
"python.formatting.blackArgs": ["--line-length=100"]
}
This project scrapes Icelandic e-bike retailer websites
TODO
Vehicles can be browsed on these dimensions
In the future it would be good to connect vehicles to electribikereview.com to get frame types, purpose (gravel, city, cargo etc.). I scraped the bike brand name too. Could add a filter for that to the UI.
The project is hosted on Render on www.orflaedi.is
. There is a Scrapy spider
for each of the retailer websites that is run a few times a day.
> poetry export --without-hashes -f requirements.txt > requirements.txt
> NODE_ENV=production yarn run build
Next add a commit and push. It will autodeploy.
Images are served via imgix proxy (all bike images are references to the external URL, never persisted locally).