Deep web scanning done right
To scan a list of onion sites and output it to a file:
./redonion -list=./sample/short_list.txt > output.json
Fetchers fetch data from a list of onion sites.
/fetchers/fetch.go
) will get all the HTML data from aProcessors make transformations on the input data. The input data may come from fetchers or from other processors.
text: (/processors/text.go
) pass-through processor which will pass the
output content from input channel to output channel.
image: (/processors/image.go
) fetches all website images and inspects
various types of metadata
Contributions for new fetchers, processors and outputs welcome.
gpestana MIT