github-scanner-local

Locally scan all the repositories of a github organization.

Setup

Clone below repositories as same location as github-scanner-local
- gh-crawl
- bash-scripts
Install npm-name-cli globally
Install get-dependencies globally
Install pip-name

$ npm i npm-name-cli -g

$ npm i get-dependencies -g

$ pip install pip-name

$ sh run.sh {GITHUB_ORGANIZATION_NAME}

$ sh runNpmDeps.sh {FOLDER_NAME}

$ sh runPipDeps.sh {FOLDER_NAME}

Uses clone.sh, grepURL.sh and broken.sh

Clones all the repositories of the organanization (Note: It does not clones archived repositories)

Find all the urls from all the repositories of the organization (Searches in the cloned folder) and stores in results directory

Checks all the urls found by grepURL.sh and captures the status code of the URL

ls -d -1 target/* | grep -v target.txt | xargs -I {} sh search.sh {} "{{STRING_TO_SEARCH}}"

grep -r -o "{{STRING_TO_SEARCH}}" target/.

Curated list of utilities required for setting up github repository

Clone (~1000) repos matched to query on GitHub using Search API

orgit is a cli tool for organising and syncing git repositories in a consistent and fast way.

An advanced REST and GraphQL client for the GitHub API.

A collection of tools to perform searches on GitHub.

Clones every repository or gist from a Github user, optionally to a specified directory

GitHub clone repo util

Clone github organization repositories

Crawler for Github repositories. Finds all the broken links from the repositories