Description

• This program uses Python to clone/maintain multiple security related repos using threading and multiprocessing

Goal

• The goal of this program is to quickly pull and install repos from its list

Use cases

• Quickly install your favorite Security repos on a new system
  
• Kick off multiple concurrent git clone tasks utilizing Python
  
• Add remove repos to the worker_data list as needed in order to address indivudual use case/project needs
  

Requirements

• This program was tested with Python version 3.7.2 64-bit
  
• Ensure the Python3 virtual environment package is installed (Ubuntu)
  sudo apt-get install python3-venv
  
• Ensure git is installed (Ubuntu)
  sudo apt-get install git
  

Usage Option 1 Automatic (Docker)

• Clone code repo
  git clone https://github.com/tbalz2319/RapidRepoPull.git
  
• Change directory into RapidRepoPull
  cd RapidRepoPull
  
• The script will run in a minimal Alpine Docker container (126 MB) and extract the dirs in the current working dir
  docker-compose up --build
  

Usage Option 2 Local Install

• Clone code repo
  git clone https://github.com/tbalz2319/RapidRepoPull.git
  
• Change directory into RapidRepoPull
  cd RapidRepoPull
  
• Execute the script below
  ./install.sh
  

Usage Option 3 Manual

• Clone code repo
  git clone https://github.com/tbalz2319/RapidRepoPull.git
  
• Change directory into RapidRepoPull
  cd RapidRepoPull
  
• Create a virtual Python3 environment to run this code
  python3 -m venv venv
  
• Activate the virual enivornment
  source venv/bin/activate
  
• Install requirements
  pip install -r requirements.txt
  
• Run program
  python3 rapid.py
  

Update Program

• Run the following script
  ./update.sh
  

Mass Update all existing repos

• Run the command to maintain all existing repos by attempting to pull latest version
  ./update_repos.sh