Scraper to download all the material from Chamilo for the UGA. The script downloads all files from the Chamilo platform and creates the required directories on the fly.
To run this script, Python 3.7 or higher is required. The libraries needed are mechanize and beautifulsoup.
To get the help message run main.py -h
usage: main.py [-h] [-d DIR] [-u USERNAME] [-p PASSWORD]
UGA Chamilo scraper
optional arguments:
-h, --help show this help message and exit
-d DIR, --dir DIR Directory to download all courses. Defaults to the current directory.
-u USERNAME, --username USERNAME
Username
-p PASSWORD, --password PASSWORD
Password
Both the user and password are needed to login into Chamilo. If they are not provided through as arguments with the -u and -p, the user will be prompted for them.
The password is not echoed back for security purposes.
Note that the files will be downloaded to the current directory. To download all documents to another folder pass it through the -d argument. The path can be relative or absolute.
On most linux systems, Python 3.7 comes pre-installed. If it is not installed, use the package manager to install both python3 and pip3. To install the dependencies:
pip install -r requirements.txt
To install the dependencies on MacOS:
xcode-select --install
/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
brew install python3
python3 get-pip.py
pip3 install --user -r requirements.txt
This script is under MIT license.