KITCrawler
Fetch lecture PDFs with ease.
It currently supports crawling PDFs for lectures from the studium.kit.edu page,
but can be easily extended to fetch PDFs from other services.
Requirements
- ruby (>= 1.9, but 1.8 might also be okay)
- bundler (or install the required gems (see
Gemfile
) manually) - linux (with curl, might also work on other Unixes)
Install
Simply run
gem install kitcrawler
to install the gem (it's often a bit behind the repo).
Or run it from source.
git clone https://github.com/parttimenerd/KITCrawler
cd KITCrawler
bundle install
``
Usage
-------------------
Run
kitcrawler add NAME
to add a new fetch job named `NAME`. This will prompt you to pass an entry URL to the site, etc.
To finally run your jobs use
kitcrawler fetch
It also supports some command line parameters, run `kitcrawler` to see an explanation.
License
-------------------
The code is GNU GPL v3 licensed.