wg-gesucht-crawler-cli
Advanced tools
Python web crawler / scraper for WG-Gesucht. Crawls the WG-Gesucht site for new apartment listings and send a message to the poster, based off your saved filters and saved text template.
.. image:: https://img.shields.io/travis/grantwilliams/wg-gesucht-crawler-cli.svg :target: https://travis-ci.org/grantwilliams/wg-gesucht-crawler-cli
.. image:: https://img.shields.io/pypi/v/wg-gesucht-crawler-cli.svg :target: https://pypi.python.org/pypi/wg-gesucht-crawler-cli
.. image:: https://readthedocs.org/projects/wg-gesucht-crawler-cli/badge/?version=latest :target: https://wg-gesucht-crawler-cli.readthedocs.io/en/latest/?badge=latest :alt: Documentation Status
Python web crawler / scraper for WG-Gesucht. Crawls the WG-Gesucht site for new apartment listings and send a message to the poster, based off your saved filters and saved text template.
::
$ pip install wg-gesucht-crawler-cli
Or, if you have virtualenvwrapper installed::
$ mkvirtualenv wg-gesucht-crawler-cli
$ pip install wg-gesucht-crawler-cli
Can be run directly from the command line with::
$ wg-gesucht-crawler-cli --help
Or if you want to use it in your own project:
.. code-block:: python
from wg_gesucht.crawler import WgGesuchtCrawler
Just make sure to save at least one search filter as well as a template text on your wg-gesucht account.
Getting Caught with reCAPTCHA
I've made the crawler sleep for 5-8 seconds between each request to try and avoid their reCAPTCHA, but if the crawler does get caught, you can sign into your wg-gesucht account manually through the browser and solve the reCAPTCHA, then start the crawler again.
If it continues to happen, you can also increase the sleep time in the :code:get_page() function in :code:wg_gesucht.py
Pre-release
FAQs
Python web crawler / scraper for WG-Gesucht. Crawls the WG-Gesucht site for new apartment listings and send a message to the poster, based off your saved filters and saved text template.
We found that wg-gesucht-crawler-cli demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Research
An advanced npm supply chain attack is leveraging Ethereum smart contracts for decentralized, persistent malware control, evading traditional defenses.
Security News
Research
Attackers are impersonating Sindre Sorhus on npm with a fake 'chalk-node' package containing a malicious backdoor to compromise developers' projects.
Security News
The npm package for the LottieFiles Player web component was hit with a supply chain attack after a software engineer's npmjs credentials were compromised.