Making easier the text crawling tasks over websites with depth levels.
|PyPI Package latest release| |Code Quality Status| |PyPI Package monthly downloads| |GitHub issues for digs|
::
pip install digs
or
::
pip install --upgrade digs
Common use will be extract the text from a website, the following call from terminal is the way to do that:
::
digs http://thewebsite.com
Also, you can add the option --depth=LEVEL to perform over the root domain (website) a crawling with the specific depth:
::
digs http://thewebsite.com --depth=3
Be careful, with high levels, the tree asociated to those crawlings grows exponentially in size.
And last but not the least, you can turn on a graphical interface (if you have installed PySide) with the following call from terminals:
::
digs -i
It will be look something like this:
|GUI|
Look at requirements in the file: :
::
requirements.txt
digs was written by Jonathan S. Prieto C. <prieto.jona@gmail.com>__.
|Bitdeli badge|
.. |PyPI Package latest release| image:: http://img.shields.io/pypi/v/digs.png?style=flat :target: https://pypi.python.org/pypi/digs .. |Code Quality Status| image:: https://landscape.io/github/d555/digs/master/landscape.svg?style=flat :target: https://landscape.io/github/d555/digs/master .. |PyPI Package monthly downloads| image:: http://img.shields.io/pypi/dm/digs.png?style=flat :target: https://pypi.python.org/pypi/digs .. |GitHub issues for digs| image:: https://img.shields.io/github/issues/d555/digs.svg?style=flat-square :target: https://github.com/d555/digs/issues .. |GUI| image:: https://raw.githubusercontent.com/d555/digs/master/gui.png :target: https://pypi.python.org/pypi/digs .. |Bitdeli badge| image:: https://d2weczhvl823v0.cloudfront.net/d555/digs/trend.png :target: https://bitdeli.com/free
FAQs
Making easier the text crawling tasks over websites with depth levels.
We found that digs demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
pnpm 10 blocks lifecycle scripts by default to improve security, addressing supply chain attack risks but sparking debate over compatibility and workflow changes.
Product
Socket now supports uv.lock files to ensure consistent, secure dependency resolution for Python projects and enhance supply chain security.
Research
Security News
Socket researchers have discovered multiple malicious npm packages targeting Solana private keys, abusing Gmail to exfiltrate the data and drain Solana wallets.