Readme
Making easier the text crawling tasks over websites with depth levels.
|PyPI Package latest release| |Code Quality Status| |PyPI Package monthly downloads| |GitHub issues for digs|
::
pip install digs
or
::
pip install --upgrade digs
Common use will be extract the text from a website, the following call from terminal is the way to do that:
::
digs http://thewebsite.com
Also, you can add the option --depth=LEVEL to perform over the root domain (website) a crawling with the specific depth:
::
digs http://thewebsite.com --depth=3
Be careful, with high levels, the tree asociated to those crawlings grows exponentially in size.
And last but not the least, you can turn on a graphical interface (if you have installed PySide) with the following call from terminals:
::
digs -i
It will be look something like this:
|GUI|
Look at requirements in the file: :
::
requirements.txt
digs was written by Jonathan S. Prieto C. <prieto.jona@gmail.com>__.
|Bitdeli badge|
.. |PyPI Package latest release| image:: http://img.shields.io/pypi/v/digs.png?style=flat :target: https://pypi.python.org/pypi/digs .. |Code Quality Status| image:: https://landscape.io/github/d555/digs/master/landscape.svg?style=flat :target: https://landscape.io/github/d555/digs/master .. |PyPI Package monthly downloads| image:: http://img.shields.io/pypi/dm/digs.png?style=flat :target: https://pypi.python.org/pypi/digs .. |GitHub issues for digs| image:: https://img.shields.io/github/issues/d555/digs.svg?style=flat-square :target: https://github.com/d555/digs/issues .. |GUI| image:: https://raw.githubusercontent.com/d555/digs/master/gui.png :target: https://pypi.python.org/pypi/digs .. |Bitdeli badge| image:: https://d2weczhvl823v0.cloudfront.net/d555/digs/trend.png :target: https://bitdeli.com/free
FAQs
Making easier the text crawling tasks over websites with depth levels.
We found that digs demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Tea.xyz, a crypto project aimed at rewarding open source contributions, is once again facing backlash due to an influx of spam packages flooding public package registries.
Security News
As cyber threats become more autonomous, AI-powered defenses are crucial for businesses to stay ahead of attackers who can exploit software vulnerabilities at scale.
Security News
UnitedHealth Group disclosed that the ransomware attack on Change Healthcare compromised protected health information for millions in the U.S., with estimated costs to the company expected to reach $1 billion.