Huge News!Announcing our $40M Series B led by Abstract Ventures.Learn More
Socket
Sign inDemoInstall
Socket

webby

Package Overview
Dependencies
Maintainers
1
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

webby

Web Crawler, HTML Parser, and Data Visualization

  • 1.3.0
  • PyPI
  • Socket score

Maintainers
1

! -- Make sure you have downloaded libslt1 and libxml2 in order for lxml to work properly on Linux systems. (Ubuntu at least)

Documentation is under construction right now!

If you have any questions you can email me at

gitwebby@gmail.com

NOW recieved pylint rating of 9.62/10

Webby quickly brings web crawling and xml/html parsing to your fingertips.

Creating Crawlers has never been this easy, feel free to connect to any website and use XPATHs to harvest valuable web data.

Example Setup:

import webby spider = webby.Crawler('http://example.com')

parse = webby.Parser(spider.source) parse.scrape("//p") #Will return all 'p' data tags from html on example.com

#To print out what you just scraped for value in parse.data.itervalues(): print value

Keywords

FAQs


Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

npm

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc