WebMole is a powerful web scraping tool built in Ruby. It allows you to crawl websites and extract various types of information such as emails, phone numbers, URLs, social media handles, addresses, and more.
Add this line to your application's Gemfile:
gem 'webmole'
And then execute:
$ bundle install
Or install it yourself as:
$ gem install webmole
To use WebMole, run the following command:
webmole -u https://example.com -s emails -d 2
This will crawl https://example.com to a depth of 2 and extract all email addresses found.
For more options, run:
webmole --help
After checking out the repo, run bin/setup to install dependencies. Then, run rake spec to run the tests. You can also run bin/console for an interactive prompt that will allow you to experiment.
To install this gem onto your local machine, run bundle exec rake install.
Bug reports and pull requests are welcome on GitHub at https://github.com/yourusername/webmole.
The gem is available as open source under the terms of the MIT License.
FAQs
Unknown package
We found that webmole demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Bybit's $1.46B hack by North Korea's Lazarus Group pushes 2025 crypto losses to $1.6B in just two months, already surpassing all of 2024's $1.49B total.
Security News
OpenSSF has published OSPS Baseline, an initiative designed to establish a minimum set of security-related best practices for open source software projects.
Security News
Michigan TypeScript founder Dimitri Mitropoulos implements WebAssembly runtime in TypeScript types, enabling Doom to run after processing 177 terabytes of type definitions.