Product
Introducing Ruby Support in Socket
Socket is launching Ruby support for all users. Enhance your Rails projects with AI-powered security scans for vulnerabilities and supply chain threats. Now in Beta!
github.com/danielmensah/webcrawler
This is a simple webcrawler that crawls a given URL as well as visiting the links on the page. This crawler avoids visiting the same URL twice, and any external links are ignored.
These dependencies can also be installed with Homebrew.
brew install go
or
downloaded here.brew install golangci-lint
or
downloaded here.Install dependencies, issue the following command(s):
make install
To run the tests, issue the following command(s):
make test
Run linting only:
make lint
To run the application with the default settings, simply issue the following example command(s):
make run https://example.com/
If you wish to change the default settings, navigate to cmd/main.go
and change the default settings. Here is the list
of settings that can be changed:
retryMax
: The maximum number of times to retry a failed request.retryMaxWait
: The maximum amount of time to wait before retrying a failed request.workers
: The number of concurrent workers to use.FAQs
Unknown package
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Product
Socket is launching Ruby support for all users. Enhance your Rails projects with AI-powered security scans for vulnerabilities and supply chain threats. Now in Beta!
Product
Ensure open-source compliance with Socket’s License Enforcement Beta. Set up your License Policy and secure your software!
Product
We're launching a new set of license analysis and compliance features for analyzing, managing, and complying with licenses across a range of supported languages and ecosystems.