Socket
Socket
Sign inDemoInstall

crawler-toolbox

Package Overview
Dependencies
274
Maintainers
1
Versions
10
Alerts
File Explorer

Advanced tools

Install Socket

Detect and block malicious and high-risk dependencies

Install

    crawler-toolbox

crawler toolbox


Version published
Weekly downloads
3
increased by50%
Maintainers
1
Install size
41.6 MB
Created
Weekly downloads
 

Changelog

Source

1.6.0 (2023-10-05)

Features

  • bump deps (e944dac)

Readme

Source

Intro

Gitpod ready-to-code npm version

a common crawler for webpages

Feature

  • cache support (persistent with sqlite default on /$homedir/crawler.db)
  • markdown support
  • dom operation support (cheerio)

Dev Setup

yarn
yarn start

Test

yarn test

Project generated by gengjiawen/ts-scaffold

Keywords

FAQs

Last updated on 05 Oct 2023

Did you know?

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc