Huge News!Announcing our $40M Series B led by Abstract Ventures.Learn More
Socket
Sign inDemoInstall
Socket

crawlee

Package Overview
Dependencies
Maintainers
10
Versions
1225
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

crawlee - npm Package Versions

1
123

3.0.3-beta.1

Diff

b4nan
published 3.0.3-beta.0 •

b4nan
published 3.0.2 •

Changelog

Source

3.0.2 (2022-07-28)

Fixes

  • regression in resolving the base url for enqueue link filtering (1422)
  • improve file saving on memory storage (1421)
  • add UserData type argument to CheerioCrawlingContext and related interfaces (1424)
  • always limit desiredConcurrency to the value of maxConcurrency (bcb689d)
  • wait for storage to finish before resolving crawler.run() (9d62d56)
  • using explicitly typed router with CheerioCrawler (07b7e69)
  • declare dependency on ow in @crawlee/cheerio package (be59f99)
  • use crawlee@^3.0.0 in the CLI templates (6426f22)
  • fix building projects with TS when puppeteer and playwright are not installed (1404)
  • enqueueLinks should respect full URL of the current request for relative link resolution (1427)
  • use desiredConcurrency: 10 as the default for CheerioCrawler (1428)

Features

  • feat: allow configuring what status codes will cause session retirement (1423)
  • feat: add support for middlewares to the Router via use method (1431)
b4nan
published 3.0.2-beta.15 •

b4nan
published 3.0.2-beta.14 •

b4nan
published 3.0.2-beta.13 •

b4nan
published 3.0.2-beta.12 •

b4nan
published 3.0.2-beta.11 •

b4nan
published 3.0.2-beta.10 •

b4nan
published 3.0.2-beta.9 •

SocketSocket SOC 2 Logo

Product

  • Package Alerts
  • Integrations
  • Docs
  • Pricing
  • FAQ
  • Roadmap
  • Changelog

Packages

npm

Stay in touch

Get open source security insights delivered straight into your inbox.


  • Terms
  • Privacy
  • Security

Made with ⚡️ by Socket Inc