@qualweb/crawler - npm Package Versions

[0.3.10] - 21/10/2021

Added

• waitUntil option to Crawler constructor. Wait for dom events before preforming the page search. This will make possible to crawl dynamic pages, but the process will be slower.

Updated

• dependencies

Fixed

• known bugs

[0.3.9] - 21/07/2021

Updated

• tsconfig.json file

[0.3.8] - 21/07/2021

Removed

• @types/puppeteer from dev-dependencies

[0.3.7] - 19/07/2021

Fixed

• incorrect urls when href value was not trimmed
• verification for href with "mailto:", "tel:" and "javascript:"

Updated

• dependencies

[0.3.6] - 12/05/2021

Updated

• dependencies

[0.3.5] - 05/05/2021

Removed

• php extension from being excluded during the crawling process

Updated

• dependencies

[0.3.4] - 23/04/2021

Added

• option for BrowserContext in the constructor

Updated

• dependencies

[0.3.3] - 13/04/2021

Added

• viewport options to Crawler class. These options are used when fetching the webpage

Updated

• dependencies

[0.3.2] - 9/04/2021

Added

• timeout option
• more logging

Fixed

• some bugs

[0.3.1] - 02/04/2021

Fixed

• some bugs