@dschnare/chai
Advanced tools
A crawler that grabs the URL, page titles, and first H1 and H2 elements.
Chai is a simple web crawler that scrapes relevant SEO data from each page it visits.
npm install @dschnare/chai -g
chai http://mywebsite.com > crawl.json
Chai will scrape the following data from each page it visits.
The scrape data written to stdout is a JSON array of objects with the
following shape:
{ title, url, headings: { h1: [], h2: [] } }
For URLs that respond with an error the scrape object has this shape:
{ url, statusCode, error }
Where error is the error object returned from Superagent.
FAQs
A crawler that grabs the URL, page titles, and first H1 and H2 elements.
We found that @dschnare/chai demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Create React App is officially deprecated due to React 19 issues and lack of maintenance—developers should switch to Vite or other modern alternatives.
Security News
Oracle seeks to dismiss fraud claims in the JavaScript trademark dispute, delaying the case and avoiding questions about its right to the name.
Security News
The Linux Foundation is warning open source developers that compliance with global sanctions is mandatory, highlighting legal risks and restrictions on contributions.