@mintlify/scraping
Advanced tools
Scrape documentation frameworks to Mintlify docs.
mintlify-scrape section [url] - scrapes multiple pages in a sitemintlify-scrape page [url] - scrapes a single page in a siteWe currently support:
The commands will automatically detect the framework.
One time use:
npx @mintlify/scraping@latest section [url]
npx @mintlify/scraping@latest page [url]
GitBook, ReadMe, and Docusaurus sites are rendered with Puppeteer, which is an optional peer dependency. Include it when scraping those sites:
npx -p @mintlify/scraping@latest -p puppeteer mintlify-scrape section [url]
Global installation:
npm install @mintlify/scraping@latest -g
Global usage:
mintlify-scrape section [url]
mintlify-scrape page [url]
Provide the relative path or URL to the OpenAPI file to generate frontmatter files for each endpoint.
mintlify-scrape openapi-file [openApiFilename]
-w, --writeFiles Whether or not to write the frontmatter files [boolean] [default: true]
-o, --outDir The folder in which to write any created frontmatter files [string]
Join our Discord community if you have questions or just want to chat:
Built with 💚 by the Mintlify community.
FAQs
Scrape documentation frameworks to Mintlify docs
The npm package @mintlify/scraping receives a total of 0 weekly downloads. As such, @mintlify/scraping popularity was classified as not popular.
We found that @mintlify/scraping demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 7 open source maintainers collaborating on the project.
Security News
The PHP Foundation says Chainguard broke a security embargo ahead of critical RCE patches, as leaks disrupted the coordinated release.
Security News
PHP releases emergency patches for two critical RCE vulnerabilities as agencies urge organizations to take unpatched sites offline.
Threat Research
/Security News
A supply chain attack compromised LiteLLM 1.107.0 on PyPI and Docker, spreading malware that steals cloud credentials, developer secrets, and AI provider keys.