github.com/yurii-vyrovyi/sitemap-generator
sitemap-generator is a tool for sitemaps generating (obviously).
sitemap-generator <url> [-parallel=...] [-output-file=...] [-max-depth=...]
url an url of website you want to build sitemap of
optional
-parallel= number of parallel workers to navigate through site
-output-file= output file path
-max-depth= max depth of url navigation recursion
A protocol description could be found here.
It was created as a test task. While it works in general and shows approaches there are several weak points that need to be improved to make this sitemap generator a real tool:
FAQs
Unknown package
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
OpenSSF has published OSPS Baseline, an initiative designed to establish a minimum set of security-related best practices for open source software projects.
Security News
Michigan TypeScript founder Dimitri Mitropoulos implements WebAssembly runtime in TypeScript types, enabling Doom to run after processing 177 terabytes of type definitions.
Security News
vlt's new "reproduce" tool verifies npm packages against their source code, outperforming traditional provenance adoption in the JavaScript ecosystem.