github.com/liuminhaw/sitemap-helper

sitemap helper

Some sitemap helper functions

• Crawler
• Parser

Install

go get github.com/liuminhawl/sitemapHelper

Crawler

Crawl the given URL and retrieve links within the same domain to generate sitemap content.

Example

See usage example at example crawler

Example build

cd examples/crawler
go build

Example run

Usage: ./crawler [options] <url>
  -depth int
    the maximum number of links deep to traverse (default 3)
  -outputDir string
    directory where result sitemap will be stored (default "sitemaps")
  -render
    indicate if the site need to be rendered to get actual links, useful for SPA site (default false)

Parser

Parse sitemap content and generate a slice of sitemap entries, ready for conversion to XML.

Example

See usage example at example parser

• fileParser
• urlParser

Example build

cd examples/parser/fileParser
# OR
cd examples/parser/urlParser

go build

Example run

File parser

Usage: ./fileParser <filepath>

Url parser

Usage: ./urlParser <url>