@jharris711/crawler

RC Image Crawler

Crawls directories and subdirectories, starting from user provided starting point and OTMM. Searches for images and writes out results to a JSON file. Default starting point for local crawl is the User's home directory.

---

Usage:

Basic (Crawls OTMM && all local directories and subdirectories)

$ npx crawl

With optional flags

$ npx crawl -s <STARTING_POINT> -n <NAME_OF_OUTUT_JSON_FILE> -w <LOCATION_TO_WRITE_JSON_FILE> -c <LOCATION_OF_USERS_OTMM_CONFIG_FILE>

Flags:

• -s/--starting-dir: String/Path
  • The desired starting directory. Crawler will go through every directory and subdirectory from this point.
  • Default: ~ (Users Home directory)
• -c/--config: String/Path
  • Location of the user's OTMM config file.
  • Deafult: ./ (Current Directory)
• -n/--name-output: String
  • Desired name for the resulting JSON file with image data.
  • Default: ingest
• -w/--write-to: String/Path
  • Where the user would like the resulting JSON file to be written.
  • Deafult: ./ (Current Directory)