ilya.app/dor

DOR - Domain Ranker

Fast HTTP service which shows a specified domain rank from following providers:

• Alexa
• Majestic
• Umbrella OpenDNS
• Statvoo
• Open PageRank

Can be used as a base for a domain categorization / network filters / suspicious domain detection.

Data is updated once a day automatically.

Right now only in-memory and MongoDB storages are supported, but Dor was built with flexibility in mind, so you can easily add the storage you like by implementing Storage interface.

Installation

Check out the releases page.

Manual build

dor supports Go 1.9 and later

go get -u github.com/ilyaglow/dor
go install ./...

Web service usage

Use MongoDB storage located at mongoserver and bind to port 8080

DOR_MONGO_URL=mongoserver DOR_PORT=8080 dor-web-mongodb

Fill database with the data

DOR_MONGO_URL=mongoserver go run cmd/dor-insert-mongo/dor-insert-mongo

Or if you want just in-memory database:

dor-web-inmemory -h

Usage of dor-web-inmemory:
  -listen string
    	Listen address to bind (default "127.0.0.1:8080")

Docker usage

Project has docker-compose that uses MongoDB as a storage. Make changes here accordingly if any (folder for data persistence, ports etc).

docker-compose up -d

Client usage

$: curl 127.0.0.1:8080/rank/github.com

{
  "data": "github.com",
  "ranks": [
    {
      "domain": "github.com",
      "rank": 33,
      "last_update": "2018-01-11T18:01:27.251103268Z",
      "source": "majestic"
    },
    {
      "domain": "github.com",
      "rank": 66,
      "last_update": "2018-01-11T18:01:27.97067767Z",
      "source": "statvoo"
    },
    {
      "domain": "github.com",
      "rank": 72,
      "last_update": "2018-01-11T18:04:26.267833256Z",
      "source": "alexa"
    },
    {
      "domain": "github.com",
      "rank": 2367,
      "last_update": "2018-01-11T18:06:50.866600102Z",
      "source": "umbrella"
    },
    {
      "domain": "github.com",
      "rank": 115,
      "last_update": "2018-03-27T17:01:13.535Z",
      "source": "pagerank"
    }
  ],
  "timestamp": "2018-01-11T18:07:09.186271429Z"
}