@dynrl/data-slammer

Data Slammer

Utility to grab data from google search results and return it in a consumable format.

Install

With npm:

npm install pdfslammer

Or with yarn

yarn add pdfslammer

Usage

See tests for example usage. Tests expect that google api key's are provided in $PROJECT_ROOT/googleapiconfig.json. In order to get these keys, you will need to generate your own google service apiKey and custom search engine and provide them in to the slammer. To do so visit https://cse.google.com/cse/all and https://console.developers.google.com/projectcreate.

Test

npm install
npm test

Accessing as an Azure Function

This code is deployed to an azure function and can be accessed via an http request. For example sending a get request to, https://drl-dataslammer.azurewebsites.net/api/slam?code=xIp8xM1jwff61BiT4w3BSlN9LqbJDGrf7sc5F9sFf4allopEv6Wycg==&pn=bav99&mf=vishay, should return a response similar to:

{
  "query": "https://www.googleapis.com/customsearch/v1?key=AIzaSyCZRFIa6FYwFyZhpoOhUooJu23JZ7rdoZI&cx=015527497063906992354:fqrmredp-fm&q=bav99&filetype=pdf",
  "result": [
    {
      "id": "0b8bc4fd4f4c17e89a8af900f770908e2da222dcea79260c0f97bb8b298b220c",
      "url": "https://www.vishay.com/doc?85718"
    },
    {
      "id": "ecc0a8dc62d1e4b34d250935fe8589a832a07ae7c8a76861fb02b1305618eead",
      "url": "https://www.diodes.com/assets/Datasheets/ds12007.pdf"
    },
    {
      "id": "65937faae0d8edd837bbaeaf04dd9cb4724ad8db987079376d8f0d3c7cc4f603",
      "url": "https://www.mouser.com/access/?pn=BAV99"
    },
    {
      "id": "c51e296e05aaf954ea1a5fb2ecea6b7dce968e7ebf5592fcbc309f13b9d6187f",
      "url": "https://www.digikey.com/product-detail/en/vishay-semiconductor-diodes-division/BAV99-E3-08/BAV99-E3-08CT-ND/3104432"
    },
    {
      "id": "a42cd2934d63046c6fafb48ee5949bedd20fde6e446e873283ad33c35669019e",
      "url": "https://www.farnell.com/datasheets/1995698.pdf"
    },
    {
      "id": "ffcd0a0d2c30645868bf7d26452d0a973e2661a867bfcd7de8a6234c225a4ee1",
      "url": "https://www.digikey.com/product-detail/en/panasonic-electronic-components/BAV99/BAV99PSCT-ND/4356985"
    },
    {
      "id": "6fc7374ea3a7bdb7a02cbf07ac7aa75621110449a1b9a89faea719e80f6c58a6",
      "url": "http://www.ti.com/lit/an/slva898/slva898.pdf"
    },
    {
      "id": "1a449473baa892b4fab96a48b36ad6956bba80e817700e43c7db5681d8f5977c",
      "url": "https://www.nexperia.com/products/diodes/switching-diodes/series/BAV99-SERIES.html"
    },
    {
      "id": "c5a75b63b10f4584bcc910328fb2c5aaf17f97a045bd522528969381dfbfad06",
      "url": "https://www.newark.com/78K5856?CMP=AFC-ECIA"
    },
    {
      "id": "e3c17479ccf8309bc613ef5c278102301eec43f048aa62912eead666f917db28",
      "url": "https://www.nexperia.com/products/diodes/switching-diodes/general-purpose-high-speed-switching-diodes-100-v/BAV99.html"
    }
  ]
}

Author

Dan Schomburg