amazon-questions-crawler

Amazon Questions Crawler

Crawls product questions from Amazon.

Installation

Via npm:

npm install amazon-questions-crawler

Or Yarn:

yarn add amazon-questions-crawler

Usage

Load the module

var questionsCrawler = require('amazon-questions-crawler')

Get questions by a product ASIN

questionsCrawler('0062472100')
	.then(function(questions){
		console.log(questions)
	})
	.catch(function(err){
		console.error(err)
	})

This will return an object containing the title of the product and an array of questions data.

Example of a return:

{
	title: "Product Name",
	questions: [
		{
			id: "Tx2FZP4T1BTNF6K",
			question: "Amazon user question here?",
			link: "https://www.amazon.com/forum/-/Tx3S3D31UW3GXGH/ref=ask_ql_ql_al_hza?asin=B00LB33S0Y"
		}
	]
}

Options

Options can also be provided to change the user agent string, questions page, or elements being crawled.

Example:

reviewsCrawler('0062472100', {
		page: 'https://www.amazon.com/ask/questions/asin/{{asin}}/1/ref=ask_ql_psf_ql_hza?sort=SUBMIT_DATE',
		userAgent: 'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:27.0) Gecko/20100101 Firefox/27.0',
		elements: {
			// Searches whole page
			productTitle: '.askProductDescription a',
			questionBlock: '.askTeaserQuestions > div',
			// Searches within questionBlock
			question: 'a',
			link: 'a'
		},
		// Stops crawling when it hits a particular question ID
		// Useful for only crawling new questions
		stopAtQuestionId: false
	})
	.then(console.log)
	.catch(console.error)