spm-metrics-js

spm-metrics-js

SPM Performance Monitoring - Custom Metrics and Event API client for node.js.

This module implements:

• custom metrics API and
• events API

A free account to generate API tokens is available at www.sematext.com

Installation

    npm install spm-metrics-js

Usage

Initialize

    var SPM = require('spm-metrics-js')
    // YOUR API TOKEN, e.g. from environment variables
    var token =  process.env.SPM_TOKEN

Create client object, automatically send every 30 seconds, 0 disables interval transmission. When transmission interval is disabled metrics are transmitted when the internal buffer size reaches 100 entries.

    var spmClient = new SPM(token, 30000)

Custom Metrics basic usage

Capture relevant metrics for your application and forward it to SPM

    var userMetric = spmClient.getCustomMetric ({name: 'user.count', aggregation: 'avg', filter1: os.hostname()})
    userMetric.set (users.count)
    ...
    userMetric.set (users.count)

Force sending the metrics immediately

    spmClient.send()

Custom Metrics advanced usage by utilizing measurements

If you want to apply statistical functions to metrics and send the results to SPM at a fixed interval to SPM, the metric object should be initialized by declaring an 'interval' for generating the statistics:

      var options = {name: 'requests', aggregation: 'avg', filter1: os.hostname(), interval: 60000}
      var requestCounterMetric = spmClient.getCustomMetric (options)

List of options

• name - the name of the metric
• aggregation - the aggregation type 'avg', 'sum', 'min' or 'max', defaults to 'avg'
• filter1 - a filter value for the first filter field in SPM User Interface
• filter2 - a filter value for the second filter field in SPM User Interface
• interval - time in ms to call save() periodically. Defaults to no automatic call of save(). The save() function captures the metric and resets meters, histograms, counters or timers.
• valueFilter - Array of property names for calculated values. Only specified fields are sent to SPM.

Measurement functions like histogram(), meter(), timer() add calculated values as properties to the metrics like count, min, max, mean or percentiles. In SPM a metric called "time" might then appear as "time.min", "time.max", "time.mean" etc.

For example: If you want to send only 'count' and 'currentRate' calculated by a "meter" measurement to SPM you can use valueFilter option to limit what you send to SPM:

    var options = {name: 'requests', aggregation: 'avg', filter1: os.hostname(), valueFilter: ['count', 'currentRate']}

See details of used properties below.

Counter

A counter can be incremented and decremented

    var options = {name: 'requests', aggregation: 'avg', filter1: os.hostname(), interval: 60000}
    var userCounterMetric = spmClient.getCustomMetric (options)
    userCounterMetric.counter()
    // use counter e.g. on login
    userCounterMetric.inc()
    // or on logout
    userCounterMetric.dec()
    // save data - only needed if no "interval" is specified
    userCounterMetric.save()

Meter

A meter can be used to count events and calculate rates

    var options = {name: 'requests', aggregation: 'avg', filter1: os.hostname()}
    var requestCounterMetric = spmClient.getCustomMetric (options)
    // activate meter functions
    requestCounterMetric.meter()
    // use meter e.g. in in each request
    requestCounterMetric.mark()
    // save data - only needed if no "interval" is specified
    requestCounterMetric.save()

This values will be calculated and attached to your metric:

• mean: The average rate since the meter was started.
• count: The total of all values added to the meter.
• currentRate: The rate of the meter since the meter was started.
• 1MinuteRate: The rate of the meter biased towards the last 1 minute.
• 5MinuteRate: The rate of the meter biased towards the last 5 minutes.
• 15MinuteRate: The rate of the meter biased towards the last 15 minutes.

In our example it would be "requests.mean", "requests.count" etc.

Histogram

Keeps a resevoir of statistically relevant values biased towards the last 5 minutes to explore their distribution.

        var options = {name: 'requestTime', aggregation: 'avg', filter1: os.hostname()}
        var requestTimeMetric = spmClient.getCustomMetric (options)
        // activate histogram functions
        requestTimeMetric.histogram()
        // use histogram update function e.g. in in each request with measured time
        requestTimeMetric.update(measuredTime)
        // save data and reset histogram - only needed if no "interval" is specified
        var metricValues = requestTimeMetric.save()
        // output values
        console.log (metricValues)

This values will be calculated and attached to your metric:

• min: The lowest observed value.
• max: The highest observed value.
• sum: The sum of all observed values.
• variance: The variance of all observed values.
• mean: The average of all observed values.
• stddev: The stddev of all observed values.
• count: The number of observed values.
• median: 50% of all values in the resevoir are at or below this value.
• p75: See median, 75% percentile.
• p95: See median, 95% percentile.
• p99: See median, 99% percentile.
• p999: See median, 99.9% percentile.

In our example it would be "requestTime.min", "requestTime.max", "requestTime.p75" etc.

Timer

Timer measures the time between start() and end() call and provides as result properties of Histogram and Meter.

     var timerMetric = spmClient.getCustomMetric (options)
     var stopwatch = timerMetric.timer().start()
     stopwatch.end()
     timerMetric.save()

More Information about the measurement functions

The measurement functions are based on the excellent Measured package. We use a concept of delegate functions to simlify the combined usage of Custom Metrics and Measured. For example a call to metric.histogram() adds dynamically all Measured.Histogram functions to the metrics object created by getCustomMetrics(). The save() function uses toJSON() of the "Measured" objects to generate the calculated properties, which are added to each metric object.

We recommend reading the documentation of Measured for a better understanding of the measurement functions.

Create Events to correlatee with your metrics in SPM

Add an event to SPM Events, the callback function is optional (see events of spm-metrics-js)

    var spmClient = new SPM(token, 0)
    // configure defaults
    var eventLogger = spmClient.getEventLogger ({
            type: 'system',
            name: 'system',
            tags: ['job', 'queue'],
            creator: 'jobsQ.js',
            data: 'String or Base64 coded content'})

    // send Event Message, the callback is optional
    eventLogger.log ('forked new worker', function (err, res) {
        console.log(err || res)
    })

    process.on ('exit', function () {
        eventLogger.log ('Exit job queue PID:' + process.pid)
    })

Monitoring activity and errors

You can add event handlers for errors and actions

    spmClient.on ('error', console.log)
    spmClient.on ('add', console.log)
    spmClient.on ('send metrics', console.log)
    spmClient.on ('send event', console.log)