dynamodb-recs

AWS Dynamodb/Firehose Based Reccomendation Engine Based on Graphs.

1. Config Lambda Code

const {
    App,
    handlers
} = require('dynamodb-recs');

const app = new App('tablePrefix', 'partition', {
    recs: {
        firehose: {
            concurrency: 100,
            stream: 'app-name-recs'
        },
        jobs: {
            viewView: [{
                entity: 'view'
            }, {
                entity: 'view'
            }]
        },
        ttr: 30 * 60 * 1000
    },
    recsLogs: {
        firehose: {
            concurrency: 100,
            stream: 'app-name-recs-logs'
        },
        process: {
            concurrency: 100,
            offset: 60 * 60 * 1000
        }
    }
});

exports.recs = handlers.recs(app);
exports.recsFirehose = handlers.recsFirehose(app);
exports.recsLogsFirehose = handlers.recsLogsFirehose(app);
exports.recsLogsHit = handlers.recsLogsHit(app);
exports.recsLogsProcess = handlers.recsLogsProcess(app);

2. Config Lambda Handlers

Name
app-recs

Handler
index.fetch

Size
3008 MB

-

Name
app-recs-firehose

Handler
index.recsFirehose

Size
512 MB

-

Name
app-recs-logs-firehose

Handler
index.recsLogsFirehose

Size
512 MB

-

Name
app-recs-logs-hit

Handler
index.recsLogsHit

Size
128 MB

-

Name
app-recs-logs-process

Handler
index.recsLogsProcess

Size
512 MB

3. Config Kinesis Firehose

Name
app-name-recs

Lambda Transformer
app-recs-firehose

S3 Bucket
app-name

Prefix
recs/dt=!{timestamp:yyyy}-!{timestamp:MM}-!{timestamp:dd}/

Error prefix
recs-error/err=!{firehose:error-output-type}/dt=!{timestamp:yyyy}-!{timestamp:MM}-!{timestamp:dd}/

-

Name
app-name-recs-logs

Lambda Transformer
app-recs-logs-firehose

S3 Bucket
app-name

Prefix
recs-logs/dt=!{timestamp:yyyy}-!{timestamp:MM}-!{timestamp:dd}/

Error prefix
recs-logs-error/err=!{firehose:error-output-type}/dt=!{timestamp:yyyy}-!{timestamp:MM}-!{timestamp:dd}/