@aws-cdk/aws-kinesis
Advanced tools
Amazon Kinesis provides collection and processing of large streams of data records in real time. Kinesis data streams can be used for rapid and continuous data intake and aggregation.
Amazon Kinesis Data Streams ingests a large amount of data in real time, durably stores the data, and makes the data available for consumption.
Using the CDK, a new Kinesis stream can be created as part of the stack using the construct's constructor. You may specify the streamName to give
your own identifier to the stream. If not, CloudFormation will generate a name.
new Stream(this, "MyFirstStream", {
streamName: "my-awesome-stream"
});
You can also specify properties such as shardCount to indicate how many shards the stream should choose and a retentionPeriod
to specify how long the data in the shards should remain accessible.
Read more at Creating and Managing Streams
new Stream(this, "MyFirstStream", {
streamName: "my-awesome-stream",
shardCount: 3,
retentionPeriod: Duration.hours(48)
});
Stream encryption enables server-side encryption using an AWS KMS key for a specified stream.
Encryption is enabled by default on your stream with the master key owned by Kinesis Data Streams in regions where it is supported.
new Stream(this, 'MyEncryptedStream');
You can enable encryption on your stream with a user-managed key by specifying the encryption property.
A KMS key will be created for you and associated with the stream.
new Stream(this, "MyEncryptedStream", {
encryption: StreamEncryption.KMS
});
You can also supply your own external KMS key to use for stream encryption by specifying the encryptionKey property.
import * as kms from "@aws-cdk/aws-kms";
const key = new kms.Key(this, "MyKey");
new Stream(this, "MyEncryptedStream", {
encryption: StreamEncryption.KMS,
encryptionKey: key
});
Any Kinesis stream that has been created outside the stack can be imported into your CDK app.
Streams can be imported by their ARN via the Stream.fromStreamArn() API
const stack = new Stack(app, "MyStack");
const importedStream = Stream.fromStreamArn(
stack,
"ImportedStream",
"arn:aws:kinesis:us-east-2:123456789012:stream/f3j09j2230j"
);
Encrypted Streams can also be imported by their attributes via the Stream.fromStreamAttributes() API
import { Key } from "@aws-cdk/aws-kms";
const stack = new Stack(app, "MyStack");
const importedStream = Stream.fromStreamAttributes(
stack,
"ImportedEncryptedStream",
{
streamArn: "arn:aws:kinesis:us-east-2:123456789012:stream/f3j09j2230j",
encryptionKey: kms.Key.fromKeyArn(
"arn:aws:kms:us-east-1:123456789012:key/12345678-1234-1234-1234-123456789012"
)
}
);
IAM roles, users or groups which need to be able to work with Amazon Kinesis streams at runtime should be granted IAM permissions.
Any object that implements the IGrantable interface (has an associated principal) can be granted permissions by calling:
grantRead(principal) - grants the principal read accessgrantWrite(principal) - grants the principal write permissions to a StreamgrantReadWrite(principal) - grants principal read and write permissionsGrant read access to a stream by calling the grantRead() API.
If the stream has an encryption key, read permissions will also be granted to the key.
const lambdaRole = new iam.Role(this, 'Role', {
assumedBy: new iam.ServicePrincipal('lambda.amazonaws.com'),
description: 'Example role...',
}
const stream = new Stream(this, 'MyEncryptedStream', {
encryption: StreamEncryption.KMS
});
// give lambda permissions to read stream
stream.grantRead(lambdaRole);
The following read permissions are provided to a service principal by the grantRead() API:
kinesis:DescribeStreamSummarykinesis:GetRecordskinesis:GetShardIteratorkinesis:ListShardskinesis:SubscribeToShardGrant write permissions to a stream is provided by calling the grantWrite() API.
If the stream has an encryption key, write permissions will also be granted to the key.
const lambdaRole = new iam.Role(this, 'Role', {
assumedBy: new iam.ServicePrincipal('lambda.amazonaws.com'),
description: 'Example role...',
}
const stream = new Stream(this, 'MyEncryptedStream', {
encryption: StreamEncryption.KMS
});
// give lambda permissions to write to stream
stream.grantWrite(lambdaRole);
The following write permissions are provided to a service principal by the grantWrite() API:
kinesis:ListShardskinesis:PutRecordkinesis:PutRecordsYou can add any set of permissions to a stream by calling the grant() API.
const user = new iam.User(stack, 'MyUser');
const stream = new Stream(stack, 'MyStream');
// give my user permissions to list shards
stream.grant(user, 'kinesis:ListShards');
1.95.0 (2021-03-25)
image property in the
Bundling class is changed from BundlingDockerImage to
DockerImage.dockerImage property in
BundlingOptions is changed from BundlingDockerImage to
DockerImage.allowMethods property under corsPreflight
section is changed from HttpMethod to CorsHttpMethod.NodejsFunction is now Node.js 14.x if the environment from which it is deployed uses Node.js >= 14 and Node.js 12.x otherwise.apigatewayv2: error while configuring ANY as an allowed method in CORS (#13313) (34bb338), closes #13280 #13643
aws-ecs: drain hook lambda allows tasks to stop gracefully (#13559) (3e1148e), closes #13506
codebuild: Fixed build spec file format to return yaml (#13445) (fab93c6)
codedeploy: Use aws-cli instead of awscli for yum (#13655) (449ce12)
codepipeline-actions: BitBucketAction fails with S3 "Access denied" error (#13637) (77ce45d), closes #13557
core: toJsonString() cannot handle list intrinsics (#13544) (a5be042), closes #13465
events,applicationautoscaling: specifying a schedule rate in seconds results in an error (#13689) (5d62331), closes #13566
lambda: incorrect values for prop UntrustedArtifactOnDeployment (#13667) (0757686), closes #13586
neptune: create correct IAM statement in grantConnect() (#13641) (2e7f046), closes #13640
s3: Notifications fail to deploy due to incompatible node runtime (#13624) (aa32cf6)
lambda-nodejs: prepare code to reduce merge conflicts when deprecated APIs are stripped (#13738) (ca391b5)
FAQs
The CDK Construct Library for AWS::Kinesis
The npm package @aws-cdk/aws-kinesis receives a total of 49,223 weekly downloads. As such, @aws-cdk/aws-kinesis popularity was classified as popular.
We found that @aws-cdk/aws-kinesis demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 4 open source maintainers collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Research
A malicious npm package disguised as a WhatsApp client is exploiting authentication flows with a remote kill switch to exfiltrate data and destroy files.
Security News
PyPI now supports digital attestations, enhancing security and trust by allowing package maintainers to verify the authenticity of Python packages.
Security News
GitHub removed 27 malicious pull requests attempting to inject harmful code across multiple open source repositories, in another round of low-effort attacks.