dynamodb-streams-kinesis-adapter | Amazon DynamoDB Stream | AWS library
kandi X-RAY | dynamodb-streams-kinesis-adapter Summary
kandi X-RAY | dynamodb-streams-kinesis-adapter Summary
DynamoDB Streams Kinesis Adapter implements the Amazon Kinesis interface so that your application can use KCL to consume and process data from a DynamoDB stream. You can get started in minutes using Maven.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Gets the records
- Transforms an AmazonServiceException to a compatible KinesServiceException
- Adds an entry to the cache
- Converts AWS Dynamo DynamoDB streams to a compatible Amazon KinesisRecords
- Get all shard ids
- Attempt to determine the consistency of the shards in the given shard state
- Gets shards
- Get Stream ExceededExceededExceededException
- Entry point for the KCL API
- Create an AWS client using the provided parameters
- Create a DynamoDB stream worker
- Returns the hash key range for the shard
- Returns the names of the streams associated with the account
- Returns the shard with the given id
- Shuts down the leader election thread pool
- Process records input
- Get a JSON representation of the record
- Retrieves a list of records
- Gets the current status of the stream
- Returns true if the lease should be removed
- Gets shard iterator
- Gets the range of the current shard numbers
dynamodb-streams-kinesis-adapter Key Features
dynamodb-streams-kinesis-adapter Examples and Code Snippets
Community Discussions
Trending Discussions on dynamodb-streams-kinesis-adapter
QUESTION
There's this document on AWS that suggests the best way to consume a dynamoDB Stream is via Kinesis Client Library using an adapter to translate between kinesis stream and dynamodb stream API.
This is the document: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Streams.KCLAdapter.html
And these are maven coordinates for the adapter implementation
...ANSWER
Answered 2020-Dec-03 at 09:09Answering my own question after researching a bit more.
There seem to be no equivalent of Dynamodb Streams adapter for KCL 2.x and Java SDK 2.x, so you'll need to roll out your own if you want to consume dynamodb stream with KCL 2.x.
Also, around 2 weeks ago a new feature has been added to Dynamodb that allows to stream item changes directly to Kinesis streams. This then allows to use KCL 2.x without any adapters. https://aws.amazon.com/about-aws/whats-new/2020/11/now-you-can-use-amazon-kinesis-data-streams-to-capture-item-level-changes-in-your-amazon-dynamodb-table/
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install dynamodb-streams-kinesis-adapter
Sign up for AWS - Before you begin, you need an AWS account. Please see the AWS Account and Credentials section of the developer guide for information about how to create an AWS account and retrieve your AWS credentials. You don’t need this if you’re using DynamoDB Local.
Minimum requirements - To run the SDK you will need Java 1.8+. For more information about the requirements and optimum settings for the SDK, please see the Java Development Environment section of the developer guide.
Install the DynamoDB Streams Kinesis Adapter - Using Maven is the recommended way to install the DynamoDB Streams Kinesis Adapter and its dependencies, including the AWS SDK for Java. To download the code from GitHub, simply clone the repository by typing: git clone https://github.com/awslabs/dynamodb-streams-kinesis-adapter.git, and run the Maven command described below in "Building From Source". You may also depend on the maven artifact com.amazonaws:dynamodb-streams-kinesis-adapter.
Build your first application - There is a walkthrough to help you build first application using this adapter. Please see Using the DynamoDB Streams Kinesis Adapter to Process Stream Records.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page