Skip to content
Open Data Sync ↗

Amazon DynamoDB

Data Sync reads Amazon DynamoDB as a source: it backfills the tables you select, then streams changes from each table's stream. There is no DynamoDB sink.

Source DynamoDB Streams

Overview

DynamoDB records item-level changes in a table's stream when streams are enabled. Data Sync reads that stream rather than re-scanning the table, so each change is seen once and in order per item.

Before you connect

  1. Enable DynamoDB Streams on every table you want to replicate.
  2. Mind the 24-hour window. A stream keeps records for 24 hours. If Data Sync is stopped for longer, the changes it needs to resume from are gone and the sync cannot pick up where it stopped.
  3. Grant access to the identity Data Sync uses: it needs to describe and scan the tables for the backfill, and to read their streams.
# the IAM actions a DynamoDB source typically needs dynamodb:DescribeTable dynamodb:Scan dynamodb:ListStreams dynamodb:DescribeStream dynamodb:GetShardIterator dynamodb:GetRecords

Connection fields

Set once, on the connection, in step 2 of the add-a-connection wizard.

FieldDefaultDescription
regionOptionalus-east-1The AWS region the tables live in.
endpointOptionalAWSA custom endpoint, for example a VPC endpoint. Leave it empty for the standard regional endpoint.

Credentials

Step 3 asks for an access key ID and secret access key. Store them as a Blunox-managed secret or as a reference to your own secret store; the connection keeps a reference, never the value. See Connections.