Open source

Cassandra Kinesis Connector

Back Open source

Cassandra Kinesis connector is based on Amazon Kinesis Connector Library project. It extends the library with Cassandra-specific transformer and emitter (ITransformer and IEmitter, that is, CassandraTransformer and CassandraEmitter) and provides basic implementations for those. It also includes a connector executor implementation that allows the connector to be run as a stand-alone Java process.

The provided default implementations of CassandraTransformer and CassandraEmitter are JsonCassandraTransformerand DefaultCassandraEmitter.

JsonCassandraTransformer interprets the input records from Kinesis stream as JSON strings and converts them into CassandraRecord instances. Every JSON top-level property is treated as a Cassandra table column. Only JSON properties of type string, boolean or number are processed. The rest is silently ignored.

DefaultCassandraEmitter stores CassandraRecord instances (produced by JsonCassandraTransformer) into the respective Cassandra table (specified by the configuration).

Github project page

Related Case Studies

Click to read blog

MANAGED SERVICE FOR APACHE CASSANDRA

Click to read blog

INFRASTRUCTURE AUTOMATION

Click to read blog

INGESTION ETL

Click to read blog

IMPLEMENTATION OF IoT SENSOR PLATFORM