How to Unit Test Kafka Streams Application – PART 1 (DSL)

This is part 1 of 2 articles to unit test Kafka Streams application. The first part talks about testing DSL transformation, stateless and stateful, including joining and windowing.

Filtering Nested Array Objects in Elasticsearch Document with Painless Scripting

Painless is a simple, secure scripting language designed specifically for use with Elasticsearch. It is the default scripting language for Elasticsearch and can safely be used for inline and stored scripts.

https://bit.ly/2TRuUNj

A Food for Thought: How to Share Data Among Services in a Microservice World (part 2)

A microservice architecture is all about transferring data from one service to another.

A Food for Thought: How to Share Data Among Services in a Microservice World (part 1)

A microservice architecture is all about transferring data from one service to another.

How to Join One-to-Many and Many-to-One Relationship with Kafka Streams

Yet another Kafka feature, which is Kafka Streams, allow us to join two streams into one single stream. Kafka streams provide one-to-many and many-to-one join types.

How to Encrypt and Decrypt Kafka Message using Custom (De)Serializers

Sensitive data always need to be handled with extra careful. Thus, in some cases, we need to encrypt before delivering message to Kafka topic.

How to Publish Subscribe to Kafka with Spring and SASL/SCRAM

interface

After we secure Kafka Broker and Zookeeper with SASL/SCRAM, it is time for client (Java + Spring) to connect to secured Kafka.

How to Secure Confluent Kafka with SSL and SASL/SCRAM

Overview When I decided to include Apache Kafka as one of our technology stack, I never imagine the demand would be this huge. At first, my requirements were only two things. Something faster than ActiveMQ […]

How to Isolate Database Credentials in Spring Boot Using Vault

Data privacy and security became critical nowadays. Thus, we need to isolate database credentials and make it transparent to our applications/services.