Picture by Donald Giannatti on unsplash
This post is part of a series of posts on Kafka Streams. Related posts: Kafka Streams with Spring Cloud Stream Unit Testing Kafka Streams with Avro State Stores Each stateful operator in Kafka Streams is materialized in a state store. Different types of state stores exists in kafka streams depending on the streaming operation, level […]
Unit testing Kafka Streams with Avro is critical to ensure correctness of your streaming processing pipelines. If you decide to skip unit testing, you will likely spend a lot of time debugging at run time. The TopologyTestDriver API developed for Kafka Streams is powerful, intuitive and quite easy to use. In the following, I describe […]
In this post we show how to configure Kafka Streams with Spring Cloud Stream. Then we deploy it and run it on Cloud Foundry PaaS. This post is part of a series of posts on Kafka Streams. Related posts: Unit Testing Kafka Streams with Avro 1. Software Stack In this tutorial we use Kafka Streams […]
Java Flight Recorder for Spark on Yarn In a previous post we have discussed how to enable Java Flight Recorder for Java applications. Here we show how to enable Java Flight Recorder for Spark applications running on Yarn. In this example, we use “RDDRelation”, a Spark SQL application that is provided in Spark distribution. We […]
Java Flight Recorder is a profiling tool for Java which is included in the Java Virtual Machine (since JDK version 7u40 or newer). The overhead of the tool is very small when we use the default profiling setting (the performance impact is below 1%). This makes it attractive for profiling applications even in heavily loaded […]