more and more
Building a Data Pipeline with Kafka, Spark Streaming and Cassandra 1. Overview Apache Kafka is a scalable, high performance, low latency platform that allows reading and writing streams of data like a messaging system. We can start with Kafka in Java fairly easily. Spark Streaming is part of the Apache Spark platform that… Continue Reading kafka-spark-data-pipeline
getdocs
Introduction to Kafka Connectors 1. Overview Apache Kafka® is a distributed streaming platform. In a previous tutorial, we discussed how to implement Kafka consumers and producers using Spring. In this tutorial, we’ll learn how to use Kafka Connectors. We’ll have a look at: Different types of Kafka Connectors Features and… Continue Reading kafka-connectors-guide
getdocs
Intro to Apache Kafka with Spring 1. Overview Apache Kafka is a distributed and fault-tolerant stream processing system. In this article, we’ll cover Spring support for Kafka and the level of abstractions it provides over native Kafka Java client APIs. Spring Kafka brings the simple and typical Spring template programming… Continue Reading spring-kafka
getdocs
Exactly Once Processing in Kafka 1. Overview In this tutorial, we’ll look at how Kafka ensures exactly-once delivery between producer and consumer applications through the newly introduced Transactional API. Additionally, we’ll use this API to implement transactional producers and consumers to achieve end-to-end exactly-once delivery in a WordCount example. 2.… Continue Reading kafka-exactly-once
getdocs
Introduction to KafkaStreams in Java 1. Overview In this article, we’ll be looking at the KafkaStreams library. KafkaStreams is engineered by the creators of Apache Kafka. The primary goal of this piece of software is to allow programmers to create efficient, real-time, streaming applications that could work as Microservices. KafkaStreams… Continue Reading java-kafka-streams
getdocs
Building a Data Pipeline with Flink and Kafka 1. Overview Apache Flink is a stream processing framework that can be used easily with Java. Apache Kafka is a distributed stream processing system supporting high fault-tolerance. In this tutorial, we-re going to have a look at how to build a data pipeline… Continue Reading kafka-flink-data-pipeline
getdocs