Kafka

Kafka Log Compaction: A Comprehensive Guide

May 17th, 2024 By Sarthak Bhardwaj in Data Warehousing, Kafka

Are you confused about what Log Compaction is all about? It is an effective recovery strategy and also to also manage your data log up to a threshold limit. Do…

Kinesis vs Kafka: What’s the Best Choice for Your Data Pipeline

May 10th, 2024 By Satyam Agrawal in Data Warehousing, Kafka, Versus

Data is all around us. There is a firehose of information coming from social networks, financial trading floors, and geospatial services. Collecting, storing, and analyzing this type of high throughput…

Kafka batch processing using Spring Boot: 4 Easy Steps

December 27th, 2023 By Arsalan Mohammed in Data Warehousing, Kafka

Processing large volumes of data efficiently is critical for many modern applications. Kafka provides an excellent publish-subscribe messaging system for handling real-time data feeds, but its batch-processing capabilities are less…

Kafka Console Producer: Master Data Streaming with Kafka

December 27th, 2023 By Shubhnoor Gill in Data Warehousing, Kafka

Have you considered the simplest way to write and read messages from Kafka? If not, in this article you will discover how you can use Kafka Console Producer to write…

Best Kafka Connectors in 2025

January 10th, 2023 By Raj Verma in Data Warehousing, Kafka

Kafka Connect is basically a set of connectors that allow you to get data from an external Database straight into Kafka, and to put your data from Kafka into any…

Snowflake vs Kafka: 5 Critical Differences

October 21st, 2022 By Manisha Jena in Data Warehousing, Kafka, Snowflake, Versus

With ever-increasing data, organizations have realized the need to process the data. To make the most out of it, there has been a growing demand for separating storage and computing.…

Kafka Clusters Architecture 101: A Comprehensive Guide

March 30th, 2022 By Preetipadma Khandavilli in Data Warehousing, Kafka

Event streaming is used in industries like banking, stock exchanges, hospitals, and factories for real-time data access. Apache Kafka, a prominent real-time data streaming software, employs an open-source architecture for…

Simplifying Kafka Event Streaming: Easy Steps Explained (with code)

March 23rd, 2022 By Shubhnoor Gill in Data Warehousing, Kafka

Kafka Event Streaming is becoming essential as data grows across industries. But what exactly is Event Streaming? It enables businesses to: Track events like customer orders or bank deposits in…

How To Work With Confluent, Avro & Kafka Schema Registry

March 16th, 2022 By Ishwarya M in Data Warehousing, Kafka

Trillions of data are being handled and streamed through Kafka servers per day. However, Kafka servers only store and organize data received from producers and are not responsible for evaluating…

Critical Kafka Producer Config Parameters Simplified

March 3rd, 2022 By Raj Verma in Data Warehousing, Kafka

Organizations today have access to a wide stream of data. Apache Kafka, a popular Data Processing Service is used by over 30% of Fortune 500 companies to develop real-time data…

IBM MQ vs Kafka: 5 Critical Differences

February 25th, 2022 By Shravani Kharat in Data Warehousing, Kafka, Versus

Today, large volumes of data are transmitted as messages between applications, systems, and services. In case an application isn't ready, or a service failure occurs, messages and transactions may be…

Debezium vs Kafka Connect Simplified: 3 Critical Differences

February 24th, 2022 By Ishwarya M in Data Warehousing, Kafka, Versus

Based on a report, Apache Kafka stores and streams more than 7 trillion real-time messages per day. However, fetching real-time messages from external sources or applications is a tedious process…

8 Kafka CLI Crucial Commands: Comprehensive Guide

February 21st, 2022 By Aditya Jadon in Data Warehousing, Kafka

Apache Kafka is an event streaming platform widely used by companies for distributing events at high throughput and a publish-subscribe messaging system that makes users read and write data more…

GCP Kafka Installation: A Comprehensive Guide 101

February 4th, 2022 By Manisha Jena in Data Warehousing, Kafka

Apache Kafka is a distributed Publish-Subscribe Messaging platform explicitly designed to handle Real-time Streaming data. It helps in Distributed Streaming, Pipelining, and replay of data feeds for quick, scalable workflows.…

Apache Kafka Queue 101: Messaging Made Easy

January 31st, 2022 By Preetipadma Khandavilli in Data Warehousing, Kafka

Apache Kafka is a distributed publish-subscribe messaging platform explicitly designed to handle real-time streaming data. It helps in distributed streaming, pipelining, and replay of data feeds for quick, scalable workflows.…

Creating Spring Kafka Consumer Applications Simplified 101

January 31st, 2022 By Shubhnoor Gill in Data Warehousing, Kafka

Application Development is critical in Software Development. Since the mid-1990s, Java has been a popular choice for many programmers for building software. As a result, several frameworks have been developed…

Kafka Metrics: Optimize the Performance of Kafka Applications

January 27th, 2022 By Preetipadma Khandavilli in Data Warehousing, Kafka

Apache Kafka is a well-known open-source Data Streaming Platform that enables high-throughput Data Pipelines.  As a critical component of the IT infrastructure, it is necessary to have a dedicated tool…

Working With the Kafka Console Consumer Platform For Efficient Processing

January 27th, 2022 By Ishwarya M in Data Warehousing, Kafka

Apache Kafka is an open-source streaming platform that handles and processes real-time messages that can be further used for developing event-based applications. Kafka servers can handle hundreds of billions of…

Apache Kafka vs Spark: 5 Critical Differences to Simplify Understanding

January 21st, 2022 By Preetipadma Khandavilli in Data Warehousing, Kafka, Versus

In recent years, the phrase "big data" has gained popularity in a variety of industries throughout the world. Regardless of what industry you work in or the size of your…

How to Install Kafka on Mac? 3 Easy Steps

January 19th, 2022 By Sanchit Agarwal in Data Warehousing, Kafka

Real-Time Data in the form of events from sources such as Databases, sensors, mobile devices, cloud services, and software applications is crucial for business growth. A Community Distributed Message Streaming…