Which framework is used to transform data from one Kafka topic to another?

Which framework is used to transform data from one Kafka topic to another?

• A. Connectors
• B. Kafka Streams
• C. Producers
• D. Consumers

Answer: (B)

Streaming processing is about reading data from a topic, applying transformations, and writing the results to another topic. Kafka Streams is the library designed for this purpose: it lets you build applications that consume from input topics, perform operations like map, filter, join, and windowed aggregations, and then emit the transformed data to output topics. It runs inside your application and uses Kafka’s own producers and consumers, providing fault tolerance and, with the right configuration, strong consistency. Kafka Connect, by contrast, is focused on moving data between Kafka and external systems and can do only lightweight transformations via simple single-message transforms, not full stream processing. Producers and consumers are the endpoints that publish and read data, not frameworks to transform between topics. So for transforming data from one Kafka topic to another, Kafka Streams is the appropriate framework.

Streaming processing is about reading data from a topic, applying transformations, and writing the results to another topic. Kafka Streams is the library designed for this purpose: it lets you build applications that consume from input topics, perform operations like map, filter, join, and windowed aggregations, and then emit the transformed data to output topics. It runs inside your application and uses Kafka’s own producers and consumers, providing fault tolerance and, with the right configuration, strong consistency.

Kafka Connect, by contrast, is focused on moving data between Kafka and external systems and can do only lightweight transformations via simple single-message transforms, not full stream processing. Producers and consumers are the endpoints that publish and read data, not frameworks to transform between topics.

So for transforming data from one Kafka topic to another, Kafka Streams is the appropriate framework.