Skip to content

Kafka Stream Topology visualizer #205

Open
@IldarAlmakaev

Description

@IldarAlmakaev

As a user, I would like to copy&paste a generated Kafka Streams topology from an application log and then generate a nice-looking diagram in Kafka UI application.
It would help users to review how their stream topology is built.
As an example, you can take a look at this repo.
example

We can implement a parser of this topology in the backend and then provide models for easier display in UI

Here we could add features like:

  • interactive UI elements (e.g. by clicking on a UI elements ability to display metadata of sources, sinks, processors, transformers, etc
  • Downloading this nice-looking chart/diagram
    • something else :)

The data model is a graph that consists of source connectors, sink connectors, and consumers. Consumers are processor topologies that consist of stream processors (nodes) that are connected by streams (edges).
The graph nodes have additional info:

  • the number of processors and topics at the consumer level
  • the number of input messages, output messages, and lag at the topic level

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions