Open
Description
Motivation
Tracking stream lineage is the ability to understand the full path of a message from the very first producer through the final consumer, including the trail and evolvement of a message between topics. This ability is extremely handy in a troubleshooting process.
Suggested Memphis implementation
Stream lineage of each message with out-of-the-box visualization for each stamped message using a generated header by the Memphis SDK.
Asked by
- Sihoon (discord user):
"Since u guys already have an amazing GUI, can u extend the "message journey" from a single station to the "end to end" message flow? Basically there is an initial message generated that is triggered by something like a cronjob, API request etc. Then lets say there is three different type of consumers A, B, C that consumes the same message, each of them produce different messages, which are also consumed by other child consumers. The GUI would look something like user flows in google analytics/mixpanel (see the attached screenshot). The "red", which corresponds to the users have left the app on a certain page, would respond to messages count in the dead letter station. I think u could show this "flow" with multiple options as well, for a single parent event, for all events(general stats). "