Port kvsd

[ymgyt]

Goal

Manage kvsd within the syndicationd project.

Motivation

One of the goals of this project is to provide users with a self-hostable feed service.
To achieve this, the following aspects are necessary:

• Tools and echanisms for data backup and resoration
• Observability

Tools and Mechanisms for Data Backup and Restoration

We want to provide these tools and mechanisms within the same release cycle as syndicationd. While it could be managed in a separate repository, having it in the same repository reduces management costs (CI, dependencies management, release cycle).

Observability

By implementing consistent OpenTelemetry signals across synd-api and kvsd, we can offer complete observability.

Issues to Resolve During the Port

The current kvsd has the follwing issues:

• kvsd and CLI are in the same binary.
• The kvs-client feature cannot be used independently (it also depends on kvsd).
• No performance tests are avaialble.
• OpenTelemetry is not instrumented.

Therefore, during the port, we plan to split kvsd into the following packages

• synd_kvsd: Implementation of kvsd
• synd_kvs_client: Implementation of the kvs client, which will be used by synd_api
• synd_kvsctl: CLI for kvs
• synd_kvsadm: Admin tool for kvsd handling tasks like backup

Tasks

• convert config file format from yaml to toml
• use nom to parse message
  • be57556
  • 0c574f2
• instrument opentelemetry
  • instrument traces
  • instrument metrics