chore: add built-in Prometheus support

[xeniape]

Description

Part of #954

Docs added here: https://docs.stackable.tech/home/nightly/zookeeper/usage_guide/monitoring/

Integrationtests

--- PASS: kuttl (292.82s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/cluster-operation_zookeeper-latest-3.9.3_openshift-false (33.82s)
        --- PASS: kuttl/harness/znode_zookeeper-latest-3.9.3_openshift-false (28.00s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-false_use-client-auth-tls-false_openshift-false (72.61s)
        --- PASS: kuttl/harness/delete-rolegroup_zookeeper-3.9.3_openshift-false (68.26s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-true_openshift-false (136.65s)
        --- PASS: kuttl/harness/logging_zookeeper-3.9.3_openshift-false (68.04s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-false_openshift-false (78.36s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-false_use-client-auth-tls-true_openshift-false (83.90s)
PASS

Openshift

--- PASS: kuttl (136.25s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/znode_zookeeper-latest-3.9.3_openshift-true (33.86s)
        --- PASS: kuttl/harness/logging_zookeeper-3.9.3_openshift-true (41.60s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-true_openshift-true (101.50s)
        --- PASS: kuttl/harness/delete-rolegroup_zookeeper-3.9.3_openshift-true (34.16s)
        --- PASS: kuttl/harness/cluster-operation_zookeeper-latest-3.9.3_openshift-true (33.89s)
PASS

Release Note Snippet

Prometheus support was added using the built-in Prometheus provider in ZooKeeper. This appends another port (native-metrics). To access the metrics this port in combination with the /metrics endpoint can be used.

Definition of Done Checklist

• Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
• Please make sure all these things are done and tick the boxes

Author

• Changes are OpenShift compatible
• CRD changes approved
• CRD documentation for all fields, following the style guide.
• Helm chart can be installed and deployed operator works
• Integration tests passed (for non trivial changes)
• Changes need to be "offline" compatible
• Links to generated (nightly) docs added
• Release note snippet added

Reviewer

• Code contains useful comments
• Code contains useful logging statements
• (Integration-)Test cases added
• Documentation added or updated. Follows the style guide.
• Changelog updated
• Cargo.toml only contains references to git tags (not specific commits or branches)

Acceptance

• Feature Tracker has been updated
• Proper release label has been added
• Links to generated (nightly) docs added
• Release note snippet added
• Add type/deprecation label & add to the deprecation schedule
• Add type/experimental label & add to the experimental features tracker

[razvan]

LGTM but this is worth mentioning in the docs too, especially the metric endpoints and maybe adding an assert step in a kuttl test. Maybe smoke ?

[xeniape]

LGTM but this is worth mentioning in the docs too, especially the metric endpoints and maybe adding an assert step in a kuttl test. Maybe smoke ?

b5a685d (expanded test)

--- PASS: kuttl (170.26s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-false_use-client-auth-tls-false_openshift-false (72.53s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-false_openshift-false (85.02s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-true_openshift-false (91.53s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-false_use-client-auth-tls-true_openshift-false (85.21s)
PASS

Working on some documentation next

Edit: Updated docs fa8597e

[razvan]

The metrics port is hard coded in a couple of places:

❯ rg 9505
...
rust/operator-binary/src/zk_controller.rs
715:                port: 9505,
900:        .add_container_port("metrics", 9505)

[xeniape]

Rerun of tests after readding jmx exporter

--- PASS: kuttl (375.29s)
    --- PASS: kuttl/harness (0.00s)
        --- PASS: kuttl/harness/znode_zookeeper-latest-3.9.3_openshift-false (49.41s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-false_use-client-auth-tls-true_openshift-false (117.62s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-true_openshift-false (169.62s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-false_use-client-auth-tls-false_openshift-false (80.68s)
        --- PASS: kuttl/harness/smoke_zookeeper-3.9.3_use-server-tls-true_use-client-auth-tls-false_openshift-false (94.72s)
        --- PASS: kuttl/harness/cluster-operation_zookeeper-latest-3.9.3_openshift-false (35.44s)
        --- PASS: kuttl/harness/delete-rolegroup_zookeeper-3.9.3_openshift-false (71.55s)
        --- PASS: kuttl/harness/logging_zookeeper-3.9.3_openshift-false (78.07s)
PASS

[razvan]

lgtm