Skip to content

Commit fcec014

Browse files
authored
Sync buildkite builds and jobs dynamoDB tables to ClickHouse (#7002)
A follow-up of #6998 and #7001 to sync these dynamoDB tables to ClickHouse, I will need to find a permanent home for these tables instead of using `fortesting` ### Testing Actually running and ingesting data at the moment (I update the lambda manually on AWS). Also backfilling the data from DynamoDB as I have run a debug version of #6998 since mid July. ``` python dynamo2ch.py --dynamodb-table vllm-buildkite-build-events --clickhouse-table fortesting.vllm_buildkite_builds --stored-data vllm_buildkite_builds.json ``` ``` python dynamo2ch.py --dynamodb-table vllm-buildkite-job-events --clickhouse-table fortesting.vllm_buildkite_jobs --stored-data vllm_buildkite_jobs.json ``` --------- Signed-off-by: Huy Do <[email protected]>
1 parent 01e9114 commit fcec014

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

aws/lambda/clickhouse-replicator-dynamo/lambda_function.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,8 @@
3131
"torchci-metrics-ci-wait-time": "misc.metrics_ci_wait_time",
3232
"torchci-dynamo-perf-stats": "benchmark.inductor_torch_dynamo_perf_stats",
3333
"torchci-oss-ci-benchmark": "benchmark.oss_ci_benchmark_v2",
34+
"vllm-buildkite-build-events": "vllm.vllm_buildkite_builds",
35+
"vllm-buildkite-job-events": "vllm.vllm_buildkite_jobs",
3436
}
3537

3638

0 commit comments

Comments
 (0)