You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sync buildkite builds and jobs dynamoDB tables to ClickHouse (#7002)
A follow-up of #6998 and
#7001 to sync these dynamoDB
tables to ClickHouse, I will need to find a permanent home for these
tables instead of using `fortesting`
### Testing
Actually running and ingesting data at the moment (I update the lambda
manually on AWS). Also backfilling the data from DynamoDB as I have run
a debug version of #6998 since
mid July.
```
python dynamo2ch.py --dynamodb-table vllm-buildkite-build-events --clickhouse-table fortesting.vllm_buildkite_builds --stored-data vllm_buildkite_builds.json
```
```
python dynamo2ch.py --dynamodb-table vllm-buildkite-job-events --clickhouse-table fortesting.vllm_buildkite_jobs --stored-data vllm_buildkite_jobs.json
```
---------
Signed-off-by: Huy Do <[email protected]>
0 commit comments