Skip to content

Integrate llm-d-benchmark as part of the [guides](https://github.com/llm-d/llm-d/tree/main/guides) on llm-d main repository #611

@maugustosilva

Description

@maugustosilva

Component

Run

Desired use case or feature

The goal of this feature is to include easy to use, highly reproducible, instructions on how to use llm-d-benchmark with each one of the guides on llm-d.

Given llm-d-benchmark has itself capabilities to standup stacks and run workloads against it, the main goal of this feature is to allow only the latter (being the former done by simply following the guide)

Proposed solution

This will be carried out through several PRs, both on llm-d-benchmark and the llm-d repositories.

  1. PR 566 Benchmark runner for an existing stack (already merged on llm-d-benchmark)
  2. PR 559 Simple benchmarking guide, towards benchmarking well-lit paths (llm-d)
  3. PR 585 Configuration template for precise-prefix-cache-aware well-lit path benchmarking (llm-d)
  4. PR 586 Pd template (llm-d)

Alternatives

No response

Additional context or screenshots

No response

Metadata

Metadata

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions