Skip to content

Start latency outline - #38

Open
MikeSpreitzer wants to merge 1 commit into
llm-d-incubation:mainfrom
MikeSpreitzer:add-latency-outline
Open

Start latency outline#38
MikeSpreitzer wants to merge 1 commit into
llm-d-incubation:mainfrom
MikeSpreitzer:add-latency-outline

Conversation

@MikeSpreitzer

Copy link
Copy Markdown
Collaborator

This PR adds a couple of end-to-end outlines, with a focus on latency.

This was referenced Sep 19, 2025
@github-actions

github-actions Bot commented Mar 9, 2026

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

I still think that we should have some documentation and clarity about where the latency comes from in real end-to-end scenarios.

@github-actions

github-actions Bot commented Apr 4, 2026

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

I still think that we need a document like this.

Copilot AI review requested due to automatic review settings April 9, 2026 20:33
@github-actions

github-actions Bot commented May 1, 2026

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

This Issue should, for now, be kept open.

@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

The force-push to d680777 is a rebase onto main.

@MikeSpreitzer
MikeSpreitzer force-pushed the add-latency-outline branch from d680777 to 3d9e0c0 Compare June 1, 2026 06:22
@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

The force-push to 3d9e0c0 is a rebase onto main, so that we can graduate from stage B of #471 .

@github-actions

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

@github-actions

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

This is still interesting.

Signed-off-by: Mike Spreitzer <mspreitz@us.ibm.com>
@MikeSpreitzer

Copy link
Copy Markdown
Collaborator Author

The force-push to 5090fae is a rebase onto main.

@github-actions

Copy link
Copy Markdown

This PR is marked as stale after 21d of inactivity. After an additional 14d of inactivity (7d to become rotten, then 7d more), it will be closed. To prevent this PR from being closed, add a comment or remove the lifecycle/stale label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant