Skip to content

Update benchmark input and output length lists #1059

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update benchmark input and output length lists #1059

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions benchmark/models_benchmark/online.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,9 @@ unset https_proxy
unset HTTP_PROXY
unset HTTPS_PROXY

INPUT_LEN_LIST="128 512 1024 2048 6144 14336 30720"
OUTPUT_LEN_LIST="128 512 1024 2048"
NUM_PROMPT_LIST="1 100 1000 2000"
INPUT_LEN_LIST="512 6144 30720 512 6144 30720"
OUTPUT_LEN_LIST="128 2048"
NUM_PROMPT_LIST="1000"
MAX_LATENCY_ALLOWED_MS=100000000000

LOG_FOLDER="$BASE/online-benchmark-$PURE_MODEL_NAME/$TAG"
Expand Down
Loading