Skip to content

Conversation

@V2arK
Copy link
Contributor

@V2arK V2arK commented Oct 1, 2025

Testing for adding a fake recipe

Adding a testing recipe:

centml cserve-recipe update ~/Downloads/platform_db_test.json --cluster-id 1012
Processing 1 models from ~/Downloads/platform_db_test.json...
Target cluster ID: 1012

============================================================
✓ Update Complete
============================================================

CServe recipes update completed

Processed Models (1):
  ✓ Test/Test-VL-2B-Instruct

Resulting Recipe:

centml cserve-recipe list

CServe Recipes (19 found)

...

Model: Qwen/QwQ-32B
  Fastest:
    Hardware: ID: 1050 (details not found)
    Recipe: Qwen/QwQ-32B
    Parallelism: TP=2, PP=1

Model: Test/Test-VL-2B-Instruct
  Fastest:
    Hardware: small (ID: 1074, 1xH200)
    Recipe: Test/Test-VL-2B-Instruct
    Parallelism: TP=N/A, PP=N/A

Platform result:

image

Deleting the test recipe:

centml cserve-recipe delete Test/Test-VL-2B-Instruct
Are you sure you want to delete recipe for model 'Test/Test-VL-2B-Instruct'? [y/N]: y
✓ Successfully deleted recipe for model: Test/Test-VL-2B-Instruct

and the model is gone from the CLI and the platform:

image

Testing for updating a real recipe

centml cserve-recipe update ~/Downloads/platform_db_test.json --cluster-id 1012
Processing 1 models from ~/Downloads/platform_db_test.json...
Target cluster ID: 1012

============================================================
✓ Update Complete
============================================================

CServe recipes update completed

Processed Models (1):
  ✓ Qwen/Qwen2.5-VL-7B-Instruct
image image

@V2arK V2arK self-assigned this Oct 1, 2025
@V2arK V2arK marked this pull request as draft October 1, 2025 17:38
@V2arK V2arK closed this Oct 2, 2025
@V2arK V2arK deleted the honglin/add_platform_db_parsing_api branch October 2, 2025 16:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants