Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Assembly-level Feature Extraction #16

Open
wants to merge 180 commits into
base: main
Choose a base branch
from

Conversation

liaopeiyuan
Copy link
Collaborator

@liaopeiyuan liaopeiyuan commented Jul 27, 2021

Known records that results in OOM/Segfault on e5-2673:

'([6e24397e6a0f017cdf546cb2ec2116a5,4,8,8,512,1,1,512,2048,1,1,1,2048,4,8,8,2048,4,8,8,2048],llvm).json'  '([96a9c78ecf376dfe9479c94de3b5e43a,2,8,8,2048,2,8,8,2048],llvm).json'
'([8c674f26f66543069d1e1c56cda249f9,8,15,15,1024,1,1,1024,2048,1,1,1,2048,8,8,8,2048],llvm).json'         '([96a9c78ecf376dfe9479c94de3b5e43a,4,8,8,2048,4,8,8,2048],llvm).json'
'([96a9c78ecf376dfe9479c94de3b5e43a,1,8,8,2048,1,8,8,2048],llvm).json'                                    '([c985575127b3ad80868c19dff585d60b,1,100,36864,100,1,36864],llvm).json'
'([6e24397e6a0f017cdf546cb2ec2116a5,8,7,7,512,1,1,512,2048,1,1,1,2048,8,7,7,2048,8,7,7,2048],llvm).json'

Time taken roughly on a 64-core machine: 100 hours

Full-scale results on e5:

Model: xgb
RMSE: 0.0775
R^2: 0.7641
pairwise comparision accuracy: 0.8556
mape: 10064628454.7681
average peak score@1: 0.8368
average peak score@5: 0.9098

Model: lgbm
RMSE: 0.0727
R^2: 0.7928
pairwise comparision accuracy: 0.8665
mape: 10188322169.1727
average peak score@1: 0.8467
average peak score@5: 0.9203

e2e results:

XGB:

Estimated total latency: 17.791 ms Trials: 102 Used time : 18696 s Next ID: -1
Mean inference time (std dev): 15.84 ms (0.01 ms)

LightGBM:

Estimated total latency: 16.897 ms Trials: 102 Used time : 35345 s Next ID: -1
Mean inference time (std dev): 14.88 ms (0.02 ms)

Peiyuan Liao and others added 30 commits July 12, 2021 13:29
* fix typo (tlc-pack#12)

* update gpu dataset version

* Few-shot learning for end-to-end search; graph embedding; mlp model (tlc-pack#7)

* add few shot learning

* embedding

* embedding

* embedding

* embedding

* excluded certain networks

* excluded certain networks

* mlp

* mlp

* mlp

* Update dataset.py

* split dataset

* exclude dataset

* exclude dataset

* dataset

* add vgg

* a

* mlp

* mlp models

* mlp models

* a

* mlp model in eval

* plot

* eval model

* plot mlp

* mlp

* mlp load + vgg

* two mlp models

* mlp loss func by group

* remove vgg add eval gpu

* mlp loss by group

* mlp loss by group

* mlp loss by group multiple loaders

* plot

* mlp lambda rank remove device

* plot

* mlp

* plot

* weight by flop cnt

* delete plots

* plot

* plot

* weight by ctn

* mlp shuffle tasks

* renext

* mlp debug

* plots

* plots

* random from top two

* random from top two

* plots

* plot

* plot

* beam search

* random wearch debug

* plots

* plot debugger

* make plot

* plots

* eval model

* a

* eval model

* eval model

* eval model

* eval model

* eval

* comment out stuff

* get backstuff

* remove meta

* revert

* revert

* a model

* clean up mlp

* embedding

* a model

* clean up mlp

* clean up mlp

* hold out

* model

* a

* metrics

* models

* a

* eval model

* a

* dataset

* mlp debug

* lstm

* lstm

* lstm

* lstm

* lstm

* average top score

* lstm

* hold out all resnet50

* model

* target embedding

* multiple target

* a

* timestamp

* timestamp

* timestamp

* timestamp

* timestamp

* timestamp

* timestamp

* timestamp

* mlp

* cross platform

* minor bugs fixed

* local

* wrap up

* wrap up

* wrap up

* wrap up

* wrap up

* wrap up

* delete binary

* merge

* Update xgb_model.py

* Update dataset.py

* Update dataset.py

* Update dataset.py

* Update dispatcher.py

* Update task_scheduler.py

* remove binary

* Update workload_registry.py

* doc

* Delete graph_embedding.py

Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>

Co-authored-by: Lianmin Zheng <[email protected]>
Co-authored-by: ruochen99 <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
Co-authored-by: Ubuntu <[email protected]>
@liaopeiyuan
Copy link
Collaborator Author

This PR is ready for review.

@merrymercy merrymercy force-pushed the main branch 4 times, most recently from b4070bf to a3f54d7 Compare October 25, 2022 12:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant