You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# code copy from https://github.com/huggingface/transformers/blob/66ab300aaff9ef509f8736cf186ab9b6a0ef4f3b/examples/pytorch/language-modeling/run_clm.py#L242-L249parser=HfArgumentParser((ModelArguments, DataTrainingArguments, TrainingArguments))
iflen(sys.argv) ==2andsys.argv[1].endswith(".json"):
# If we pass only one argument to the script and it's the path to a json file,# let's parse it to get our arguments.model_args, data_args, training_args=parser.parse_json_file(json_file=os.path.abspath(sys.argv[1]))
else:
model_args, data_args, training_args=parser.parse_args_into_dataclasses()
期待这个仓库越来越好~
The text was updated successfully, but these errors were encountered:
Megatron-lm的那套配置config,真的非常让人看懂。model_args、data_args、train_args 这种如果不熟悉的话,很难搞清楚。
我看了一下你们的代码:有
create_config.py
部分,然后在训练的时候,加载config.json
文件?当前思路确实很不错,但这种多个步骤,还是有点麻烦的。
可以按照hf的这种代码形式,
期待这个仓库越来越好~
The text was updated successfully, but these errors were encountered: