Currently, we call config.log_config in the recipe_main which means this logs to every device.
We really only need this to happen once. See callsite here: https://github.com/pytorch/torchtune/blob/dd6764189d7e6ecc0f59902afb657dd60ee74b13/recipes/full_finetune_distributed.py#L1093
Currently, we call
config.log_configin the recipe_main which means this logs to every device.We really only need this to happen once. See callsite here: https://github.com/pytorch/torchtune/blob/dd6764189d7e6ecc0f59902afb657dd60ee74b13/recipes/full_finetune_distributed.py#L1093