Add Example for Comet

[ParagEkbote]

Fixes #269

I've setup an example with the scikit-learn breast cancer dataset and a Random Forest Classifier model. How do I set up the comet API key for CI?

cc: @not522

[ParagEkbote]

Output of experiment for optimizing the f1 score:

[HideakiImamura]

@ParagEkbote Thanks for the PR. I'm worrying about the CI failure. All examples in this repository are continuously tested by the GitHub Actions, so I expect that this example can be tested too. It seems that the API key of the Comet is missing. Is is possible to generate the API key which can be used here?

[ParagEkbote]

@ParagEkbote Thanks for the PR. I'm worrying about the CI failure. All examples in this repository are continuously tested by the GitHub Actions, so I expect that this example can be tested too. It seems that the API key of the Comet is missing. Is is possible to generate the API key which can be used here?

No, we will probably need to add it as a GitHub repo secret in Settings->Secrets and Variables->Actions. WDYT?

cc: @HideakiImamura

[HideakiImamura]

Thanks for the reply. I understood.

Is it OK to use the generated API key of one of us (comitters) or should be use any universal API key?

[ParagEkbote]

Thanks for the reply. I understood.

Is it OK to use the generated API key of one of us (comitters) or should be use any universal API key?

Unless there is an enterprise plan available, we will need to use an individual API key.

cc: @HideakiImamura

[nzw0301]

I'm not sure but how about https://www.comet.com/docs/v2/api-and-sdk/python-sdk/advanced/running-offline/ like WandB example

optuna-examples/.github/workflows/wandb.yml

Line 37 in 70be131

wandb offline

?

[HideakiImamura]

I discussed with other committers. It would be great to remove the CI configuration file from this PR.

[ParagEkbote]

I discussed with other committers. It would be great to remove the CI configuration file from this PR.

I have removed the CI config file. Could you please review?

cc: @HideakiImamura

[nzw0301]

How about using the same objective and printing result code as
https://github.com/optuna/optuna-examples/blob/main/wandb/wandb_integration.py?

This is because it would be more easily understood without manually calling log_metric and similar code to other MLops code (namely, wandb here).

[nzw0301]

Hi @HideakiImamura, thank you for directing us.
Do you mean this repo does not test this comet example similar to the Kubernetes example https://github.com/optuna/optuna-examples/tree/main/kubernetes or plan to add CI config by another pull request for simplicity?

[ParagEkbote]

I have updated the example. Could you please review?

cc: @nzw0301

[nzw0301]

Lovely, I will check the changes this weekend!