Skip to content

Commit 6f58c54

Browse files
reduce dataset proportion for ogb training on pod4 (#46)
* reduce dataset proportion for ogb training on pod4 * precommit
1 parent d85c112 commit 6f58c54

File tree

1 file changed

+19
-1
lines changed

1 file changed

+19
-1
lines changed

ogb-competition/gps++_training.ipynb

Lines changed: 19 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@
3333
"source": [
3434
"#### Running on Paperspace\n",
3535
"\n",
36-
"> Currently, this notebook requires a POD16 machine type to run successfully.\n",
36+
"> This notebook is designed to be run on a POD16. If you are using a POD4 we will reduce the proportion of the dataset used to enable it to run. For training on the full dataset we recommend using a POD16.\n",
3737
"\n",
3838
"The Paperspace environment lets you run this notebook with no set up. To improve your experience we preload datasets and pre-install packages, this can take a few minutes, if you experience errors immediately after starting a session please try restarting the kernel before contacting support. If a problem persists or you want to give us feedback on the content of this notebook, please reach out to through our community of developers using our [slack channel](https://www.graphcore.ai/join-community) or raise a [GitHub issue](https://github.com/gradient-ai/Graphcore-Tensorflow2/issues)."
3939
]
@@ -245,6 +245,24 @@
245245
" wandb.init(entity=cfg.wandb_entity, project=cfg.wandb_project, config=cfg.as_dict())"
246246
]
247247
},
248+
{
249+
"cell_type": "markdown",
250+
"metadata": {},
251+
"source": [
252+
"This notebook is designed to be run on a POD16. If you are using a POD4 we will reduce the proportion of the dataset used to enable it to run. For training on the full dataset we recommend using a POD16."
253+
]
254+
},
255+
{
256+
"cell_type": "code",
257+
"execution_count": null,
258+
"metadata": {},
259+
"outputs": [],
260+
"source": [
261+
"pod_type = os.getenv(\"GRAPHCORE_POD_TYPE\", \"pod16\")\n",
262+
"if pod_type == \"pod4\":\n",
263+
" cfg.dataset.prop_to_use = 0.2"
264+
]
265+
},
248266
{
249267
"cell_type": "markdown",
250268
"metadata": {},

0 commit comments

Comments
 (0)