You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: _extras/guide.md
+26-9Lines changed: 26 additions & 9 deletions
Original file line number
Diff line number
Diff line change
@@ -7,23 +7,34 @@ title: "Instructor Notes"
7
7
8
8
This document tries to describe what preparations are required of instructors to make the workshop work as smooth as possible. In order to build the materials for the workshop at your site, consult the `_config.yaml` file before you generate the site with `make site`. It contains the 'environment variables' that are specific to your workshop, such as the name of the login node, the root folder of the shared file system etc.
9
9
10
-
## Chapter 1
10
+
## Rational
11
11
12
-
### Section 1, Taking the space shuttle
12
+
The lineup of lessons is meant to be as flexible as possible. Skip lessons if needed.
13
13
14
-
At some point a folder named `this_weeks_canteen_menus` will be needed under `/tmp/this_weeks_canteen_menus` on the login node. Make sure before the lesson, that this folder is present. [/home/rob/this_weeks_canteen_menus](filesystem/home/rob/this_weeks_canteen_menus) of this material contains synthesized pdfs of a computerized canteen if you wish. You can use either these or prepare the menu of the canteen as single pdf files per day you'll go for the workshop into in this folder.
14
+
### Recap: Changing the Environment
15
15
16
-
### Section 2, Navigating Files and Directories
16
+
We start with environment variables as a recap and to get all learners on board. Feel free to skip this if you know from the pre-workshop survey that your learners are capable of this.
17
17
18
-
Make sure that for this lesson, that the contents of [filesystem](../filesystem) folder are available somewhere for the learners to download and unpack.
18
+
### Estimation of Pi for Pedestrians
19
19
20
-
## Chapter 2
20
+
This lessons introduces the computational working hourse for all of this material. We use this way to calculate pi as it is compute intensive and typically doesn't need any I/O. As it is compute intensive it renders itself as a good example to illustrate data parallelism. Other types of parallism (task parallelism, latency hiding, ...) are exluded from the material on purpose in order to keep the cognitive load on the learners low.
21
21
22
-
None so far.
22
+
In addition, this lesson does nothing more than profile the code to find hot spots with respect to performance, i.e. runtime.
23
23
24
-
## Chapter 3
24
+
### Parallel Estimation of Pi for Pedestrians
25
+
26
+
This lesson uses `multiprocessing` to parallelise the code in a shared memory environment.
27
+
28
+
### Higher levels of parallelism
29
+
30
+
This lesson introduces dask as a representative candidatae for cloud-native parallelisation approaches. This offers multiple things to the learners which often induce trouble in understanding.
31
+
32
+
It shows that there are libraries out there that perform parallization automatically. It also tries to demo the infrastructure required for this, i.e. setting up a server process that dispatches work to worker processes etc.
33
+
34
+
### Searching for Pi
35
+
36
+
This introduces concepts from high throughput computing by illustrating map-reduce style searches through files.
25
37
26
-
### Section 4, Searching for Pi
27
38
28
39
Use the file [generate_scrambled_data.py](./code/03_parallel_jobs/generate_scrambled_data.py) to produce 16 files that comply to the files used in this section, e.g. :
29
40
@@ -44,3 +55,9 @@ $ for i in `seq -f "%02.0f" 1 16`;do python3 ./generate_scrambled_data.py pi_est
44
55
At best, create directories for the each learner so that they don't get into each other's way.
45
56
46
57
Note, that this lesson is currently quite fragile as the i/o caching can easily get into the way of the learners.
58
+
59
+
60
+
### Bonus session: Distributing computations among computers
61
+
62
+
A guided tour through a mpi program with all it's nuances and brain quirks in program flow.
0 commit comments