Skip to content

Commit 5aabacb

Browse files
committed
update lab 1 for reset env instructions
1 parent f508672 commit 5aabacb

File tree

1 file changed

+10
-0
lines changed

1 file changed

+10
-0
lines changed

Lab 1 - Introduction to Spark and HPC.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -144,6 +144,16 @@ Successfully installed py4j-0.10.9.7 pyspark-3.5.0
144144

145145
[`py4j`](https://www.py4j.org/) enables Python programmes to Java objects. We need it because Spark is written in scala, which is a Java-based language.
146146

147+
#### How to reset your environment
148+
149+
If you found that you’ve messed your environment up and encountered seemingly unrecoverable errors, please follow the steps below to reset your environment:
150+
151+
1. Log out of Stanage and log back in, then start an interactive session `run --pty bash -i`.
152+
2. Restore the default files by command `resetenv`. If the command `restenv` is not working (possibly removed from $PATH), you can run the resetenv command directly: `/opt/site/bin/resetenv`. See the instructions [here](https://docs.hpc.shef.ac.uk/en/latest/FAQs.html#strange-things-are-happening-with-my-terminal-or-my-terminal-seems-broken) for more details.
153+
3. Remove the conda environment files via `rm -rf ~/.conda` and `rm -rf ~/.condarc`.
154+
4. Log out fully & then back in again.
155+
5. Start an interactive session and follow the steps above to create the `myspark` environment.
156+
147157
#### Run pyspark
148158

149159
```sh

0 commit comments

Comments
 (0)