updated goals

Author: mahmoudparsian

README.md

@@ -31,7 +31,7 @@ Original Creator of Apache Spark <br>
 
 ### Author: [Mahmoud Parsian](https://www.linkedin.com/in/mahmoudparsian/) 
 
-### Goal of this book: enable writing efficient & simpler PySpark code for data algorithms using Spark
+### [Goal of this book: Data Algorithms with Spark](./docs/goal_of_book.md)
 
 ### [Story of this book: Data Algorithms with Spark](./docs/story_of_book.md)
 

code/chap10/python/minmax_use_mappartitions_v2.sh

@@ -3,9 +3,9 @@
 #-----------------------------------------------------
 # @author Mahmoud Parsian
 #-----------------------------------------------------
-export SPARK_HOME="/book/spark-3.2.0"
+export SPARK_HOME="/book/spark-3.4.0"
 export INPUT_PATH="/book/code/chap10/sample_numbers.txt"
-export SPARK_PROG="/book/code/chap10/minmax_use_mappartitions.py"
+export SPARK_PROG="/book/code/chap10/minmax_use_mappartitions_v2.py"
 #
 # run the PySpark program:
 $SPARK_HOME/bin/spark-submit $SPARK_PROG $INPUT_PATH

docs/goal_of_book.md

@@ -0,0 +1,18 @@
+# Goal of this book: Data Algorithms with Spark
+
+1. Keep it SIMPLE!
+
+2. Goal of this book: enable writing efficient & 
+  simpler PySpark code for data algorithms using Spark
+
+3. A lot of [working PySpark code](../code/) is provided 
+   so that the reader can understand how to use basic 
+   transformations on using RDDs and DataFrames
+   
+4. As much as possible, I have avoided writing complex 
+   code and functions: keep it simple so that you can 
+   debug easily and your co-workers can understand them.
+   
+5. CUT-and-PASTE: you may take portions of the [code](../code/) 
+   and tailor it to your needs
+