Skip to content
Open
Show file tree
Hide file tree
Changes from 19 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 18 additions & 8 deletions 02_activities/assignments/assignment.sh
Original file line number Diff line number Diff line change
Expand Up @@ -28,22 +28,32 @@ unzip -q rawdata.zip
# Complete assignment here

# 1. Create a directory named data

mkdir data
# 2. Move the ./rawdata directory to ./data/raw (eg. move it into ./data and rename it to raw)

mv rawdata data/raw
# 3. List the contents of the ./data/raw directory

ls data/raw
# 4. Create the directory ./data/processed,
# then create the following sub-directories within it: server_logs, user_logs, and event_logs

mkdir ./data/processed
mkdir data/processed/server_logs
mkdir data/processed/user_logs
mkdir data/processed/event_logs
# 5. Copy all server log files (files with "server" in the name AND a .log extension) from ./data/raw to ./data/processed/server_logs

cp server_*.log /data/processed/server_logs
# 6. Repeat the above step for user logs and event logs

cp user_*.log /data/processed/user_logs
cp event_*.log /data/processed/event_logs
# 7. For user privacy, remove all files containing IP addresses (files with "ipaddr" in the filename) from ./data/raw and ./data/processed/user_logs

cd data/raw
rm user_ipaddr*.log
rm ipaddr*.txt
cd data/processed
cd data/processed/user_logs
rm user_ipaddr*.log
# 8. Create a file named ./data/inventory.txt that lists all the files in the subfolders of ./data/processed

touch data/inventory.txt
echo "data/processed/server_logs data/processed/user_logs data/processed/event_logs" > ./data/inventory.txt

###########################################

Expand Down
Empty file added newproject/README.md
Empty file.
Empty file added newproject/analysis/main.py
Empty file.