Replacing Attention with Modality-wise Convolution for Energy-Efficient PPG-based Heart Rate Estimation using Knowledge Distillation

Simplified code of paper "Replacing Attention with Modality-wise Convolution for Energy-Efficient PPG-based Heart Rate Estimation using Knowledge Distillation" for educational purposes.

Run the notebooks in this order:

1. load_segment_data_.ipynb, to download, segment and store the data
2. teacher_dalia_.ipynb, to train/evaluate the teacher model
3. KD_student_dalia_.ipynb, to train/evaluate the student model