Skip to content

Files

Latest commit

doublechenchingdoublechenching
init project
Mar 26, 2025
1b9f1ed · Mar 26, 2025

History

History
41 lines (34 loc) · 816 Bytes

INSTALL.md

File metadata and controls

41 lines (34 loc) · 816 Bytes

Install Tutorial

Miniconda

wget -O minicnda3.sh https://repo.anaconda.com/miniconda/Miniconda3-py39_24.5.0-0-Linux-x86_64.sh
bash minicnda3.sh -b -p /miniconda
rm minicnda3.sh
conda init
conda env create -n ori -f environment.yaml
conda activate ori

Pip

pip install --no-cache-dir -r requirements.txt

setup.py

python setup.py install

Other Options

Flash Attention

flash attention speed up for multihead attention

MAX_JOBS=4 pip install -U --no-cache-dir flash-attn==2.5.2 --no-build-isolation

Apex

apex speed up for rmsnorm and layernorm

git clone https://github.com/NVIDIA/apex  \
&& cd apex  \
&& git checkout 24.04.01  \
&& pip install -r requirements.txt  \
&& python3 setup.py install --cpp_ext --cuda_ext  \
&& cd ..