Skip to content

Error while running inference on llama-2-7b-chat fine tune #20

@Pwntus

Description

@Pwntus

Trained on a16z-infra/llama-2-7b-chat:7b0bfc9aff140d5b75bacbed23e91fd3c34b01a1e958d32132de6e0a19796e2c

Inference error log:

[2023-08-23 08:08:21,585] [INFO] [real_accelerator.py:133:get_accelerator] Setting ds_accelerator to cuda (auto detect)
starting setup
Downloading https://storage.googleapis.com/replicate-weights/llama-2-7b-chat/Llama-2-7b-chat/llama_7b_fp16.tensors to models/llama-2-7b-chat/model_artifacts/training_weights/llama_7b_fp16.tensors
Downloading https://storage.googleapis.com/replicate-weights/llama-2-7b-chat/Llama-2-7b-chat/config.json to models/llama-2-7b-chat/model_artifacts/training_weights/config.json
weights loaded in 19.51545262336731
Downloading https://pbxt.replicate.delivery/Wev6tadimBWKdiYcXPJ6GiYH6M2fVp9cc24EHCFeKwClKa5iA/training_output.zip to local_weights.zip
Traceback (most recent call last):
File "/root/.pyenv/versions/3.10.12/lib/python3.10/site-packages/cog/server/worker.py", line 185, in _setup
run_setup(self._predictor)
File "/root/.pyenv/versions/3.10.12/lib/python3.10/site-packages/cog/predictor.py", line 98, in run_setup
predictor.setup(weights=weights)
File "/src/predict.py", line 77, in setup
self.model = self.load_peft(weights)
File "/src/predict.py", line 93, in load_peft
download_file(weights, local_weights)
File "/src/config.py", line 134, in download_file
os.makedirs(os.path.dirname(local_filename), exist_ok=True)
File "/root/.pyenv/versions/3.10.12/lib/python3.10/os.py", line 225, in makedirs
mkdir(name, mode)
FileNotFoundError: [Errno 2] No such file or directory: ''
Traceback (most recent call last):
  File "/root/.pyenv/versions/3.10.12/lib/python3.10/site-packages/cog/server/runner.py", line 292, in setup
    for event in worker.setup():
  File "/root/.pyenv/versions/3.10.12/lib/python3.10/site-packages/cog/server/worker.py", line 126, in _wait
    raise FatalWorkerException(raise_on_error + ": " + done.error_detail)
cog.server.exceptions.FatalWorkerException: Predictor errored during setup: [Errno 2] No such file or directory: ''

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions