Skip to content

Support loading of .bin, .pt, .pth models #31

@NamburiSrinath

Description

@NamburiSrinath

Hi @hemingkx, @hyx1999

I am wondering if it's possible to support loading of different file formats for benchmarking.

Not all models are HF-compatible and benchmarking on this repo would be very easy if this support is available.

Example when I tried to load .pt

OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory /xxx/xxx/experiments/llama_7b_0.25.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions