Skip to content

Does meta/llama-2-70b-chat use the original model weights? #84

@fancyerii

Description

@fancyerii

I have a question about "https://replicate.com/meta/llama-2-70b-chat" deployment. I read the codes of models/llama-2-70b-chat/config.py. it seems using exllama. What model do it use? Do you use TheBloke/Llama-2-70B-Chat-GPTQ ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions