Skip to content

repositories Search Results · repo:learnagi/vllm-rag-api language:Python

Filter by

0 files
 (83 ms)

0 files

inlearnagi/vllm-rag-api (press backspace or delete to remove)

本仓库提供了一个基于强大的 Llama 3.2 模型的私有化实现的检索增强生成(RAG)API,使用 vLLM 进行优化部署以提升性能和可扩展性。该 API 结合了先进的语言建模和高效的检索技术,提供了强大的问答和文档生成能力。
  • Python
  • 3
  • Updated
    on Oct 14, 2024
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! 
Press the
/
key to activate the search input again and adjust your query.