[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

[NeurIPS 2024] Official code for PuLID: Pure and Lightning ID Customization via Contrastive Alignment

Transcribe on your own!

Interact with your SQL database, Natural Language to SQL using LLMs

A self-organizing file system with llama 3

turnkey self-hosted offline transcription and diarization service with llm summary

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

LLM Inference on AWS Lambda

LLM training in simple, raw C/CUDA

Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.

LLM Analytics

a text-based terminal client for Ollama

llama3 implementation one matrix multiplication at a time

WARC + AI - Experimental Retrieval Augmented Generation Pipeline for Web Archive Collections.

AI-powered Jupyter Notebook — use local AI to generate and edit code cells, automatically fix errors, and chat with your data

Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective…

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

YaFSDP: Yet another Fully Sharded Data Parallel

Localized watermarking for AI-generated speech audios, with SOTA on robustness and very fast detector

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2…

[ICLR 2025] From anything to mesh like human artists. Official impl. of "MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformers"

Generate ideal question-answers for testing RAG

[ICML 2024] EvTexture: Event-driven Texture Enhancement for Video Super-Resolution

Bring portraits to life!

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

PDF to Markdown with vision models

Easy Docker setup for Stable Diffusion with user-friendly UI

Gollama: Your offline conversational AI companion. An interactive tool for generating creative responses from various models, right in your terminal. Ideal for brainstorming, creative writing, or s…